Image data conversion method, apparatus, device, and medium

Abstract

The application is suitable for the technical field of image processing, and provides an image data conversion method, device, equipment and medium. The method comprises the following steps: acquiring pixel point coordinates of a first image, pixel point coordinates of a second image and an image curvature radius of the second image; calculating a reversible mapping relationship from a pixel point in the first image to a pixel point in the second image according to the image curvature radius; and converting the first image into an image with the pixel point coordinates of the second image, or converting the second image into an image with the pixel point coordinates of the first image according to the reversible mapping relationship. The application calculates the reversible mapping relationship according to the image curvature radius, and realizes image conversion based on the reversible mapping relationship, which provides a good foundation for displaying an image on a special-shaped screen with curvature or converting a special-shaped image with curvature (i.e. converting into a standard image or other curvature image), and avoids the problems of pixel loss or pixel misplacement that may occur when the image does not match the display screen.

Description

Technical Field

[0001] This application belongs to the field of image processing technology, and in particular relates to image data conversion methods, apparatus, devices and media. Background Technology

[0002] There is a problem in the field of image display that is often overlooked by those skilled in the art: how to display standard images on curved screens (e.g., fan-shaped screens, circular screens, etc. for specific events), and further, in some cases, how to display irregularly shaped images (e.g., arc-shaped pixel arrangement images with a first curvature) on mismatched curved screens (e.g., floor plan screens with a second curvature); or, how to convert irregularly shaped images into standard images.

[0003] Because this situation is relatively rare, those skilled in the art tend to adjust the initial image for a specific curved screen when faced with a problem. This is not only inefficient, but also cannot be applied to all types of curved screens.

[0004] Therefore, how to provide a universal image conversion method that can solve the problem of image display on curved screens and has a better and more stable display effect has become an urgent issue for the industry. Summary of the Invention

[0005] This application provides an image data conversion method, apparatus, device, and medium that can solve the problem of image display on curved screens.

[0006] In a first aspect, embodiments of this application provide an image data conversion method, including:

[0007] Obtain the pixel coordinates of the first image, the pixel coordinates of the second image, and the radius of curvature of the second image;

[0008] The reversible mapping relationship from pixels in the first image to pixels in the second image is calculated based on the radius of curvature of the image. The reversible mapping relationship refers to the coordinate transformation mapping from pixels in the i-th preset first set in the first image to pixels in the i-th preset second set in the second image. The number of the first set is the same as the number of the second set. i is a positive integer not greater than the number of the first set.

[0009] The first image is converted into an image with the pixel coordinates of the second image according to the reversible mapping relationship, or the second image is converted into an image with the pixel coordinates of the first image.

[0010] The above method calculates a reversible mapping relationship based on the radius of curvature of the image and realizes image conversion based on the reversible mapping relationship. It provides a good foundation for displaying images on irregularly shaped screens with curvature, or for converting irregularly shaped images with curvature (i.e. converting them into standard images or other curvature images), and avoids the pixel loss or pixel misalignment problems that may occur when the image and the display screen do not match.

[0011] In one possible implementation of the first aspect, the step of calculating the reversible mapping relationship from pixels in the first image to pixels in the second image based on the image radius of curvature includes:

[0012] The i-th circle is determined based on the radius of curvature of the image and the coordinates of the pixels in the first image; wherein the radius of the i-th circle is consistent with the radius of curvature of the image;

[0013] Based on the i-th circle, construct the coordinate transformation mapping from the i-th first set to the i-th second set.

[0014] The above method, by introducing the i-th circle as an intermediate parameter for constructing the reversible mapping relationship, can more accurately obtain the coordinate transformation mapping from the first image to the second image, thereby achieving a better display effect on irregularly shaped screens.

[0015] In one possible implementation of the first aspect, the first image is an image based on a linear arrangement of pixels, the i-th first set is composed of pixels in the i-th row of the first image, and the step of determining the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image includes:

[0016] The coordinates of the first circle center, whose distances relative to both the first and second coordinates are the radius of curvature of the image in the i-th second set, are calculated; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image.

[0017] The i-th circle is determined by taking the first circle center coordinates as the center and the radius of curvature of the i-th second set of images as the radius.

[0018] In one possible implementation of the first aspect, the first image is an image based on a linear arrangement of pixels, the i-th first set is composed of pixels in the i-th row of the first image, and the step of determining the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image includes:

[0019] The distance relative to the third coordinate is the radius of curvature of the image of the i-th second set, and the coordinates of the second center of the circle located on the i-th perpendicular bisector are calculated; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel of the i-th row of the first image as its endpoints; the third coordinate is the coordinate of the intersection point of the i-th line segment and the i-th perpendicular bisector.

[0020] The i-th circle is determined by taking the second circle center coordinates as the center and the radius of curvature of the i-th second set of images as the radius.

[0021] The two methods described above provide two different ways to determine the i-th circle, which can adapt to different computational needs, thereby achieving the effect of fast calculation and saving computational resources.

[0022] In one possible implementation of the first aspect, the step of constructing the coordinate transformation mapping from the i-th first set to the i-th second set based on the i-th circle includes:

[0023] For the j-th pixel in the i-th row of the first image, the coordinates of the intersection of the j-th ray and the i-th circle are determined as the mapping coordinates of the j-th pixel in the i-th second set, thus constructing the coordinate transformation relationship from the j-th pixel in the i-th row of the first image to the j-th pixel in the i-th second set; the j-th ray is a ray pointing from the center of the i-th circle to the j-th pixel in the i-th row of the first image; the number of pixels in the i-th first set is the same as the number of pixels in the i-th second set, and j is a positive integer not greater than the number of pixels in the i-th row of the first image.

[0024] The above method can construct a more accurate reversible mapping relationship by introducing the j-th ray to calculate the mapping coordinates.

[0025] In one possible implementation of the first aspect, the step of determining the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image includes:

[0026] For the j-th pixel in the i-th row of the first image, construct the j-th triangle; the j-th triangle is a right triangle with the center of the i-th circle, the coordinates of the j-th pixel in the i-th row of the first image, and a third coordinate as its vertices; the third coordinate is the coordinate of the intersection of the i-th line segment and the i-th perpendicular bisector; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel in the i-th row of the first image as its endpoints;

[0027] Calculate the distance between the third coordinate and the coordinates of the j-th pixel in the i-th row of the first image and record it as the first distance; calculate the distance between the third coordinate and the center of the i-th circle and record it as the second distance;

[0028] The ratio of the first distance to the second distance is calculated in radians using the arctangent function and denoted as the j-th radian.

[0029] Calculate the coordinates of the j-th pixel in the i-th second set based on the j-th radian and the i-th circle.

[0030] The above method uses elementary functions (inverse trigonometric functions) to quickly determine the output coordinates, which helps to reduce the time required for converting irregularly shaped screen images and improve conversion efficiency. Based on this, the animation display function based on multiple frames of images can be realized.

[0031] In one possible implementation of the first aspect, the step of determining the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image includes:

[0032] If the pixels in the i-th second set are determined to be uniformly distributed, then the major or minor arc on the i-th circle with the first coordinate and the second coordinate as endpoints is used to determine the i-th arc; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image;

[0033] With the constraint that the output coordinates of the pixels in the i-th row of the first image are evenly distributed on the i-th arc, the mapping coordinates of the j-th pixel in the i-th second set are calculated.

[0034] The above method calculates the pixel coordinates of the second set of pixels with uniform distribution. Due to the premise of uniform pixels, the output coordinates only need to be uniformly distributed on the i-th arc, which has a faster calculation speed compared to the above scheme based on inverse trigonometric functions.

[0035] Secondly, embodiments of this application provide an image data conversion apparatus, comprising:

[0036] The acquisition module is used to acquire the image curvature radius of the first image and the screen;

[0037] The mapping module is used to calculate the output coordinates of pixels in the first image based on the radius of curvature of the image; the output coordinates of pixels in the i-th group in the first image are all coordinate points on the i-th circle, and the radius of the i-th circle is consistent with the radius of curvature of the image; i is a positive integer not greater than the number of pixel groups in the first image;

[0038] A conversion module is used to display the pixel on the screen according to the output coordinates of the pixel.

[0039] Thirdly, embodiments of this application provide a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the image data conversion method described in any one of the first aspects above.

[0040] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the image data conversion method described in any one of the first aspects.

[0041] Fifthly, embodiments of this application provide a computer program product that, when run on a terminal device, causes the terminal device to execute the image data conversion method described in any one of the first aspects.

[0042] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0043] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0044] Figure 1 This is a flowchart illustrating the image data conversion method provided in an embodiment of this application;

[0045] Figure 2 This is a schematic diagram of the structure of the image data conversion device provided in the embodiments of this application;

[0046] Figure 3 This is a schematic diagram of the structure of the terminal device provided in the embodiments of this application;

[0047] Figure 4 This is a schematic diagram of the structure of the first image and the first curved screen provided in the embodiments of this application;

[0048] Figure 5 This is a schematic diagram of the structure of the second first image and the second curved screen provided in the embodiments of this application;

[0049] Figure 6This is a schematic diagram of the structure of the first curved screen and the second curved screen combined, as provided in the embodiments of this application.

[0050] Figure label:

[0051] Get module 201;

[0052] Mapping module 202;

[0053] Conversion module 203;

[0054] Terminal equipment 30;

[0055] Processor 301;

[0056] Memory 302;

[0057] Computer program 303;

[0058] First image 401;

[0059] The first curved screen has a resolution of 400.

[0060] Second first image 501;

[0061] The second curved screen is 500. Detailed Implementation

[0062] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0063] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0064] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0065] As used in this application specification and the appended claims, the term "if" may be interpreted, depending on the context, as "when," "once," "in response to determination," or "in response to detection." Similarly, the phrase "if determined" or "if detected [the described condition or event]" may be interpreted, depending on the context, as meaning "once determined," "in response to determination," "once detected [the described condition or event]," or "in response to detection [the described condition or event]."

[0066] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0067] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0068] First, the application scenarios of each embodiment of this application will be described.

[0069] The second LED image is composed of individual cabinets connected by network cables. For the screen to display correctly, each individual cabinet must first be lit. Rectangular cabinets are the most common, but with the diversification of applications, non-rectangular cabinets have emerged, such as fan-shaped, circular, and triangular ones. These irregular cabinets need to be obtained by cutting rectangular cabinets. If the effective pixels in the LED panel structure are not horizontally distributed but arranged with a certain curvature, the horizontal straight lines in the image will have a certain curvature according to the effective pixels of the LED panel during normal imaging, thus causing a deviation in the screen's load capacity.

[0070] The embodiments of this application calculate horizontal straight lines as curves with the same curvature, thus ensuring the horizontal presentation effect of effective horizontal pixels on the curvature light panel.

[0071] This application provides an image data conversion method, such as... Figure 1 As shown, it includes:

[0072] Step 102: Obtain the pixel coordinates of the first image, the pixel coordinates of the second image, and the radius of curvature of the second image;

[0073] Step 104: Calculate the reversible mapping relationship from pixels in the first image to pixels in the second image based on the radius of curvature of the image; the reversible mapping relationship refers to the coordinate transformation mapping from pixels in the i-th preset first set in the first image to pixels in the i-th preset second set in the second image; the number of the first set is the same as the number of the second set; i is a positive integer not greater than the number of the first set;

[0074] Step 106: Convert the first image into an image with the pixel coordinates of the second image according to the reversible mapping relationship, or convert the second image into an image with the pixel coordinates of the first image.

[0075] In this embodiment, the reversible mapping relationship can be used to convert a first image based on a straight line pixel arrangement into a second image based on an arc pixel arrangement (denoted as the first conversion), to convert a first image based on an arc arrangement with a first curvature into a second image based on an arc arrangement with a second curvature (denoted as the second conversion), and to convert a second image based on an arc pixel arrangement into a first image based on a straight line pixel arrangement (denoted as the third conversion).

[0076] The first and third transformations can be understood as reversible processes. Therefore, the first transformation will be used as an example to give a more specific explanation of this embodiment.

[0077] In the first conversion scenario, the steps in this embodiment can be specifically as follows:

[0078] Step 1020: Obtain the display curvature radius of the input image and the screen;

[0079] Step 1040: Calculate the output coordinates of the pixels in the input image based on the display curvature radius; the output coordinates of the pixels in the preset i-th set in the input image are all coordinates on the i-th circle, and the radius of the i-th circle is consistent with the display curvature radius; i is a positive integer not greater than the number of pixel groups in the input image;

[0080] Step 1060: Display the pixel on the screen according to the output coordinates of the pixel.

[0081] In this example, the input image can be understood as the first image, and the output pixel coordinates of the input image can be understood as the pixel coordinates of the second image.

[0082] The first image can be a standard rectangular first image, or an irregularly shaped first image, such as a triangular first image or a trapezoidal first image. The screen is irregularly shaped and the display points are arranged with curvature, such as a fan-shaped screen, a circular screen, or a screen that is part of a circular shape.

[0083] Here, a display point refers to the smallest light-emitting unit in the screen, such as a lamp bead in an LED light box.

[0084] The output of step 1040, i.e. the output coordinates, can be understood as the pixel display coordinates adapted to the above-mentioned irregular screen with curved display point arrangement. In contrast, the coordinates of the pixels in the first image can be defined as the input coordinates.

[0085] The beneficial effect of this example is:

[0086] By calculating the pixel output coordinates of the first image that match the screen (especially the screen's image curvature radius), the first image is converted into an output image with curvature adapted to irregularly shaped screens, and the screen is displayed based on this output image, thus achieving a better display effect on irregularly shaped screens and avoiding pixel loss or misalignment problems that may occur when the first image does not match the screen.

[0087] It is worth noting that although the screen commonly used in the various embodiments of this application may be a screen with the same curvature for each display point, this does not constitute a limitation on the arrangement of display points in the screen. The curvature of the display point arrangement in each row of the screen may be different.

[0088] In the actual application of this embodiment, due to the manufacturing precision problem of the screen (typically, such as the arrangement coordinate precision problem of LED beads in the manufacturing process of LED light boxes), the actual coordinates of some display points may not match the theoretical arc. In this case, the i-th circle can be adjusted to a certain extent to match the curve at a specific arc according to the actual manufacturing situation of the screen. Therefore, considering the screen manufacturing error, the i-th circle in this embodiment cannot be understood as a standard perfect circle.

[0089] In this embodiment, the concept of the i-th set is introduced to group the pixels of the first image from the perspective of screen display, so as to adapt to various irregular shapes of the first image. When the first image is a relatively regular shape, such as when the first image has rows or columns arranged in sequence, the i-th set can be understood as the i-th row or i-th column of the first image.

[0090] It is worth noting that the concept of row or column is related to the viewing perspective. Therefore, in the various embodiments of this application, the first image pixels that are on the same straight line are collectively referred to as rows, which does not constitute a limitation on the scope of protection.

[0091] The beneficial effects of this embodiment are as follows:

[0092] By calculating the reversible mapping relationship based on the radius of curvature of the image, and realizing image conversion based on the reversible mapping relationship, a good foundation is provided for displaying images on irregularly shaped screens with curvature, or for converting irregularly shaped images with curvature (i.e. converting them into standard images or other curvature images), avoiding pixel loss or pixel misalignment problems that may occur when the image and the display screen do not match.

[0093] Based on the above embodiments, this embodiment provides a specific method for calculating the output coordinates, specifically:

[0094] The step of calculating the reversible mapping relationship from pixels in the first image to pixels in the second image based on the radius of curvature of the image includes:

[0095] The i-th circle is determined based on the radius of curvature of the image and the coordinates of the pixels in the first image; wherein the radius of the i-th circle is consistent with the radius of curvature of the image;

[0096] Based on the i-th circle, construct the coordinate transformation mapping from the i-th first set to the i-th second set.

[0097] Furthermore, still using the first conversion case as an example, the implementation method is described below:

[0098] The set of pixels in the i-th row of the first image constitutes the i-th set;

[0099] The step of calculating the output coordinates of pixels in the first image based on the radius of curvature of the image includes:

[0100] The i-th circle is determined based on the radius of curvature of the image and the input coordinates of the pixels in the first image; the input coordinates refer to the coordinates of the pixels in the rectangular first image; the i-th circle corresponds one-to-one with the i-th row of the rectangular first image.

[0101] The output coordinates of the pixel are calculated based on the i-th circle and the input coordinates.

[0102] In this embodiment, the pixels in the i-th row of the first image are located on the same straight line; further, in a preferred embodiment, all pixels of the first image are located on a series of equally spaced parallel straight lines, for example... Figure 4 The first image shown is 401 or Figure 5 The second first image 501 is shown.

[0103] As an example rather than a limitation, for a screen with a uniform radius of curvature for images, the i-th circle is a series of reference circles with the same radius and their center coordinates spaced apart. By introducing this reference circle, the output coordinates can be calculated better and more accurately.

[0104] The beneficial effects of this embodiment are as follows:

[0105] By performing arcuate output based on the radius of curvature of the image on a pixel-by-pixel basis, the output coordinates of the pixels in the first image can be obtained more accurately, resulting in a better display effect on irregularly shaped screens.

[0106] The beneficial effects of this embodiment are as follows:

[0107] By introducing the i-th circle as an intermediate parameter for constructing the reversible mapping relationship, the coordinate transformation mapping from the first image to the second image can be obtained more accurately, thus achieving a better display effect on irregularly shaped screens.

[0108] Based on any of the above embodiments, this embodiment provides two schemes for determining the i-th circle, specifically:

[0109] In the first scheme, the first image is an image with pixels arranged in a straight line, and the i-th first set is composed of pixels in the i-th row of the first image. The step of determining the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image includes:

[0110] The coordinates of the first circle center, whose distances relative to both the first and second coordinates are the radius of curvature of the image in the i-th second set, are calculated; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image.

[0111] The i-th circle is determined by taking the first circle center coordinates as the center and the radius of curvature of the i-th second set of images as the radius.

[0112] In the second approach, the first image is an image with pixels arranged in a straight line, and the i-th first set is composed of pixels in the i-th row of the first image. The step of determining the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image includes:

[0113] The distance relative to the third coordinate is the radius of curvature of the image of the i-th second set, and the coordinates of the second center of the circle located on the i-th perpendicular bisector are calculated; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel of the i-th row of the first image as its endpoints; the third coordinate is the coordinate of the intersection point of the i-th line segment and the i-th perpendicular bisector.

[0114] The i-th circle is determined by taking the second circle center coordinates as the center and the radius of curvature of the i-th second set of images as the radius.

[0115] Furthermore, taking the first conversion scenario as an example, the implementation method is provided as follows.

[0116] In the first embodiment, the step of determining the i-th circle based on the radius of curvature of the image and the input coordinates of the pixels in the first image includes:

[0117] The calculated coordinates are the coordinates of the first center of a circle whose distances relative to both the first and second coordinates are the radius of curvature of the image; the first coordinate is the input coordinate of the first pixel in the i-th row of the first image; the second coordinate is the input coordinate of the last pixel in the i-th row of the first image.

[0118] The i-th circle is determined by taking the first circle center coordinates as the center and the image curvature radius as the radius.

[0119] In the second embodiment, the step of determining the i-th circle based on the radius of curvature of the image and the input coordinates of the pixels in the first image includes:

[0120] The distance relative to the third coordinate is the radius of curvature of the image, and the coordinates of the second center of the circle are located on the i-th perpendicular bisector; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment whose endpoints are the first pixel and the last pixel of the i-th row of the first image; the third coordinate is the coordinate of the intersection point of the i-th line segment and the i-th perpendicular bisector;

[0121] The i-th circle is determined by taking the second circle center coordinates as the center and the image curvature radius as the radius.

[0122] This embodiment provides two optional schemes for determining the i-th circle. For the same screen, one of the two schemes can be selected to ensure the display effect on a single screen. For different screens, different schemes for determining the i-th circle can be selected based on the characteristics of the screen and the first image.

[0123] For example, targeting Figure 4The first curved screen 400 and the first image 401 shown have a bottom edge length (actually, the number of pixels at the bottom edge is considered. Since the pixels are usually evenly distributed in the first image, it is feasible and convenient to use the length instead of the number of pixels for calculation) that is consistent with the bottom arc length of the first curved screen 400 (similarly, the number of display points on the bottom arc is considered). Based on this, each row of the first image 401 can correspond well with the corresponding arc length of the first curved screen 400. Therefore, the second scheme can more conveniently match the spacing of the pixels in the first image row with the spacing of the display points in the screen arc, thereby achieving the effect of easy calculation.

[0124] For example, targeting Figure 5 The second curved screen 500 and the second first image 501 shown have a bottom edge length (similarly considering the number of pixels at the bottom edge) that is consistent with the distance between the two ends of the bottom arc of the second curved screen 500. Based on this, the distance between each row of the second first image 501 and the corresponding two ends of the arc of the second curved screen 500 can be well corresponded. Therefore, the first scheme can better match the spacing ratio of pixels in the first image row with the spacing ratio of display points in the screen arc, thereby achieving the effect of easy calculation.

[0125] Furthermore, the first curved screen 400 and the second curved screen 500 can be used in combination in practical applications, such as... Figure 6 As shown, the first and second schemes mentioned above can be executed simultaneously in some combined scenarios.

[0126] Furthermore, the step of determining the i-th circle can be repeated until the i-th circle for all rows of the first image has been determined.

[0127] The beneficial effects of this embodiment are as follows:

[0128] By providing two different methods for determining the i-th circle, it is possible to adapt to the computational needs of different input images and screen pairs, thereby achieving the effect of fast computation and saving computational resources.

[0129] According to any of the above embodiments, this embodiment provides an optional method for calculating output coordinates, specifically:

[0130] The step of constructing the coordinate transformation mapping from the i-th first set to the i-th second set based on the i-th circle includes:

[0131] For the j-th pixel in the i-th row of the first image, the coordinates of the intersection of the j-th ray and the i-th circle are determined as the mapping coordinates of the j-th pixel in the i-th second set, thus constructing the coordinate transformation relationship from the j-th pixel in the i-th row of the first image to the j-th pixel in the i-th second set; the j-th ray is a ray pointing from the center of the i-th circle to the j-th pixel in the i-th row of the first image; the number of pixels in the i-th first set is the same as the number of pixels in the i-th second set, and j is a positive integer not greater than the number of pixels in the i-th row of the first image.

[0132] Furthermore, an example of the implementation method in the first conversion scenario is as follows.

[0133] The step of calculating the output coordinates of the pixel based on the i-th circle and the input coordinates includes:

[0134] For the j-th pixel in the i-th row of the first image, the coordinates of the intersection of the j-th ray and the i-th circle are determined as the output coordinates of the pixel; the j-th ray is a ray with the center of the i-th circle as its endpoint pointing to the input coordinates of the pixel; j is a positive integer not greater than the number of pixels in the i-th row of the first image.

[0135] Furthermore, the step of determining the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image includes:

[0136] For the j-th pixel in the i-th row of the first image, construct the j-th triangle; the j-th triangle is a right triangle with the center of the i-th circle, the coordinates of the j-th pixel in the i-th row of the first image, and a third coordinate as its vertices; the third coordinate is the coordinate of the intersection of the i-th line segment and the i-th perpendicular bisector; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel in the i-th row of the first image as its endpoints;

[0137] Calculate the distance between the third coordinate and the coordinates of the j-th pixel in the i-th row of the first image and record it as the first distance; calculate the distance between the third coordinate and the center of the i-th circle and record it as the second distance;

[0138] The ratio of the first distance to the second distance is calculated in radians using the arctangent function and denoted as the j-th radian.

[0139] Calculate the coordinates of the j-th pixel in the i-th second set based on the j-th radian and the i-th circle.

[0140] Correspondingly, the implementation example in the first conversion scenario is as follows.

[0141] The step of determining the output coordinates of the intersection point of the j-th ray and the i-th circle for the j-th pixel in the i-th row of the first image includes:

[0142] For the j-th pixel in the i-th row of the first image, construct the j-th triangle; the j-th triangle is a right triangle with the center of the i-th circle, the input coordinates of the j-th pixel, and a third coordinate as its vertices; the third coordinate is the coordinate of the intersection of the i-th line segment and the i-th perpendicular bisector; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel in the i-th row of the first image as its endpoints;

[0143] Calculate the distance between the third coordinate and the input coordinate of the j-th pixel and record it as the first distance; calculate the distance between the third coordinate and the center of the i-th circle and record it as the second distance;

[0144] The ratio of the first distance to the second distance is calculated in radians using the arctangent function and denoted as the j-th radian.

[0145] The output coordinates of the j-th pixel are calculated based on the j-th radian and the i-th circle.

[0146] It is worth noting that the step of calculating the output coordinates of the j-th pixel can be repeated until the output coordinates of all pixels have been calculated.

[0147] After all the output coordinates of the pixels have been calculated, update the value of i and repeat the above steps until the output coordinates of all the pixels of the first image have been calculated.

[0148] In an optional implementation, the above steps can be refined as follows:

[0149] 1. Set the distance from the line to the vertex (center of the circle);

[0150] 2. Given the start and end coordinates, the coordinates between them can be calculated. Since the data in this row is on a straight line, the coordinates of the center of the circle can be calculated. The center of the circle and the current start and end positions form an equilateral triangle.

[0151] 3. Each point on the line segment, the midpoint, and the center of the circle form a right triangle.

[0152] 4. Draw a circle with the radius to form an arc with the starting and ending positions. The points where the line segment intersects the arc are the points where the straight line needs to be turned into an arc.

[0153] 5. The angles can be calculated from the right triangle formed. The nth point needs to be rotated by a certain angle from the starting point to obtain the coordinates of the sequential point.

[0154] 6. Use sine and cosine functions to calculate the output coordinates.

[0155] The solution in this embodiment can be used to solve the following problems:

[0156] The arrangement of LED screen lights is limited by the physical structure of the light board. If the light board arrangement has a certain curvature during the production of the light board, the horizontally imaged image will also have a certain curvature due to the structure of the light board. In order to ensure the normal display of straight lines in the image, the effective pixels need to be deflected to a certain extent so that the horizontal straight lines in the image can be displayed as straight lines in the curved light board.

[0157] In this embodiment, the curvature calculation ensures that each straight line in the light panel is projected onto a curve at a certain distance from the center of the sphere, thus improving the accuracy of the image rendering of the curved light panel. Furthermore, this embodiment allows for the creation of a user-friendly software interface that meets various practical production needs, ultimately liberating productivity.

[0158] In summary, this embodiment uses the distance of a row of data within the current data group from the center point of the sphere as the arc length, accurately distributing the effective pixels of the current row of data on the curvature curve at the same distance from the center point of the sphere, thus ensuring that the current row of data accurately corresponds to the points required for the arc display.

[0159] thereby:

[0160] In spherical display, an algorithm is used to shield the curvature of the spherical light panel itself, thereby correctly displaying the image of the loaded area. Multiple arc-shaped single panels are spliced ​​together to accurately display the image of the loaded area.

[0161] In actual production processes, users will face complex and diverse needs. The software provides users with complete functions to meet their actual needs. When displaying on a spherical screen, the algorithm loads each line of data onto the curved light board to ensure display accuracy.

[0162] The beneficial effects of this embodiment are as follows:

[0163] Using elementary functions (inverse trigonometric functions) to quickly determine the output coordinates helps reduce the time required for converting irregularly shaped screen images and improves conversion efficiency. Based on this, animation display function based on multi-frame images can be realized.

[0164] Based on any of the above embodiments, this embodiment will provide another method for calculating the output coordinates, specifically:

[0165] The step of determining the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image includes:

[0166] If the pixels in the i-th second set are determined to be uniformly distributed, then the major or minor arc on the i-th circle with the first coordinate and the second coordinate as endpoints is used to determine the i-th arc; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image;

[0167] With the constraint that the output coordinates of the pixels in the i-th row of the first image are evenly distributed on the i-th arc, the mapping coordinates of the j-th pixel in the i-th second set are calculated.

[0168] In one possible implementation of the first conversion scenario:

[0169] Step 5, which calculates the output coordinates of the pixel based on the i-th circle and the input coordinates, includes:

[0170] If the pixels in the i-th row of the first image are uniformly distributed, then the major or minor arc on the i-th circle with the first coordinate and the second coordinate as endpoints is used to determine the i-th arc;

[0171] The output coordinates are calculated by constraining the uniform distribution of the output coordinates of the pixels in the i-th row of the first image on the i-th arc.

[0172] In a preferred embodiment, the i-th circle is determined using the first scheme described above, so that the i-th arc determined by the first and second coordinates can better correspond to the display point on the screen. Based on this, the output coordinates of the first image with uniformly distributed pixels are calculated. Due to the premise of uniform pixels, the output coordinates only need to be uniformly distributed on the i-th arc, which has a faster calculation speed than the scheme based on the inverse trigonometric function described above.

[0173] It is worth noting that whether the i-th arc is a major or minor arc depends on whether the display point on the screen corresponding to the i-th row of pixels of the first image forms the major or minor arc of the i-th circle. In other words, in each embodiment of this application, at least a portion of the i-th circle can be matched with the display point on the screen corresponding to the i-th row of pixels of the first image.

[0174] The beneficial effects of this embodiment are as follows:

[0175] The output coordinates of the first image with uniformly distributed pixels are calculated. Due to the premise of uniform pixels, the output coordinates only need to be uniformly distributed on the i-th arc, which has a faster calculation speed compared to the above scheme based on inverse trigonometric functions.

[0176] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0177] 5 corresponds to the image data conversion method described in the above embodiments. Figure 2 A structural block diagram of an image data conversion apparatus provided in an embodiment of this application is shown. For ease of explanation, only the parts related to the embodiments of this application are shown.

[0178] Reference Figure 2 The device includes:

[0179] The acquisition module 201 is used to acquire the pixel coordinates of the first image, the pixel coordinates of the second image, and the radius of curvature of the second image;

[0180] Mapping module 202 is used to calculate a reversible mapping relationship from pixels in the first image to pixels in the second image based on the radius of curvature of the image; the reversible mapping relationship refers to the coordinate transformation mapping from pixels in the i-th preset first set in the first image to pixels in the i-th preset second set in the second image; the number of the first set is the same as the number of the second set; i is a positive integer not greater than the number of the first set;

[0181] The conversion module 203 is used to convert the first image into an image with the pixel coordinates of the second image according to the reversible mapping relationship, or to convert the second image into an image with the pixel coordinates of the first image.

[0182] Further, the set of pixels in the i-th row of the first image constitutes the i-th set, and the mapping module 202 includes:

[0183] The i-th circle determination unit is used to determine the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image; wherein the radius of the i-th circle is consistent with the radius of curvature of the image;

[0184] The output mapping unit is used to construct a coordinate transformation mapping from the i-th first set to the i-th second set based on the i-th circle.

[0185] The i-th circle determination unit includes:

[0186] The first circle center coordinate determination subunit is used to calculate the first circle center coordinates, which are the radius of curvature of the image relative to both the first and second coordinates and the distance to the i-th second set; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image;

[0187] The first circle determination subunit is used to determine the i-th circle with the first circle center coordinates as the center and the radius of curvature of the image of the i-th second set as the radius.

[0188] Alternatively, the i-th circle determination unit includes:

[0189] The second center coordinate determination subunit is used to calculate the second center coordinates relative to the third coordinates, which is the radius of curvature of the image of the i-th second set, and located on the i-th perpendicular bisector; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment whose endpoints are the first pixel and the last pixel of the i-th row of the first image; the third coordinates are the coordinates of the intersection point of the i-th line segment and the i-th perpendicular bisector;

[0190] The second circle determination subunit is used to determine the i-th circle with the second circle center coordinates as the center and the radius of curvature of the image of the i-th second set as the radius.

[0191] The output mapping unit includes:

[0192] A ray subunit is used to determine the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image, and to construct the coordinate transformation relationship from the j-th pixel in the i-th row of the first image to the j-th pixel in the i-th second set; the j-th ray is a ray pointing from the center of the i-th circle to the j-th pixel in the i-th row of the first image; the number of pixels in the i-th first set is the same as the number of pixels in the i-th second set, and j is a positive integer not greater than the number of pixels in the i-th row of the first image.

[0193] The ray subunit includes:

[0194] The j-th triangle portion is used to construct the j-th triangle for the j-th pixel in the i-th row of the first image; the j-th triangle is a right triangle with the center of the i-th circle, the coordinates of the j-th pixel in the i-th row of the first image, and a third coordinate as its vertices; the third coordinate is the coordinate of the intersection of the i-th line segment and the i-th perpendicular bisector; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel in the i-th row of the first image as its endpoints;

[0195] The distance component is used to calculate the distance between the third coordinate and the coordinates of the j-th pixel in the i-th row of the first image, and denoted as the first distance; and to calculate the distance between the third coordinate and the center of the i-th circle, and denoted as the second distance.

[0196] The arctangent part is used to calculate the radians corresponding to the ratio of the first distance to the second distance using the arctangent function and denoted as the j-th radian;

[0197] The coordinate part is used to calculate the coordinates of the j-th pixel in the i-th second set based on the j-th radian and the i-th circle.

[0198] Alternatively, the output coordinate unit includes:

[0199] The i-th arc subunit is used to determine the uniform distribution of pixels in the i-th second set. Then, the superior or inferior arc on the i-th circle with the first coordinate and the second coordinate as endpoints is used to determine the i-th arc; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image.

[0200] The coordinate sub-unit is used to calculate the mapped coordinates of the j-th pixel in the i-th second set, with the constraint that the output coordinates of the pixels in the i-th row of the first image are uniformly distributed on the i-th arc.

[0201] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0202] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0203] This application also provides a terminal device, such as... Figure 3As shown, the terminal device 30 includes: at least one processor 301, a memory 302, and a computer program 303 stored in the memory and executable on the at least one processor. When the processor executes the computer program, it implements the steps in any of the above-described method embodiments.

[0204] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps described in the various method embodiments above.

[0205] This application provides a computer program product that, when run on a mobile terminal, enables the mobile terminal to implement the steps described in the various method embodiments.

[0206] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0207] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0208] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0209] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0210] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0211] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. An image data conversion method, characterized in that, include: Obtain the pixel coordinates of the first image, the pixel coordinates of the second image, and the radius of curvature of the second image; Calculate the reversible mapping relationship from pixels in the first image to pixels in the second image based on the radius of curvature of the image; The reversible mapping relationship refers to the coordinate transformation mapping from the i-th preset first set of pixels in the first image to the i-th preset second set of pixels in the second image; The number of elements in the first set is the same as the number of elements in the second set; i is a positive integer not greater than the number of elements in the first set; The first image is converted into an image with the pixel coordinates of the second image according to the reversible mapping relationship, or the second image is converted into an image with the pixel coordinates of the first image; The step of calculating the reversible mapping relationship from pixels in the first image to pixels in the second image based on the radius of curvature of the image includes: The i-th circle is determined based on the radius of curvature of the image and the coordinates of the pixels in the first image; wherein the radius of the i-th circle is consistent with the radius of curvature of the image; Based on the i-th circle, construct the coordinate transformation mapping from the i-th first set to the i-th second set; The first image is an image based on pixels arranged in a straight line. The i-th first set is composed of pixels in the i-th row of the first image. The step of determining the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image includes: The coordinates of the first circle center, whose distances relative to both the first and second coordinates are the radius of curvature of the image in the i-th second set, are calculated; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image. The i-th circle is determined by taking the first circle center coordinates as the center and the radius of curvature of the i-th second set of images as the radius; The step of constructing the coordinate transformation mapping from the i-th first set to the i-th second set based on the i-th circle includes: For the j-th pixel in the i-th row of the first image, the coordinates of the intersection of the j-th ray and the i-th circle are determined as the mapping coordinates of the j-th pixel in the i-th second set, thus constructing the coordinate transformation relationship from the j-th pixel in the i-th row of the first image to the j-th pixel in the i-th second set; the j-th ray is a ray pointing from the center of the i-th circle to the j-th pixel in the i-th row of the first image; the number of pixels in the i-th first set is the same as the number of pixels in the i-th second set, and j is a positive integer not greater than the number of pixels in the i-th row of the first image.

2. The image data conversion method as described in claim 1, characterized in that, The first image is an image based on pixels arranged in a straight line. The i-th first set is composed of pixels in the i-th row of the first image. The step of determining the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image includes: The distance relative to the third coordinate is the radius of curvature of the image of the i-th second set, and the coordinates of the second center of the circle located on the i-th perpendicular bisector are calculated; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel of the i-th row of the first image as its endpoints; the third coordinate is the coordinate of the intersection point of the i-th line segment and the i-th perpendicular bisector. The i-th circle is determined by taking the second circle center coordinates as the center and the radius of curvature of the i-th second set of images as the radius.

3. The image data conversion method as described in claim 1 or 2, characterized in that, The step of determining the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image includes: For the j-th pixel in the i-th row of the first image, construct the j-th triangle; the j-th triangle is a right triangle with the center of the i-th circle, the coordinates of the j-th pixel in the i-th row of the first image, and a third coordinate as its vertices; the third coordinate is the coordinate of the intersection of the i-th line segment and the i-th perpendicular bisector; the i-th perpendicular bisector is the perpendicular bisector of the i-th line segment; the i-th line segment is the line segment with the first pixel and the last pixel in the i-th row of the first image as its endpoints; Calculate the distance between the third coordinate and the coordinates of the j-th pixel in the i-th row of the first image and record it as the first distance; calculate the distance between the third coordinate and the center of the i-th circle and record it as the second distance; The ratio of the first distance to the second distance is calculated in radians using the arctangent function and denoted as the j-th radian. Calculate the coordinates of the j-th pixel in the i-th second set based on the j-th radian and the i-th circle.

4. The image data conversion method as described in claim 1 or 2, characterized in that, The step of determining the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image includes: If the pixels in the i-th second set are determined to be uniformly distributed, then the major or minor arc on the i-th circle with the first coordinate and the second coordinate as endpoints is used to determine the i-th arc; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image; With the constraint that the output coordinates of the pixels in the i-th row of the first image are evenly distributed on the i-th arc, the mapping coordinates of the j-th pixel in the i-th second set are calculated.

5. An image data conversion device, characterized in that, include: The acquisition module is used to acquire the image curvature radius of the first image and the screen; The mapping module is used to calculate the output coordinates of pixels in the first image based on the radius of curvature of the image; In the first image, the output coordinates of the pixels in the preset i-th set are all coordinates on the i-th circle, and the radius of the i-th circle is consistent with the radius of curvature of the image; i is a positive integer not greater than the number of pixel groups in the first image; A conversion module is used to display the pixel on the screen according to the output coordinates of the pixel; The mapping module includes: The i-th circle determination unit is used to determine the i-th circle based on the radius of curvature of the image and the coordinates of the pixels in the first image; wherein the radius of the i-th circle is consistent with the radius of curvature of the image; The output mapping unit is used to construct a coordinate transformation mapping from the i-th first set to the i-th second set based on the i-th circle; The first image is an image based on pixels arranged in a straight line, and the i-th first set is composed of pixels in the i-th row of the first image; the i-th circle determination unit includes: The first circle center coordinate determination subunit is used to calculate the first circle center coordinates, which are the radius of curvature of the image relative to both the first and second coordinates and the distance to the i-th second set; the first coordinate is the coordinate of the first pixel in the i-th row of the first image; the second coordinate is the coordinate of the last pixel in the i-th row of the first image; The first circle determination subunit is used to determine the i-th circle with the first circle center coordinates as the center and the radius of curvature of the image of the i-th second set as the radius; The output mapping unit includes a ray subunit, used to determine the coordinates of the intersection point of the j-th ray and the i-th circle as the mapping coordinates of the j-th pixel in the i-th second set for the j-th pixel in the i-th row of the first image, and to construct the coordinate transformation relationship from the j-th pixel in the i-th row of the first image to the j-th pixel in the i-th second set; the j-th ray is a ray pointing from the center of the i-th circle to the j-th pixel in the i-th row of the first image; the number of pixels in the i-th first set is the same as the number of pixels in the i-th second set, and j is a positive integer not greater than the number of pixels in the i-th row of the first image.

6. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method as described in any one of claims 1 to 4.

7. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 4.

Images