Display data processing method, system, storage medium and electronic device

Abstract

The present disclosure provides a display data processing method, system, storage medium, and electronic device. The display data processing method, applied to a processing terminal, includes determining a to-be-displayed area based on a target to be displayed; determining reference pixel coordinates based on the resolution of the display terminal and the to-be-displayed area; determining pixel information of the target to be displayed based on the reference pixel coordinates; and concatenating the reference pixel coordinates and the pixel information to obtain updated information, which is then transmitted to the display terminal. The present disclosure concatenates the reference pixel coordinates and the pixel information of the target to be displayed, and then transmits only the resulting updated information, eliminating the need to transmit the entire display information. This significantly improves transmission efficiency and reduces bandwidth usage.

Description

Technical Field

[0001] The present disclosure relates to the technical field of display data processing, and in particular to a display data processing method, system, storage medium, and electronic device. Background Art

[0002] Augmented Reality (AR) is a technology that calculates the position and angle of a camera image in real time and superimposes corresponding images. Its goal is to overlay the virtual world onto the real world on a screen for interaction. Due to its high degree of realism, AR is widely used in weapons and aircraft research and development, data model visualization, virtual training, entertainment, and art. Furthermore, as the computing power of electronic devices continues to increase, the uses of AR will continue to expand.

[0003] Specifically, during AR display, the processing terminal typically renders the target to be displayed according to the resolution of the display terminal screen. Areas other than the area corresponding to the target to be displayed are set to black pixels, which are transparent in AR systems. The entire rendered display information is then transmitted to the display terminal for display. However, transmitting the entire display information each time results in low transmission efficiency. Summary of the Invention

[0004] In view of this, the purpose of the present disclosure is to provide a display data processing method, system, storage medium and electronic device, which can solve the problem of low transmission efficiency caused by transmitting the entire display information each time.

[0005] In a first aspect, the present disclosure provides a display data processing method, applied to a processing terminal, comprising:

[0006] determining a to-be-displayed area based on the to-be-displayed object;

[0007] Determining reference pixel coordinates based on the resolution of the display terminal and the area to be displayed;

[0008] Determining pixel information of the to-be-displayed object based on the reference pixel coordinates;

[0009] The reference pixel coordinates and the pixel information are spliced ​​together to obtain update information, and the update information is transmitted to the display terminal.

[0010] In a possible implementation, determining the area to be displayed based on the target to be displayed includes:

[0011] Determine edge pixel points of the object to be displayed;

[0012] The area formed by the line segments where the edge pixels are located is used as the area to be displayed.

[0013] In a possible implementation, determining the pixel information of the target to be displayed based on the reference pixel coordinates includes:

[0014] Dividing the target to be displayed into at least one display line in units of pixels;

[0015] For each of the display lines, determining pixel coordinates of pixel points at both ends of the display line;

[0016] The pixel information is determined based on the pixel coordinates of the two end pixel points in all the display rows.

[0017] In a possible implementation, the pixel information includes at least pixel coordinates and pixel values ​​of the pixel points of the object to be displayed.

[0018] In a possible implementation, the step of splicing the reference pixel coordinates and the pixel information to obtain the update information includes:

[0019] Determine whether to stitch black pixels;

[0020] In the case of splicing the black pixels, the reference pixel coordinates, the pixel information, and the black pixel information are spliced ​​based on a splicing rule to obtain update information.

[0021] In a possible implementation, the step of splicing the reference pixel coordinates, the pixel information, and the black pixel information to obtain the update information includes:

[0022] For each of the display rows, sequentially concatenate pixel coordinates of pixel points at both ends of the display row, pixel information of the display row, and the black pixel information to obtain first sub-update information of each of the display rows;

[0023] The reference pixel coordinates are concatenated with all the first sub-update information to obtain the update information.

[0024] In a possible implementation, the splicing the reference pixel coordinates, the pixel information, and the black pixel information to obtain the update information further includes:

[0025] splicing pixel coordinates of pixel points at both ends of each display row and pixel information of the display row to obtain second sub-update information of each display row;

[0026] The reference pixel coordinates, all the second sub-update information, and the black pixel information are sequentially spliced ​​together to obtain the update information.

[0027] In a possible implementation, the splicing the reference pixel coordinates, the pixel information, and the black pixel information to obtain the update information further includes:

[0028] The reference pixel coordinates, the pixel coordinates of the pixels at both ends of all the display lines, the pixel information of the target to be displayed, and the black pixel information are sequentially spliced ​​to obtain the update information.

[0029] In a second aspect, the present disclosure further provides a display data processing method, which is applied to a display terminal connected to the above-mentioned processing terminal, and includes:

[0030] Parsing received update information based on splicing rules;

[0031] The target to be displayed is displayed based on the display information obtained by parsing.

[0032] In a possible implementation, displaying the target to be displayed based on the display information obtained through analysis includes:

[0033] Get the current display area corresponding to the current display target;

[0034] Determining whether there is an overlapping area between the current display area and the area to be displayed determined by the display information;

[0035] In the case that the overlapping area does not exist, the pixel information in the current display area is replaced with black pixel information, and the pixel information in the area to be displayed is displayed;

[0036] In the case where the overlapping area exists, pixel information of other areas in the current display area except the overlapping area is replaced with black pixel information, and pixel information in the area to be displayed is displayed.

[0037] In a third aspect, the present disclosure further provides a display data processing system, comprising:

[0038] The processing terminal determines an area to be displayed based on the target to be displayed; determines reference pixel coordinates based on the resolution of the display terminal and the area to be displayed; determines pixel information of the target to be displayed based on the reference pixel coordinates; splices the reference pixel coordinates and the pixel information to obtain updated information, and transmits the updated information to the display terminal.

[0039] The display terminal parses the received update information based on the splicing rule; and displays the target to be displayed based on the display information obtained by the parsing.

[0040] In a fourth aspect, the present disclosure further provides a computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the display data processing method as described above are executed.

[0041] In a fifth aspect, the present disclosure also provides an electronic device, which includes: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of the display data processing method as described are performed.

[0042] The present disclosure splices the reference pixel coordinates and the pixel information of the target to be displayed, and then only transmits the updated information obtained by the splicing, without transmitting the entire display information, which greatly improves the transmission efficiency and reduces the occupied transmission bandwidth.

[0043] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the present disclosure or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0045] Figure 1 A flow chart of a display data processing method provided by the present disclosure is shown;

[0046] Figure 2 A flow chart showing a method for processing display data provided by the present disclosure for determining a to-be-displayed area based on an object to be displayed;

[0047] Figure 3 A flowchart of determining pixel information of a target to be displayed in a display data processing method provided by the present disclosure is shown;

[0048] Figure 4 A flowchart of obtaining update information based on splicing rules in a display data processing method provided by the present disclosure is shown;

[0049] Figure 5 A schematic diagram showing the update information obtained by using the first splicing rule provided by the present disclosure is shown;

[0050] Figure 6A schematic diagram showing the update information obtained by using the second splicing rule provided by the present disclosure is shown;

[0051] Figure 7 A schematic diagram showing the update information obtained by using the third splicing rule provided by the present disclosure is shown;

[0052] Figure 8 A flowchart of another display data processing method provided by the present disclosure is shown;

[0053] Figure 9 A flowchart showing display of a target to be displayed based on display information in another display data processing method provided by the present disclosure is shown;

[0054] Figure 10 A schematic diagram showing a current display area and an area to be displayed provided by the present disclosure when no overlapping area exists;

[0055] Figure 11 A schematic diagram showing a current display area and an area to be displayed provided by the present disclosure in the case where there is an overlapping area;

[0056] Figure 12 A schematic structural diagram of an electronic device provided by the present disclosure is shown. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical solutions and advantages of the present disclosure more clear, the technical solutions of the present disclosure will be clearly and completely described below in conjunction with the drawings of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0058] Unless otherwise defined, the technical or scientific terms used in this disclosure should have the usual meanings understood by persons of ordinary skill in the field to which this disclosure belongs. The words "first", "second" and similar terms used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Words such as "include" or "comprise" mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0059] In order to keep the following description of the present disclosure clear and concise, the present disclosure omits detailed descriptions of known functions and known components.

[0060] The first aspect of the present disclosure provides a display data processing method applied to a processing terminal. Figure 1 The flowchart of the display data processing method is shown, including S101-S104, which are specifically as follows:

[0061] S101: Determine a to-be-displayed area based on an object to be displayed.

[0062] Before displaying an image, the image to be displayed must be rendered. Typically, while the current frame is being displayed, the processing terminal completes rendering of the next frame. Based on the rendered next frame, the image to be displayed, the alpha channel is used to compare the target to be displayed. This target is composed of pixels with a non-zero alpha channel value. The target to be displayed is what needs to be rendered and displayed to the user, such as a rendered scene or task. It is worth noting that other methods, such as depth stencils, can also be used to determine the target to be displayed.

[0063] The area to be displayed is the area where the target to be displayed is located, which is determined based on the resolution of the display terminal screen during image processing.

[0064] When determining the area to be displayed based on the target to be displayed, you can refer to Figure 2 The method steps shown specifically include:

[0065] S201, determining edge pixels of an object to be displayed.

[0066] Among them, there is a situation where multiple sub-targets are displayed at the same time. At this time, the whole formed by the multiple sub-targets can be regarded as a target to be displayed, or each sub-target in the multiple sub-targets can be regarded as a target to be displayed, etc. The embodiment of the present disclosure does not make specific limitations on this.

[0067] After the object to be displayed is determined, edge pixel points of the object to be displayed are searched. Of course, the number of edge pixel points is determined by the shape of the object to be displayed.

[0068] S202: The area formed by the line segments where the edge pixels are located is used as the area to be displayed.

[0069] Furthermore, the line segment where each edge pixel point is located is determined, and a to-be-displayed area is formed using the line segment determined by each edge pixel point. The shape of the to-be-displayed area can be square, circle, etc., and its shape can be determined based on the principle of having fewer sides.

[0070] Of course, a preset shape can also be determined. When forming the area to be displayed using the line segments determined by each edge pixel point, the preset shape is referred to so that the shape of the area to be displayed is the same as the preset shape, wherein the size can be different.

[0071] S102: Determine reference pixel coordinates based on the resolution of the display terminal and the area to be displayed.

[0072] Considering that the image to be displayed after processing needs to be displayed on the screen of the display terminal, it is necessary to further determine the position of the area to be displayed on the screen.

[0073] Specifically, the reference pixel coordinates are determined based on the resolution of the display terminal and the area to be displayed, wherein a reference point in the area to be displayed is first determined, and the reference point may be a center point, a vertex, etc. in the area to be displayed. Then, the coordinates of the reference point, that is, the reference pixel coordinates, are determined based on the resolution of the display terminal, and then the position of the area to be displayed on the screen is determined using the reference pixel coordinates.

[0074] Here, considering that an image can only carry pixel information during image transmission, the reference pixel coordinates are binarized, that is, a sequence of 0 and 1 is used to represent the reference pixel coordinates.

[0075] S103: Determine pixel information of the target to be displayed based on the reference pixel coordinates.

[0076] Specifically, the pixel information includes at least the pixel coordinates and pixel values ​​of multiple pixels in the target to be displayed, such as the pixel coordinates of the pixels at both ends, the pixel value of each pixel, etc. Figure 3 The specific steps of determining pixel information of an object to be displayed based on reference pixel coordinates are shown, including S301-S303.

[0077] S301 , dividing the object to be displayed into at least one display line in units of pixels.

[0078] Typically, the area of ​​the object to be displayed is relatively large and consists of multiple rows of pixels. Therefore, the object to be displayed is divided into pixels to obtain at least one display row. The number of display rows is determined by the size of the object to be displayed.

[0079] S302 : For each display line, determine the pixel coordinates of the pixels at both ends of the display line.

[0080] After obtaining at least one display line, the pixel coordinates of the two end pixel points in each display line are determined. The determination method and representation manner of the pixel coordinates are the same as those of the reference pixel coordinates.

[0081] S303: Determine pixel information based on the pixel coordinates of the two end pixels in all display rows.

[0082] Specifically, the pixel coordinates of the pixel points at both ends of a display row and the pixel value of the display row can be combined to obtain sub-pixel information corresponding to the display row. Then, the sub-pixel information corresponding to each display row is combined to obtain pixel information.

[0083] S104: splice the reference pixel coordinates and the pixel information to obtain updated information, and transmit the updated information to the display terminal.

[0084] Specifically, the processing terminal needs to transmit the next frame of image to the display terminal so that the display terminal updates the current frame of image using the next frame of image. Specifically, based on pre-set splicing rules, the reference pixel coordinates and pixel information are spliced ​​to obtain update information, which is then transmitted to the display terminal so that the display terminal updates the current frame of image using the update information and then displays the next frame of image, that is, displays the target to be displayed.

[0085] Further, Figure 4 A method for obtaining update information by splicing is shown, which specifically includes the following steps:

[0086] S401, determining whether to splice black pixels.

[0087] Here, if the target to be displayed cannot completely fill the area to be displayed, black pixels may be used to fill the remaining areas of the area to be displayed, excluding the area corresponding to the target to be displayed. Specifically, the number of pixels in the area to be displayed may be compared with the number of pixels corresponding to the target to be displayed. If the number of pixels in the area to be displayed is greater than the number of pixels corresponding to the target to be displayed, black pixels are determined to be spliced. Of course, other methods may also be used to determine whether to splice black pixels, and this disclosure is not particularly limited in this regard.

[0088] S402 : In the case of splicing black pixels, based on a splicing rule, the reference pixel coordinates, the pixel information, and the black pixel information are spliced ​​to obtain update information.

[0089] After determining the black pixel to be stitched, the reference pixel coordinates, pixel information, and black pixel information are stitched together based on a pre-set stitching rule to obtain updated information. The disclosed embodiment shows stitching rules for obtaining updated information based on three different stitching rules, as follows:

[0090] The first splicing rule

[0091] For each display row, the pixel coordinates of the two end pixel points in the display row and the pixel information and black pixel information of the display row are sequentially spliced ​​to obtain the first sub-update information of each display row; the reference pixel coordinates are spliced ​​with all the first sub-update information to obtain the update information, that is, the update information is spliced ​​according to the reference pixel coordinates, the pixel coordinates of the two end pixel points in the first display row and the pixel information and black pixel information of the display row, the pixel coordinates of the two end pixel points in the second display row and the pixel information and black pixel information of the display row until the pixel coordinates of the two end pixel points in the last display row and the pixel information and black pixel information of the display row are spliced.

[0092] Figure 5 The schematic diagram of the updated information obtained by using the first splicing rule is shown. 1 is used to identify the reference pixel coordinates, 2 is used to identify the pixel coordinates of the two end pixels in the display line, 3 is used to identify the pixel information of a display line, and the remaining blank areas are used to identify black pixel information. Figure 5 The first display row in the to-be-displayed area only includes reference pixel coordinates and black pixels, that is, the first display row in the to-be-displayed area does not include pixel points of the target to be displayed; those skilled in the art should know that Figure 5 This is only an example of the present disclosure and is not intended to be limiting.

[0093] The second splicing rule

[0094] First, the pixel coordinates of the two end pixels in each display row and the pixel information of the display row are spliced ​​together to obtain the second sub-update information of each display row; then, the reference pixel coordinates, all the second sub-update information, and the black pixel information are sequentially spliced ​​together to obtain the update information, that is, all the black pixels required in the area to be displayed are arranged at the end of the update information. Figure 6 A schematic diagram of the updated information obtained using the second splicing rule is shown. Similarly, 1 is used to identify the reference pixel coordinates, 2 is used to identify the pixel coordinates of the pixels at both ends of the display line, 3 is used to identify the pixel information of a display line, and the remaining blank areas identify black pixel information.

[0095] The third splicing rule

[0096] The reference pixel coordinates, the pixel coordinates of the two end pixels in all display lines, the pixel information of the target to be displayed, and the black pixel information are sequentially spliced ​​to obtain the updated information, that is, Figure 7As shown, first arrange the reference pixel coordinates; then arrange the pixel coordinates of the two end pixel points of all display rows, wherein each display row can be provided with a row and column number. When arranging the pixel coordinates of the two end pixel points in the display row, they can be arranged in the order of the row and column numbers of the display row; then arrange the pixel information of the target to be displayed, that is, the pixel value of each pixel of the target to be displayed, etc. Of course, in the specific arrangement, it can also be arranged in the order of the row and column numbers of the display rows, for example, first arrange all the pixel information of the first display row, then arrange all the pixel information of the second display row, and finally arrange all the pixel information of the last display row; finally, arrange all the required black pixels at the end of the update information. Among them, Figure 7 Among them, 1 is used to identify the reference pixel coordinates, 2 is used to identify the pixel coordinates of the pixels at both ends of the display line, 3 is used to identify the pixel information of a display line, and the remaining blank areas identify black pixel information.

[0097] Among the three splicing rules mentioned above, compared with the second and third ones, the first one is based on the entire display line for line-by-line splicing, which has higher accuracy and generates update information with lower error. Therefore, in specific implementations, it is preferred to use the first splicing rule to obtain update information.

[0098] It is worth noting that, in the splicing rule, the reference pixel coordinates may be arranged after the pixel coordinates of the pixels at both ends of the display line, or after all black pixels, etc., and the embodiment of the present disclosure does not make any specific limitation on this.

[0099] The disclosed embodiment splices the reference pixel coordinates and the pixel information of the target to be displayed, and then only transmits the updated information obtained by the splicing, without transmitting the entire display information, which greatly improves the transmission efficiency and reduces the occupied transmission bandwidth.

[0100] A second aspect of the present disclosure provides a display data processing method applied to a display terminal, wherein the display terminal is communicatively connected to the processing terminal in the first aspect. Figure 8 The flowchart of the display data processing method is shown in FIG. , and the specific steps are as follows:

[0101] S801: Parse the received update information based on the splicing rule.

[0102] Here, the splicing rule may be any one of the three splicing rules described in the embodiments of the first aspect, as long as it is consistent with that of the processing terminal. For example, if the processing terminal obtains update information using the first splicing rule, the display terminal parses the received update information based on the first splicing rule to avoid parsing errors. Specifically, when parsing the update information based on the first splicing rule, the inverse operation of the first splicing rule may be directly performed to avoid errors in the parsed update information caused by different splicing rules between the display terminal and the processing terminal.

[0103] S802: Display the target to be displayed based on the display information obtained through analysis.

[0104] After obtaining display information based on the splicing rules, the display terminal displays the target to be displayed based on the display information, wherein the display information includes at least reference pixel coordinates, pixel information, and black pixel information, and may also include the correspondence between the target included in the current frame image and the target included in the image to be displayed.

[0105] Specifically, refer to Figure 9 The method shown displays the target to be displayed based on the display information, and specifically includes S901-S904.

[0106] S901: Obtain a current display area corresponding to a current display target.

[0107] Here, the display terminal may store display information corresponding to each frame image, and determine the current display area based on the display information of the current frame image, that is, the current display area of ​​the current display object in the current frame image.

[0108] The current display area can also be represented by pixel information.

[0109] S902: Determine whether there is an overlapping area between the current display area and the area to be displayed determined by the display information.

[0110] The area to be displayed is determined according to the display information obtained by parsing, and then the current display area and the area to be displayed are placed simultaneously in the area of ​​the display terminal screen to check whether there is an overlapping area between the current display area and the area to be displayed.

[0111] S903 : When there is no overlapping area, the pixel information in the current display area is replaced with black pixel information, and the pixel information in the area to be displayed is displayed.

[0112] In the absence of overlapping areas, such as Figure 10 As shown, the area where A is located is the area corresponding to the display terminal screen, the area where N is located is the current display area, and the area where N+1 is located is the area to be displayed. Figure 10 In the case shown, the pixel information in the current display area can be directly replaced with black pixel information, that is, black pixels are filled in the area where N is located, and the pixel information in the area to be displayed is displayed at the same time, that is, pixels in the area to be displayed are filled in the area where N+1 is located.

[0113] S904 , when there is an overlapping area, replacing pixel information of other areas in the current display area except the overlapping area with black pixel information, and displaying pixel information in the area to be displayed.

[0114] In the case of overlapping areas, such as Figure 11 As shown, the area where A is located is the area corresponding to the display terminal screen, the area where N is located is the current display area, and the area where N+1 is located is the area to be displayed. The overlapping area between the current display area and the area to be displayed is calculated, and the area where Q is located is the overlapping area. At this time, the pixel information of other areas in the current display area except the overlapping area is replaced with black pixel information, that is, the area where N is located except the area where Q is located is filled with black pixels, and the pixel information in the area to be displayed is displayed at the same time, that is, the area where N+1 is located is filled with pixels in the area to be displayed.

[0115] Specifically, when there is an overlapping area, after the overlapping area is determined, pixel information of the overlapping area may be determined based on display information of the current frame image, and then pixels in the overlapping area may be set to black based on the pixel information of the overlapping area.

[0116] In the embodiment of the present disclosure, the display terminal only needs to display the target to be displayed based on the update information, that is, only the pixels in the area where there is a change need to be updated, and there is no need to scan and update the pixels of the entire screen line by line, which reduces the logical power consumption of the display terminal and improves the display efficiency.

[0117] A second aspect of the present disclosure provides a display data processing system, which includes a processing terminal and a display terminal:

[0118] The processing terminal determines a display area based on the target to be displayed; determines reference pixel coordinates based on the resolution of the display terminal and the display area; determines pixel information of the target to be displayed based on the reference pixel coordinates; and, based on a splicing rule, splices the reference pixel coordinates and the pixel information to obtain updated information, which is transmitted to the display terminal. The display terminal parses the received updated information based on the splicing rule and displays the target to be displayed based on the parsed display information.

[0119] Here, the specific operation method of the processing terminal is the same as that of the embodiment of the first aspect, and the specific operation method of the display terminal is the same as that of the embodiment of the second aspect, and will not be described in detail again.

[0120] A fourth aspect of the present disclosure further provides a storage medium, which is a computer-readable medium and stores a computer program. When the computer program is executed by a processor, the method provided in any embodiment of the present disclosure is implemented, including the following steps:

[0121] S11, determining a to-be-displayed area based on the to-be-displayed object;

[0122] S12, determining reference pixel coordinates based on the resolution of the display terminal and the area to be displayed;

[0123] S13, determining pixel information of the target to be displayed based on the reference pixel coordinates;

[0124] S14, combining the reference pixel coordinates and the pixel information to obtain updated information, and transmitting the updated information to the display terminal.

[0125] When the computer program is executed by the processor to determine the area to be displayed based on the target to be displayed, the processor specifically performs the following steps: determining edge pixels of the target to be displayed; and taking the area formed by the line segments where the edge pixels are located as the area to be displayed.

[0126] When the computer program is executed by the processor to determine the pixel information of the target to be displayed based on the reference pixel coordinates, the processor specifically performs the following steps: dividing the target to be displayed into at least one display row in units of pixels; for each of the display rows, determining the pixel coordinates of the pixel points at both ends of the display row; and determining the pixel information based on the pixel coordinates of the pixel points at both ends of all the display rows.

[0127] When the computer program is executed by the processor to splice the reference pixel coordinates and the pixel information to obtain updated information, the processor specifically performs the following steps: determining whether to splice black pixels; in the case of splicing the black pixels, splicing the reference pixel coordinates, the pixel information and the black pixel information based on splicing rules to obtain updated information.

[0128] When the computer program is executed by the processor to splice the reference pixel coordinates, the pixel information and the black pixel information to obtain update information, the processor also executes the following steps: for each display row, the pixel coordinates of the pixel points at both ends of the display row, the pixel information of the display row, and the black pixel information are sequentially spliced ​​to obtain the first sub-update information of each display row; the reference pixel coordinates are spliced ​​with all the first sub-update information to obtain the update information.

[0129] When the computer program is executed by the processor to splice the reference pixel coordinates, the pixel information and the black pixel information to obtain update information, the processor specifically performs the following steps: splicing the pixel coordinates of the pixel points at both ends of each display row and the pixel information of the display row to obtain the second sub-update information of each display row; sequentially splicing the reference pixel coordinates, all the second sub-update information and the black pixel information to obtain the update information.

[0130] When the computer program is executed by the processor to splice the reference pixel coordinates, the pixel information and the black pixel information to obtain the updated information, the processor specifically performs the following steps: sequentially splicing the reference pixel coordinates, the pixel coordinates of the pixel points at both ends of all the display rows, the pixel information of the target to be displayed, and the black pixel information to obtain the updated information.

[0131] When the computer program is executed by the processor and applied to the display data processing method of the display terminal, the processor specifically executes the following steps: parsing the received update information based on the splicing rule; and displaying the target to be displayed based on the display information obtained by the parsing.

[0132] When the computer program is executed by the processor to display the target to be displayed based on the display information obtained by analysis, the processor specifically performs the following steps: determining whether there is an overlapping area between the current display area and the area to be displayed determined by the display information; if there is no overlapping area, replacing the pixel information in the current display area with black pixel information, and displaying the pixel information in the area to be displayed; if there is an overlapping area, replacing the pixel information of other areas in the current display area except the overlapping area with black pixel information, and displaying the pixel information in the area to be displayed.

[0133] The display data processing method on the terminal side of the present disclosure can splice the reference pixel coordinates and the pixel information of the target to be displayed, and then only transmit the updated information obtained by splicing, without transmitting the entire display information, which greatly improves the transmission efficiency and reduces the occupied transmission bandwidth; and the display terminal side only displays the target to be displayed based on the updated information, that is, it is only necessary to update the pixels in the area where there is a change, without having to scan and update the pixels of the entire screen line by line, which reduces the logical power consumption of the display terminal and improves the display efficiency.

[0134] The fifth aspect of the present disclosure further provides an electronic device, such as Figure 12 As shown, the electronic device includes at least a memory 1201 and a processor 1202. The memory 1201 stores a computer program. The processor 1202 implements the method provided by any embodiment of the present disclosure when executing the computer program on the memory 1201. Exemplarily, the method executed by the electronic device computer program is as follows:

[0135] S21, determining a to-be-displayed area based on the to-be-displayed object;

[0136] S22, determining reference pixel coordinates based on the resolution of the display terminal and the area to be displayed;

[0137] S23, determining pixel information of the to-be-displayed object based on the reference pixel coordinates;

[0138] S24, combining the reference pixel coordinates and the pixel information to obtain updated information, and transmitting the updated information to the display terminal.

[0139] When executing the computer program stored in the memory for determining the area to be displayed based on the object to be displayed, the processor also executes the following computer program: determining edge pixels of the object to be displayed; and taking the area formed by the line segments where the edge pixels are located as the area to be displayed.

[0140] When the processor determines the pixel information of the target to be displayed based on the reference pixel coordinates stored in the execution memory, it also executes the following computer program: dividing the target to be displayed into at least one display row in units of pixels; for each of the display rows, determining the pixel coordinates of the pixel points at both ends of the display row; and determining the pixel information based on the pixel coordinates of the pixel points at both ends of all the display rows.

[0141] When the processor executes the update information obtained by splicing the reference pixel coordinates and the pixel information stored in the execution memory, it also executes the following computer program: determining whether to splice black pixels; in the case of splicing the black pixels, splicing the reference pixel coordinates, the pixel information and the black pixel information based on the splicing rules to obtain update information.

[0142] When the processor executes the update information obtained by splicing the reference pixel coordinates, the pixel information and the black pixel information stored in the execution memory, it also executes the following computer program: for each of the display rows, the pixel coordinates of the pixel points at both ends of the display row, the pixel information of the display row, and the black pixel information are sequentially spliced ​​to obtain the first sub-update information of each of the display rows; the reference pixel coordinates are spliced ​​with all the first sub-update information to obtain the update information.

[0143] When the processor executes the update information obtained by splicing the reference pixel coordinates, the pixel information and the black pixel information stored in the execution memory, it also executes the following computer program: splicing the pixel coordinates of the pixel points at both ends of each display row and the pixel information of the display row to obtain the second sub-update information of each display row; sequentially splicing the reference pixel coordinates, all the second sub-update information and the black pixel information to obtain the update information.

[0144] When the processor executes the update information obtained by splicing the reference pixel coordinates, the pixel information and the black pixel information stored in the execution memory, it also executes the following computer program: splicing the reference pixel coordinates, the pixel coordinates of the two end pixels in all the display rows, the pixel information of the target to be displayed, and the black pixel information in sequence to obtain the update information.

[0145] When executing the display data processing method stored in the memory and applied to the display terminal, the processor further executes the following computer program: parsing the received update information based on the splicing rule; and displaying the target to be displayed based on the display information obtained by parsing.

[0146] When the processor displays the target to be displayed based on the display information obtained by analysis and stored in the execution memory, it also executes the following computer program: obtaining the current display area corresponding to the current display target; determining whether there is an overlapping area between the current display area and the area to be displayed determined by the display information; if there is no overlapping area, replacing the pixel information in the current display area with black pixel information, and displaying the pixel information in the area to be displayed; if there is an overlapping area, replacing the pixel information of other areas in the current display area except the overlapping area with black pixel information, and displaying the pixel information in the area to be displayed.

[0147] The display data processing method on the terminal side of the present disclosure can splice the reference pixel coordinates and the pixel information of the target to be displayed, and then only transmit the updated information obtained by splicing, without transmitting the entire display information, which greatly improves the transmission efficiency and reduces the occupied transmission bandwidth; and the display terminal side only displays the target to be displayed based on the updated information, that is, it is only necessary to update the pixels in the area where there is a change, without having to scan and update the pixels of the entire screen line by line, which reduces the logical power consumption of the display terminal and improves the display efficiency.

[0148] In some embodiments, the client and server may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), internets (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

[0149] The storage medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0150] The storage medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains at least two Internet Protocol addresses; sends a node evaluation request including at least two Internet Protocol addresses to a node evaluation device, wherein the node evaluation device selects an Internet Protocol address from the at least two Internet Protocol addresses and returns it; receives the Internet Protocol address returned by the node evaluation device; wherein the obtained Internet Protocol address indicates an edge node in a content distribution network.

[0151] Alternatively, the storage medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: receive a node evaluation request including at least two Internet Protocol addresses; select an Internet Protocol address from the at least two Internet Protocol addresses; and return the selected Internet Protocol address; wherein the received Internet Protocol address indicates an edge node in a content distribution network.

[0152] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0153] It should be noted that the storage medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any storage medium other than a computer-readable storage medium that can transmit, propagate, or convey a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the storage medium may be conveyed using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), or any suitable combination thereof.

[0154] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0155] The units described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0156] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0157] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0158] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0159] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0160] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

[0161] The above describes in detail multiple embodiments of the present disclosure, but the present disclosure is not limited to these specific embodiments. Those skilled in the art can make various variations and modifications to the embodiments based on the concepts of the present disclosure, and these variations and modifications should all fall within the scope of protection claimed by the present disclosure.

Claims

1. A display data processing method, applied to a processing terminal, characterized in that: include: determining a to-be-displayed area based on the to-be-displayed object; Determining reference pixel coordinates based on the resolution of the display terminal and the area to be displayed; Determining pixel information of the to-be-displayed object based on the reference pixel coordinates; splicing the reference pixel coordinates and the pixel information to obtain update information, and transmitting the updated information to the display terminal; The step of splicing the reference pixel coordinates and the pixel information to obtain update information includes: Determine whether to stitch black pixels; In the case of splicing the black pixels, splicing the reference pixel coordinates, the pixel information and the black pixel information based on a splicing rule to obtain update information; The step of splicing the reference pixel coordinates, the pixel information, and the black pixel information to obtain the updated information includes: For each display row, sequentially concatenate the pixel coordinates of the pixels at both ends of the display row, the pixel information of the display row, and the black pixel information to obtain the first sub-update information of each display row; concatenating the reference pixel coordinates with all the first sub-update information to obtain the update information; or splicing pixel coordinates of pixel points at both ends of each display row and pixel information of the display row to obtain second sub-update information of each display row; Sequentially concatenate the reference pixel coordinates, all the second sub-update information, and the black pixel information to obtain the update information; or The reference pixel coordinates, the pixel coordinates of the pixels at both ends of all the display lines, the pixel information of the target to be displayed, and the black pixel information are sequentially spliced ​​to obtain the update information.

2. The display data processing method according to claim 1, wherein: The determining of the area to be displayed based on the target to be displayed includes: Determine edge pixel points of the object to be displayed; The area formed by the line segments where the edge pixels are located is used as the area to be displayed.

3. The display data processing method according to claim 1, wherein: The determining the pixel information of the target to be displayed based on the reference pixel coordinates includes: Dividing the target to be displayed into at least one display line in units of pixels; For each of the display lines, determining pixel coordinates of pixel points at both ends of the display line; The pixel information is determined based on the pixel coordinates of the two end pixel points in all the display rows.

4. The display data processing method according to claim 1 or 3, characterized in that: The pixel information at least includes pixel coordinates and pixel values ​​of the pixel points of the target to be displayed.

5. A display data processing method, applied to a display terminal connected to the processing terminal according to any one of claims 1 to 4, characterized in that: include: Parsing received update information based on splicing rules; The target to be displayed is displayed based on the display information obtained by parsing.

6. The display data processing method according to claim 5, characterized in that: The displaying of the target to be displayed based on the display information obtained through analysis includes: Get the current display area corresponding to the current display target; Determining whether there is an overlapping area between the current display area and the area to be displayed determined by the display information; In the case that the overlapping area does not exist, the pixel information in the current display area is replaced with black pixel information, and the pixel information in the area to be displayed is displayed; In the case where the overlapping area exists, pixel information of other areas in the current display area except the overlapping area is replaced with black pixel information, and pixel information in the area to be displayed is displayed.

7. A display data processing system, characterized in that: include: The processing terminal determines the area to be displayed based on the object to be displayed; Determining reference pixel coordinates based on the resolution of the display terminal and the area to be displayed; Determining pixel information of the to-be-displayed object based on the reference pixel coordinates; splicing the reference pixel coordinates and the pixel information to obtain updated information, and transmitting the updated information to the display terminal; wherein, when splicing the reference pixel coordinates and the pixel information to obtain updated information, the method includes: determining whether to splice black pixels; and if splicing the black pixels, splicing the reference pixel coordinates, the pixel information, and the black pixel information to obtain updated information based on a splicing rule; The update information is obtained by splicing the reference pixel coordinates, the pixel information, and the black pixel information, including: for each display row, sequentially splicing the pixel coordinates of the pixels at both ends of the display row, the pixel information of the display row, and the black pixel information to obtain first sub-update information for each display row; splicing the reference pixel coordinates with all the first sub-update information to obtain the update information; or splicing the pixel coordinates of the pixels at both ends of each display row and the pixel information of the display row to obtain the second sub-update information of each display row; sequentially splicing the reference pixel coordinates, all the second sub-update information, and the black pixel information to obtain the update information; or The update information is obtained by sequentially splicing the reference pixel coordinates, the pixel coordinates of the pixels at both ends of all the display lines, the pixel information of the target to be displayed, and the black pixel information. The display terminal parses the received update information based on the splicing rule; and displays the target to be displayed based on the update information.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which, when executed by a processor, executes the steps of the display data processing method according to any one of claims 1 to 6.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the display data processing method according to any one of claims 1 to 6 are performed.

Images