A display method and device for drawing content and an electronic device

Abstract

This application provides a method, apparatus, and electronic device for displaying drawn content. The method includes: acquiring a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of drawing points of adjacent splicing lines of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of adjacent splicing lines of the second sub-screen. The first and second sub-screens are adjacent sub-screens in a splicing screen, and the splicing line is the splicing line between the first and second sub-screens. A drawing trajectory is obtained by trajectory fitting based on the second drawing point and the first virtual drawing point. The drawn content is displayed on the sub-screens in the splicing screen according to the drawing trajectory. Since the electronic device can fit the drawing points of adjacent splicing lines in the two sub-screens, display breaks are avoided and the display effect is optimized.

Description

Technical Field

[0001] This application relates to the field of image display technology, and in particular to a method, apparatus, and electronic device for displaying drawn content. Background Technology

[0002] Because the size of a single display screen is limited, video wall technology emerged to achieve ultra-large screen displays. A video wall uses multiple displays pieced together to form a large display; each display shows a portion of an image, and the matrix-arranged displays collectively show a single image.

[0003] In some scenarios, users can draw content on images displayed on a video wall using their terminal devices, and the video wall will then display the user's drawing at the corresponding location. For example, users can annotate or draw graphics on the content displayed on the video wall. However, at the joints between the various sub-screens in the video wall, the displayed content may appear broken, severely affecting the overall display effect. Summary of the Invention

[0004] The purpose of this application is to provide a method, apparatus, and electronic device for displaying drawn content, to solve the problem of fragmented display of drawn content and optimize the display effect of splicing screens. The specific technical solution is as follows:

[0005] In a first aspect, embodiments of this application provide a method for displaying drawn content, the method comprising:

[0006] Obtain a first virtual drawing point and a second drawing point, wherein the first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing line of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen; the second drawing point is a second number of drawing points of the adjacent splicing line of the second sub-screen; the first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen; and the splicing line is the splicing line between the first sub-screen and the second sub-screen.

[0007] The drawing trajectory is obtained by fitting the trajectory based on the second drawing point and the first virtual drawing point;

[0008] Based on the drawing trajectory, control the sub-screens in the splicing screen to display the drawn content.

[0009] Secondly, embodiments of this application provide a display device for drawing content, the device comprising:

[0010] The drawing point acquisition module is used to acquire a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing line of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of the adjacent splicing line of the second sub-screen. The first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen. The splicing line is the splicing line between the first sub-screen and the second sub-screen.

[0011] The trajectory fitting module is used to perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory;

[0012] The display control module is used to control the sub-screens in the splicing screen to display the drawn content according to the drawing trajectory.

[0013] Thirdly, embodiments of this application provide an electronic device, including:

[0014] Memory, used to store computer programs;

[0015] When a processor executes a program stored in memory, it implements any of the methods described in the first aspect above.

[0016] Beneficial effects of the embodiments in this application:

[0017] In the solution provided in this application embodiment, the electronic device can obtain a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing lines of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of the adjacent splicing lines of the second sub-screen. The first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen, and the splicing line is the splicing line between the first sub-screen and the second sub-screen. A drawing trajectory is obtained by performing trajectory fitting based on the second drawing point and the first virtual drawing point. The drawing content is displayed on the sub-screens in the splicing screen according to the drawing trajectory. For any two sub-screens with splicing lines in a video wall, the electronic device can transform the drawing points of adjacent splicing lines in the two sub-screens to the same coordinate system, and then perform trajectory fitting based on the drawing points in the same coordinate system. This ensures the consistency of the drawing trajectory corresponding to the drawing points of adjacent splicing lines in the two sub-screens at the splicing line, thereby avoiding the situation where the drawing content is broken at the splicing point of each sub-screen in the video wall and optimizing the display effect of the video wall.

[0018] Of course, implementing any product or method of this application does not necessarily require achieving all of the advantages described above at the same time. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other embodiments can be obtained based on these drawings.

[0020] Figure 1 A flowchart of a method for displaying graphics on a video wall;

[0021] Figure 2 This is a flowchart of a current method for displaying drawn content on a video wall in high-frequency display scenarios;

[0022] Figure 3 Based on Figure 2 A schematic diagram of a content mapping method in the embodiment shown;

[0023] Figure 4 This is a schematic diagram illustrating the fitting of the plotted points;

[0024] Figure 5 This is a diagram illustrating a display break at the splicing line of a sub-screen.

[0025] Figure 6 A flowchart illustrating a method for displaying drawn content as provided in an embodiment of this application;

[0026] Figure 7 Based on Figure 6 A flowchart illustrating one method for obtaining a first drawing point in the embodiment shown;

[0027] Figure 8 Based on Figure 7 A schematic diagram of one method for obtaining the first drawing point in the embodiment shown;

[0028] Figure 9 Based on Figure 6 A flowchart illustrating a method for determining a drawing trajectory in the embodiment shown;

[0029] Figure 10 Based on Figure 9 A detailed flowchart of a trajectory determination method in the illustrated embodiment;

[0030] Figure 11 Based on Figure 9 A detailed flowchart of another method for determining the drawing trajectory in the illustrated embodiment;

[0031] Figure 12 Based on Figure 9 A detailed flowchart of another method for determining the trajectory in the illustrated embodiment;

[0032] Figure 13 A diagram illustrating the rendering follow-up problem;

[0033] Figure 14 Based on Figure 6 A flowchart of a synchronous display method according to the embodiment shown;

[0034] Figure 15 Based on Figure 14 A schematic diagram of a synchronous display method according to the embodiment shown;

[0035] Figure 16 Based on Figure 6 A flowchart illustrating a sequential display method of the embodiment shown;

[0036] Figure 17 Based on Figure 6 A flowchart illustrating another sequential display method of the illustrated embodiment;

[0037] Figure 18 Based on Figure 6 A flowchart illustrating one method for displaying switched drawing content in the embodiment shown;

[0038] Figure 19 Based on Figure 18 A schematic diagram illustrating one method of displaying the switched drawing content in the embodiment shown;

[0039] Figure 20 A schematic diagram of the structure of a display device for drawing content provided in an embodiment of this application;

[0040] Figure 21 A schematic diagram of the structure of a display system for drawn content provided in an embodiment of this application;

[0041] Figure 22 Based on Figure 21 A schematic diagram of the specific structure of a display system for drawing content according to an embodiment shown;

[0042] Figure 23 A schematic diagram of another display system for drawing content provided in an embodiment of this application;

[0043] Figure 24 Based on Figure 23 A schematic diagram of the specific structure of another display system for drawing content in the embodiment shown;

[0044] Figure 25 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0045] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art based on this application are within the scope of protection of this application.

[0046] Let me first introduce the current methods for displaying graphics on video wall displays:

[0047] by Figure 1 The splicing screen shown is composed of 4 sub-screens. Figure 1 The labels 1, 2, 3 and 4 in the image represent sub-screen 1, sub-screen 2, sub-screen 3 and sub-screen 4, respectively. The splicing screen includes 4 independent display systems. Each display system includes 1 sub-screen and 1 processor. The processor in each display system drives the sub-screen in that display system to display images through an output port.

[0048] When a user wants to display "123456789" on the video wall, the terminal device can first generate the corresponding graphic based on the user's input and send it to the video wall's management device. The management device can then segment the graphic based on the relationship between its position on the video wall and the positions of the various sub-screens, obtaining the sub-graphics corresponding to each sub-screen.

[0049] Furthermore, the management device can distribute the sub-graphics corresponding to each of the cut sub-screens to the corresponding display systems, so that the processor in the display system can drive the sub-screens in that display system to display the corresponding sub-graphics through the output port. Through the cooperation of the various display systems, the graphic corresponding to "123456789" is displayed on the splicing screen.

[0050] However, the size and total resolution of video wall displays are very large, so the amount of data in the generated graphics is often very large. Consequently, the time required to display the graphics on the video wall using the above method is also relatively long. Therefore, the above solution is not suitable for high-frequency display scenarios, such as when a user draws content on an image displayed on the video wall using a terminal device, and the video wall displays the user's drawing content in the corresponding position.

[0051] Currently, for high-frequency display scenarios, the first step is to divide the content drawn by the user on the terminal device into various drawing points. By transmitting these drawing points, the amount of data transmitted and the data transmission time are reduced, thereby meeting the requirements of high-frequency display scenarios.

[0052] The following is based on Figure 2 Taking this as an example, let's introduce the current methods for displaying drawn content on a video wall in high-frequency display scenarios, and the reasons why this method can result in broken display of drawn content:

[0053] When a user draws content on an image displayed on a video wall using a terminal device, the terminal device does not directly record the complete trajectory of the user's drawing. Instead, it detects the distance between the pen and the terminal device. When the distance between the pen and the terminal device reaches a set trigger distance, the terminal device detects a pen placement event. The current mapped position of the pen on the screen at this time is the pen placement position, which is used as the position where the user needs to draw, i.e., the drawing focus.

[0054] Alternatively, when the distance between the pen and the terminal device reaches the set trigger distance and the pen remains in the device for a certain period of time, the terminal device detects a pen hovering event. The current mapped position of the pen on the screen at this time is the pen hovering position, which is used as the position where the user needs to draw, i.e., the drawing focus.

[0055] The terminal device can locate the drawing focus to obtain various drawing points that reflect the drawing content. By recording each discrete drawing point, the trajectory corresponding to the user's drawing content can be obtained. In addition, the terminal device can also record drawing information such as line thickness, line density, line shape, line color, texture information, and boundary information of the drawing content. Then, the above drawing points and drawing information are sent to the management device as the content drawn by the user on the terminal device.

[0056] In some cases, in order to further reduce the amount of data transmission, when the terminal device sends the above-mentioned drawing points to the management device, it can also perform further point extraction on the above-mentioned drawing points according to the key point algorithm, and send the drawing points after point extraction to the management device.

[0057] After receiving the above content, that is, the content drawn by the user on the terminal device, the management device can map the drawn content according to the coordinate information of each drawing point, the coordinate system transformation relationship between the terminal device and the splicing screen, and the coordinate transformation relationship between the splicing screen and each sub-screen in the splicing screen, and determine the drawing point corresponding to each sub-screen, as well as the display position of each drawing point in each sub-screen.

[0058] by Figure 3 For example, the management device can first convert the coordinate information of each drawing point on the screen of the terminal device to the coordinate system of the splicing screen based on the coordinate system transformation relationship between the terminal device and the splicing screen, thereby obtaining the coordinate information of each drawing point on the splicing screen.

[0059] Furthermore, the management device can determine the sub-screen to which each drawing point in the splicing screen belongs based on the position of each sub-screen in the splicing screen, and transform the coordinate information of each drawing point in the splicing screen to the coordinate system of the sub-screen to which the drawing point belongs based on the coordinate system transformation relationship between the splicing screen and the sub-screens in the splicing screen, thereby determining the position of each drawing point in each sub-screen.

[0060] After determining the drawing points in each sub-screen, the management device can distribute these drawing points to the corresponding display systems based on their sub-screen affiliation. Each display system can then render the drawing point corresponding to its specified location. When distributing these drawing points, the management device can also send the coordinates, size, color, and style information of each drawing point to the respective display systems.

[0061] When each display system receives a drawing point, its processor can render the drawing point based on its coordinates, size, color, style, and other information. After rendering, the processor can drive the sub-screens in the display system to display the corresponding drawing content through the corresponding output port. Through the cooperation of each display system, the user's drawing content can be displayed on the splicing screen.

[0062] For example, after processor 1 finishes rendering, it drives sub-screen 1 to display the corresponding drawing content through output port 1. After processor 2 finishes rendering, it drives sub-screen 2 to display the corresponding drawing content through output port 2. After processor 3 finishes rendering, it drives sub-screen 3 to display the corresponding drawing content through output port 3. After processor 4 finishes rendering, it drives sub-screen 4 to display the corresponding drawing content through output port 4.

[0063] like Figure 4 As shown, during the rendering process, the processor in the display system receives discrete drawing points from the management device, which are not complete drawing content. Furthermore, these drawing points may be points that have been extracted using a keypoint algorithm. Therefore, after the management device sends the drawing points to each display system, the processor in each display system needs to use an interpolation fitting algorithm to fit the received drawing points (i.e., the original point information before fitting) to determine the complete drawing content, and then display the fitted result on the corresponding sub-screen.

[0064] In one implementation, the processor can use the Bessel cubic interpolation formula for fitting:

[0065] B(t)=P0(1-t) 3 +3P1t(1-t) 2 +3P2t2 (1-t)+P3t 3 ,t∈[0,1]

[0066] Among them, P0, P1, P2, and P3 are the information of the four points to be fitted.

[0067] Because each display system is relatively independent, the fitting process of each processor is also independent. Therefore, drawing points located at the seam between two adjacent sub-screens, but situated in two different sub-screens, cannot be effectively fitted. This results in the fitted drawing content appearing as shown in the image at the seam between the two sub-screens. Figure 5 The display shows a break in the drawing trajectory, where the drawing trajectory corresponding to each drawing point breaks at the junction of the two sub-screens. Figure 5 The labels 1 and 2 in the text represent sub-screen 1 and sub-screen 2, respectively.

[0068] Therefore, in order to solve the problem of fragmented display of drawn content and optimize the display effect of video wall displays, this application provides a method, apparatus, system, electronic device, computer-readable storage medium, and computer program product for displaying drawn content. The following first describes a method for displaying drawn content provided by an embodiment of this application.

[0069] The method for displaying drawn content provided in this application can be applied to any electronic device that needs to display drawn content, such as a processor connected to a sub-screen or a management device corresponding to a video wall, etc., without specific limitations. For clarity, it will be referred to as an electronic device below.

[0070] like Figure 6 As shown, a method for displaying drawn content includes:

[0071] S601, Obtain the first virtual drawing point and the second drawing point;

[0072] Wherein, the first virtual drawing point is a virtual drawing point obtained by transforming the first number of the first drawing points of the adjacent splicing line of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen; the second drawing point is the second number of the drawing points of the adjacent splicing line of the second sub-screen; the first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen; and the splicing line is the splicing line between the first sub-screen and the second sub-screen.

[0073] S602, perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory;

[0074] S603, according to the drawing trajectory, control the sub-screens in the splicing screen to display the drawing content.

[0075] In the solution provided in this application embodiment, the electronic device can obtain a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing lines of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of the adjacent splicing lines of the second sub-screen. The first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen, and the splicing line is the splicing line between the first sub-screen and the second sub-screen. A drawing trajectory is obtained by performing trajectory fitting based on the second drawing point and the first virtual drawing point. The drawing content is displayed on the sub-screens in the splicing screen according to the drawing trajectory. For any two sub-screens with splicing lines in a video wall, the electronic device can transform the drawing points of adjacent splicing lines in the two sub-screens to the same coordinate system, and then perform trajectory fitting based on the drawing points in the same coordinate system. This ensures the consistency of the drawing trajectory corresponding to the drawing points of adjacent splicing lines in the two sub-screens at the splicing line, thereby avoiding the situation where the drawing content is broken at the splicing point of each sub-screen in the video wall and optimizing the display effect of the video wall.

[0076] In one implementation, when the electronic device is a management device corresponding to the video wall, the electronic device can, for each sub-screen in the video wall, designate any one sub-screen as the first sub-screen, and designate any sub-screen adjacent to the first sub-screen as the second sub-screen, so as to... Figure 1 Taking the splicing screen shown as an example, the electronic device can designate sub-screen 1 as the first sub-screen and sub-screen 2 as the second sub-screen, or sub-screen 2 as the first sub-screen and sub-screen 1 as the second sub-screen, or sub-screen 1 as the first sub-screen and sub-screen 3 as the second sub-screen. All of these are possible and no specific limitation is made here.

[0077] In another implementation, when the electronic device is a processor connected to a sub-screen, the electronic device can designate the sub-screen it is connected to as a first sub-screen, and any sub-screen adjacent to the first sub-screen as a second sub-screen. Alternatively, it can designate the sub-screen it is connected to as a second sub-screen, and any sub-screen adjacent to the second sub-screen as a first sub-screen. Figure 1 Taking the splicing screen shown as an example, the electronic device is the processor connected to the sub-screen 1. Therefore, the electronic device can designate the sub-screen 1 as the first sub-screen and the sub-screen 2 as the second sub-screen, or the sub-screen 1 as the second sub-screen and the sub-screen 2 as the first sub-screen. These are all possible and no specific limitation is made here.

[0078] After determining the first sub-screen and the second sub-screen, the electronic device can obtain a first number of first drawing points of adjacent splicing lines of the first sub-screen, and a second number of second drawing points of adjacent splicing lines of the second sub-screen. The splicing lines are the splicing lines between the first sub-screen and the second sub-screen. The first number and the second number can be the same or different. The specific values ​​of the first number and the second number can be preset by the user according to the number of points required by the interpolation fitting algorithm used in the subsequent trajectory fitting process, or they can be determined in real time according to the number of drawing points in the first sub-screen and the second sub-screen. No specific limitation is made here.

[0079] In one embodiment, the electronic device may pre-store a first number and a second number of points set according to the number of points required by the interpolation fitting algorithm. In this case, the electronic device may first determine the distance between each drawing point in the first sub-screen and the splicing line, and then select a first number of drawing points adjacent to the splicing line from the drawing points in the first sub-screen as the first drawing points according to the distance. Similarly, the electronic device may also determine the distance between each drawing point in the second sub-screen and the splicing line, and then select a second number of drawing points adjacent to the splicing line from the drawing points in the second sub-screen as the second drawing points according to the distance.

[0080] For example, if the electronic device pre-stores a first quantity and a second quantity of 3 and 2 respectively, after determining the distances between drawing points 1, 2, 3, 4, and 5 on the first sub-screen and the splicing line, points 3, 4, and 5 can be designated as the first drawing points of the first quantity of adjacent splicing lines on the first sub-screen because they are the three points with the smallest distances to the splicing line. Similarly, after determining the distances between drawing points 6, 7, 8, and 9 on the second sub-screen and the splicing line, points 6 and 7 can be designated as the second drawing points of the second quantity of adjacent splicing lines on the second sub-screen because they are the two points with the smallest distances to the splicing line.

[0081] In another implementation, the electronic device can determine in real time the number of drawing points included in the first sub-screen and the second sub-screen, respectively, as the first number and the second number. In this case, the electronic device can directly use all the drawing points in the first sub-screen as the first number of the first drawing points of the adjacent splicing line of the first sub-screen, and use all the drawing points in the second sub-screen as the second number of the second drawing points of the adjacent splicing line of the second sub-screen.

[0082] Since the coordinate information of the first drawing point and the second drawing point are located in different coordinate systems, they cannot be fitted. Therefore, the coordinate system transformation relationship between each sub-screen can be determined in advance based on the relative position and size of each sub-screen, and the coordinate system transformation relationship between each sub-screen can be stored in the electronic device.

[0083] After acquiring the first drawing point and the second drawing point, the electronic device can transform the first drawing point into the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen, thus obtaining the first virtual drawing point.

[0084] by Figure 1 Taking the splicing screen shown as an example, assuming sub-screen 1 is the first sub-screen and sub-screen 3 is the second sub-screen, since the first and second sub-screens are arranged vertically and have the same screen width, when the coordinate information of the drawing points in the first sub-screen is transformed into the coordinate system of the second sub-screen, the horizontal coordinate can remain unchanged, while the vertical coordinate needs to be increased by the value of the vertical coordinate corresponding to the height of the second sub-screen. Similarly, when the coordinate information of the drawing points in the second sub-screen is transformed into the coordinate system of the first sub-screen, the horizontal coordinate can also remain unchanged, while the vertical coordinate needs to be decreased by the value of the vertical coordinate corresponding to the height of the first sub-screen.

[0085] For example, the coordinates of drawing point A in the first sub-screen are (1, 1). The ordinate of the point located at the junction of the first and second sub-screens in the coordinate system of the second sub-screen is 10, which means the ordinate corresponding to the height of the second sub-screen is 10. When transforming drawing point A in the first sub-screen to the coordinate system of the second sub-screen, the x-coordinate of drawing point A can remain unchanged, but the ordinate needs to be increased by the value of the ordinate corresponding to the height of the second sub-screen. Therefore, the coordinates of drawing point A in the coordinate system of the second sub-screen after transformation are (1, 11).

[0086] After transforming the first drawing point in the first sub-screen to the coordinate system of the second sub-screen to obtain the first virtual drawing point, the electronic device can perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory. Specifically:

[0087] The electronic device can first fit the first virtual drawing point and the second drawing point to obtain the first fitted line segment. Since the first virtual drawing point and the second drawing point are drawing points located on both sides of the splicing line, the first fitted line segment obtained by fitting intersects with the splicing line. Therefore, the intersection of the first fitted line segment and the splicing line can be determined as the splicing point. This splicing point is located on the splicing line, and then the sub-trajectory corresponding to the first sub-screen and the sub-trajectory corresponding to the second sub-screen can be determined according to this splicing point.

[0088] In one embodiment, after obtaining the splicing point located at the splicing line, the electronic device can use the splicing point as the cutting point to cut the first fitted line segment obtained above, thereby obtaining two sub-segments corresponding to the first fitted line segment. Since the first fitted line segment is fitted in the coordinate system of the second sub-screen, the electronic device can directly determine the sub-track corresponding to the second sub-screen among the two determined sub-segments as the sub-track corresponding to the second sub-screen. Based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen, the electronic device can transform the sub-segment corresponding to the first sub-screen among the two determined sub-segments to the coordinate system corresponding to the first sub-screen, thereby determining the sub-track corresponding to the first sub-screen.

[0089] When the second drawing point is all the drawing points in the second sub-screen, and the first virtual drawing point is the virtual drawing point corresponding to all the drawing points in the first sub-screen, the determined sub-trajectory is the complete drawing trajectory corresponding to the first sub-screen and the second sub-screen.

[0090] When the second drawing point is a partial drawing point in the second sub-screen, and the first virtual drawing point is a virtual drawing point corresponding to a partial drawing point in the first sub-screen, the above-mentioned sub-trajectory is only a partial drawing trajectory in the first and second sub-screens. Therefore, after determining the above-mentioned sub-trajectory, the electronic device can also perform trajectory fitting based on the remaining drawing points in the first and second sub-screens to obtain the complete drawing trajectory corresponding to the first and second sub-screens.

[0091] In another embodiment, after obtaining the splicing point located at the splicing line, the electronic device can also fit the first sub-screen based on the splicing point and the drawing point in the first sub-screen, and fit the drawing trajectory corresponding to the second sub-screen based on the splicing point and the drawing point in the second sub-screen.

[0092] In another embodiment, when the electronic device is a processor connected to the first or second sub-screen, after obtaining the splicing point located at the splicing line, the electronic device can fit the drawing trajectory corresponding to the sub-screen it is connected to based on the splicing point and the drawing point corresponding to the sub-screen it is connected to, and send the splicing point to the processor connected to another sub-screen, so that the processor connected to the sub-screen can fit the drawing trajectory corresponding to the sub-screen based on the splicing point and the drawing point in the sub-screen.

[0093] After obtaining the drawing trajectory, the electronic device can control the sub-screens in the splicing screen to display the drawn content according to the drawing trajectory.

[0094] In one implementation, when the electronic device is the management device corresponding to the splicing screen, after obtaining the drawing trajectory corresponding to the first sub-screen and the drawing trajectory corresponding to the second sub-screen, the electronic device can send them to the processors corresponding to the first sub-screen and the second sub-screen respectively, thereby controlling the processors corresponding to the first sub-screen and the second sub-screen to render the drawing trajectory and display it on the corresponding sub-screen. Thus, through the cooperation of each sub-screen, the drawing content is displayed in the splicing screen.

[0095] In another implementation, when the electronic device is a processor connected to a sub-screen, the electronic device can directly render the drawing trajectory corresponding to itself and display it on the corresponding sub-screen. If the electronic device also obtains the drawing trajectory corresponding to another sub-screen, the electronic device can also send the other drawing trajectory to the corresponding processor, so that the processor can render the received drawing trajectory and display it on its corresponding sub-screen.

[0096] In the solution provided in this application embodiment, the electronic device can transform the drawing points of adjacent splicing lines in two sub-screens to the same coordinate system, and then perform trajectory fitting based on the drawing points in the same coordinate system. Therefore, it ensures the consistency of the drawing trajectories corresponding to the drawing points of adjacent splicing lines in the two sub-screens at the splicing line, thereby avoiding the situation where the drawing content is broken at the splicing point of each sub-screen in the splicing screen, optimizing the display effect of the splicing screen. Furthermore, when the electronic device is the management device corresponding to the splicing screen, the electronic device can perform overall control and can determine the drawing trajectory corresponding to each sub-screen separately. When the electronic device is the processor connected to the sub-screen, the drawing trajectory corresponding to each sub-screen can be determined by the processor corresponding to each sub-screen, without the need to set up additional management devices, which can reduce the cost of the splicing screen.

[0097] As one implementation method of this application, such as Figure 7 As shown, the method for obtaining the first drawing point mentioned above may include:

[0098] S701, based on the splicing line between the first sub-screen and the second sub-screen, extend a region of target length in the direction of the first sub-screen, and determine the coordinate range of the region;

[0099] The electronic device can extend a region of a target length towards the first sub-screen based on the splicing line between the first and second sub-screens. When the first and second sub-screens are vertically arranged, the width of this region is the same as the screen width of the first and second sub-screens, and the height of this region is the target length. When the first and second sub-screens are horizontally arranged, the height of this region is the same as the screen height of the first and second sub-screens, and the width of this region is the target length.

[0100] like Figure 8 As shown, sub-screen 1 is the first sub-screen, and sub-screen 3 is the second sub-screen. The electronic device can extend a region of target length L in the direction of the first sub-screen (vertically upwards) based on the splicing line between the first and second sub-screens. The width of this region is the same as the width of both the first and second sub-screens, W, and the height of the region is L. At this time, the width of the coordinate system of the second sub-screen remains unchanged at W, but the height of the coordinate system increases from the original H to H'.

[0101] Furthermore, the electronic device can determine the coordinate range of the region in the coordinate system corresponding to the first sub-screen based on the positional relationship between the region and the first sub-screen, and the coordinate system corresponding to the first sub-screen. Alternatively, it can determine the coordinate range of the region in the coordinate system corresponding to the second sub-screen based on the positional relationship between the region and the second sub-screen, and the coordinate system corresponding to the second sub-screen, and then convert the coordinate range of the region in the coordinate system corresponding to the second sub-screen to the coordinate range of the region in the coordinate system corresponding to the first sub-screen based on the coordinate system transformation relationship between the first and second sub-screens.

[0102] For example, suppose the height of the first sub-screen is 1m, the target length is 0.1m, the origin of the coordinate system of the first sub-screen is the lower left corner of the screen, the coordinates of the lower right corner of the first sub-screen are (10, 0), the coordinates of the upper left corner of the first sub-screen are (0, 10), and the first and second sub-screens are arranged vertically.

[0103] Since the width of this area is the same as the width of the first sub-screen, the electronic device can determine that the horizontal coordinate value of this area is in the range of 0-10. Furthermore, the electronic device can determine that the vertical coordinate value of this area is in the range of 0-1 based on the ratio of the height of this area to the height of the first sub-screen and the vertical coordinate value corresponding to the height of the first sub-screen. Thus, the electronic device can determine that the coordinate range of this area is that the horizontal coordinate value is between 0-10 and the vertical coordinate value is between 0-1.

[0104] S702, from the drawing points of the first sub-screen, determine a first number of drawing points whose corresponding coordinates are located within the coordinate range, and use them as the first drawing points;

[0105] After determining the coordinate range of the area, the electronic device can sequentially determine whether the coordinates of each drawing point on the first sub-screen are within that coordinate range. If they are, the drawing point is used as the drawing point of the adjacent splicing line of the first sub-screen. For example... Figure 8As shown, since the coordinates of the drawing points P0' and P1' of the first sub-screen are within the above coordinate range, these drawing points P0' and P1' can be used as the first drawing points.

[0106] In one implementation, when the number of drawing points whose corresponding coordinates are within the above coordinate range is less than a first number, the electronic device can extend an additional area of ​​a certain length towards the direction of the first sub-screen based on the above area, so as to ensure that the number of drawing points of the adjacent splicing line of the determined first sub-screen is not less than the first number.

[0107] In the solution provided in this application embodiment, the electronic device can extend a region of a target length towards the first sub-screen based on the splicing line between the first sub-screen and the second sub-screen, and determine the coordinate range of the region. The first number of drawing points whose corresponding coordinates are located within the coordinate range among the drawing points of the first sub-screen are taken as the first drawing points, thereby determining the drawing points adjacent to the splicing line in the first sub-screen, so that a more accurate splicing point can be obtained when determining the splicing point based on the first drawing point.

[0108] As one implementation method of this application, such as Figure 9 As shown, the above-mentioned trajectory fitting based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory may include:

[0109] S901, perform trajectory fitting based on the second drawing point and the first virtual drawing point to determine the splicing point;

[0110] When an electronic device performs trajectory fitting based on a second drawing point and a first virtual drawing point, it can perform trajectory fitting based solely on the second drawing point and the first virtual drawing point, or it can perform trajectory fitting based on the second drawing point, the first virtual drawing point, and other drawing points in the first and second sub-screens when the second drawing point is a subset of drawing points in the second sub-screen and the first virtual drawing point is a subset of virtual drawing points in the first sub-screen. Both of these methods are acceptable.

[0111] Because whether the trajectory fitting is performed based solely on the second drawing point and the first virtual drawing point, or based on the second drawing point, the first virtual drawing point, and other drawing points in the first and second sub-screens, the drawing points used for trajectory fitting include the drawing points located on both sides of the splicing line. Therefore, the fitted trajectory obtained by the electronic device after trajectory fitting intersects with the splicing line of the first and second sub-screens, and the electronic device can determine this intersection point as the splicing point.

[0112] S902, Based on the splicing point and the second drawing point, determine the drawing trajectory.

[0113] When the electronic device is the processor connected to the sub-screen, after obtaining the splicing point, the electronic device can determine the drawing trajectory based only on the splicing point and the second drawing point, that is, only determine the drawing trajectory corresponding to the sub-screen itself.

[0114] When the electronic device is the processor connected to the sub-screen or the management device corresponding to the splicing screen, after obtaining the splicing point, the electronic device can also determine the first sub-trajectory of the first sub-screen and the second sub-trajectory of the second sub-screen based on the splicing point, the second drawing point and the first virtual drawing point, respectively. Then, based on the first sub-trajectory and the second sub-trajectory, the drawing trajectory corresponding to the first sub-screen and the drawing trajectory corresponding to the second sub-screen are determined.

[0115] In one implementation, the electronic device can first perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain a total trajectory. Then, it can cut the total trajectory according to the splicing point to obtain two segmented trajectories corresponding to the total trajectory. Since the total trajectory is fitted in the coordinate system of the second sub-screen, the electronic device can directly determine the segmented trajectory corresponding to the second sub-screen from the two determined segmented trajectories as the second sub-trajectory corresponding to the second sub-screen. Based on the coordinate system transformation relationship between the first and second sub-screens, the segmented trajectory corresponding to the first sub-screen is transformed to the coordinate system corresponding to the first sub-screen, thereby determining the first sub-trajectory corresponding to the first sub-screen. Furthermore, the electronic device can determine the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory and the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory.

[0116] In another implementation, if the first number is less than the number of drawing points included in the first sub-screen and the second number is less than the number of drawing points included in the second sub-screen, the electronic device may use the first drawing point and all other drawing points of the first sub-screen except for the first drawing point, i.e., all drawing points corresponding to the first sub-screen, as the drawing points of the first sub-screen, and use the second drawing point and all other drawing points of the second sub-screen except for the second drawing point, i.e., all drawing points corresponding to the second sub-screen, as the drawing points of the second sub-screen.

[0117] When the first number equals the number of drawing points included in the first sub-screen and the second number equals the number of drawing points included in the second sub-screen, the first drawing point is all the drawing points corresponding to the first sub-screen, and the second drawing point is all the drawing points corresponding to the first sub-screen. In this case, the electronic device can use the first drawing point as the drawing point of the first sub-screen and the second drawing point as the drawing point of the second sub-screen.

[0118] Then, the electronic device can perform trajectory fitting on the splicing point and all the corresponding drawing points of the first sub-screen in the coordinate system of the first sub-screen, that is, perform trajectory fitting on the splicing point and the drawing points of the first sub-screen to obtain the drawing trajectory of the first sub-screen; and perform trajectory fitting on the splicing point and all the corresponding drawing points of the second sub-screen in the coordinate system of the second sub-screen, that is, perform trajectory fitting on the splicing point and the drawing points of the second sub-screen to obtain the drawing trajectory of the second sub-screen.

[0119] In this embodiment, the electronic device can first perform trajectory fitting based on the second drawing point and the first virtual drawing point to determine the splicing point, and then determine the drawing trajectory corresponding to the first sub-screen and the second sub-screen based on the sub-trajectory obtained by cutting the total trajectory according to the splicing point and performing coordinate transformation. Alternatively, it can perform trajectory fitting based on the splicing point and all the drawing points corresponding to the first sub-screen or the second sub-screen respectively to determine the drawing trajectory corresponding to the first sub-screen and the second sub-screen. This solves the problem of display breaks at the splicing line of the sub-screen and optimizes the display effect of the splicing screen.

[0120] As one embodiment of this application, the above-mentioned total trajectory can be a first trajectory obtained by fitting the second drawing point and the first virtual drawing point together.

[0121] The determination of the first sub-trajectory corresponding to the splicing point and the first drawing point, and the second sub-trajectory corresponding to the splicing point and the second drawing point, based on the total trajectory obtained by trajectory fitting based on the second drawing point and the first drawing point, may include:

[0122] Based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen, the first virtual drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory are transformed into the coordinate system of the first sub-screen to obtain the first sub-trajectory; the second drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory are determined as the second sub-trajectory.

[0123] The step of determining the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory and determining the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory may include:

[0124] If the first quantity is less than the number of drawing points included in the first sub-screen, and the second quantity is less than the number of drawing points included in the second sub-screen, then the trajectory formed by the other drawing points of the first sub-screen and the first sub-trajectory are taken as the drawing trajectory of the first sub-screen; the trajectory formed by the other drawing points of the second sub-screen and the second sub-trajectory are taken as the drawing trajectory of the second sub-screen; or, if the first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen, then the first sub-trajectory is determined as the drawing trajectory of the first sub-screen, and the second sub-trajectory is determined as the drawing trajectory of the second sub-screen.

[0125] In other words, regardless of whether the second drawing point is a subset of the drawing points in the second sub-screen and the first virtual drawing point is a virtual drawing point corresponding to a subset of the drawing points in the first sub-screen, or whether the second drawing point is all the drawing points in the second sub-screen and the first virtual drawing point is a virtual drawing point corresponding to all the drawing points in the first sub-screen, the electronic device can first fit the second drawing point and the first virtual drawing point to obtain the first trajectory.

[0126] Then, based on the splicing points, the first trajectory is cut to obtain two segmented trajectories. Based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen, the segmented trajectory corresponding to the first sub-screen is transformed to the coordinate system corresponding to the first sub-screen, thereby determining the first sub-trajectory corresponding to the first sub-screen. The segmented trajectory corresponding to the second sub-screen is directly used as the second sub-trajectory corresponding to the second sub-screen.

[0127] At this time, when the second drawing point is a partial drawing point in the second sub-screen and the first virtual drawing point is a virtual drawing point corresponding to a partial drawing point in the first sub-screen, the obtained first sub-trajectory and second sub-trajectory are only partial drawing trajectories corresponding to the first sub-screen and the second sub-screen. Therefore, the complete drawing trajectory corresponding to the first sub-screen and the second sub-screen can be obtained further based on other drawing points of the first sub-screen and other drawing points of the second sub-screen.

[0128] When the second drawing point is all the drawing points in the second sub-screen, and the first virtual drawing point is the virtual drawing point corresponding to all the drawing points in the first sub-screen, the resulting first sub-trajectory and second sub-trajectory are the complete drawing trajectories corresponding to the first and second sub-screens.

[0129] The following is based on Figure 10 and Figure 11For example, let's introduce in detail the two methods for determining the drawing trajectory of the first and second sub-screens: when the second drawing point is a subset of the drawing points in the second sub-screen, and the first virtual drawing point is the virtual drawing point corresponding to a subset of the drawing points in the first sub-screen; and when the second drawing point is all the drawing points in the second sub-screen, and the first virtual drawing point is the virtual drawing point corresponding to all the drawing points in the first sub-screen.

[0130] As one embodiment of this application, the first quantity is less than the number of drawing points included in the first sub-screen, and the second quantity is less than the number of drawing points included in the second sub-screen; the total trajectory is a first trajectory obtained by fitting the second drawing points and the first virtual drawing points together.

[0131] like Figure 10 As shown, the total trajectory obtained by trajectory fitting based on the second drawing point and the first virtual drawing point, determining the first sub-trajectory corresponding to the splicing point and the first drawing point, and the second sub-trajectory corresponding to the splicing point and the second drawing point, determining the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory, and determining the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory, can include:

[0132] S1001, based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen, the first virtual drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory are transformed to the coordinate system of the first sub-screen to obtain the first sub-trajectory;

[0133] S1002, the second drawing point in the first trajectory and the part of the trajectory corresponding to the splicing point are determined as the second sub-trajectory;

[0134] Because the first trajectory is obtained by fitting the second drawn point and the first virtual drawn point, and the first virtual drawn point is obtained by transforming the drawn points in the first sub-screen, it actually belongs to the first sub-screen. The second drawn point belongs to the second sub-screen. Therefore, part of the first trajectory obtained by fitting belongs to the first sub-screen, and the other part belongs to the second sub-screen.

[0135] Therefore, after obtaining the first trajectory, the electronic device can cut the first trajectory according to the splicing points. Specifically, the electronic device can transform the first virtual drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory (i.e., the part of the trajectory corresponding to the first sub-screen) to the coordinate system of the first sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The transformed trajectory is then used as the first sub-trajectory corresponding to the first sub-screen. Furthermore, the second drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory (i.e., the part of the trajectory corresponding to the second sub-screen) are determined as the second sub-trajectory corresponding to the second sub-screen.

[0136] S1003, take the trajectory formed by the other drawing points of the first sub-screen and the first sub-trajectory as the drawing trajectory of the first sub-screen.

[0137] Because the first number is less than the total number of drawing points included in the first sub-screen, the first virtual drawing point for fitting is only the virtual drawing point corresponding to a portion of the drawing points in the first sub-screen, not the virtual drawing point corresponding to all the drawing points in the first sub-screen. In other words, the first sub-trajectory corresponding to the first sub-screen determined by the electronic device is not the complete trajectory corresponding to the first sub-screen.

[0138] Therefore, the electronic device can perform trajectory fitting based on other drawing points of the first sub-screen, that is, other drawing points in the first sub-screen besides the first drawing point, and use the trajectory obtained by fitting through the other drawing points and the aforementioned first sub-trajectory as the drawing trajectory of the first sub-screen.

[0139] To ensure that the trajectory fitted based on other drawing points of the first sub-screen is connected to the first sub-trajectory, the electronic device, when fitting the trajectory based on other drawing points of the first sub-screen, can determine the endpoint drawing points of the first sub-trajectory that are closest to the aforementioned other drawing points, and fit them together with the other drawing points of the first sub-screen. In this way, because the trajectory fitted based on other drawing points of the first sub-screen and the first sub-trajectory have the same endpoints, it can be guaranteed that they are connected, and the drawing trajectory will not be broken.

[0140] S1004, the trajectory formed by the other drawing points of the second sub-screen and the second sub-trajectory are used as the drawing trajectory of the second sub-screen.

[0141] Similarly, because the second number is less than the number of drawing points included in the second sub-screen, the second drawing point for fitting is only the virtual drawing point corresponding to a portion of the drawing points in the second sub-screen, not the virtual drawing point corresponding to all the drawing points in the second sub-screen. In other words, the second sub-trajectory corresponding to the second sub-screen determined by the electronic device is not the complete trajectory corresponding to the second sub-screen.

[0142] Therefore, the electronic device can perform trajectory fitting based on other drawing points of the second sub-screen, that is, other drawing points in the second sub-screen besides the second drawing point, and use the trajectory obtained by fitting through these other drawing points and the aforementioned second sub-trajectory as the drawing trajectory of the second sub-screen.

[0143] Similarly, to ensure that the trajectory fitted based on other drawing points of the second sub-screen is connected to the second sub-trajectory, the electronic device can determine the endpoint drawing points of the fitted second sub-trajectory that are close to the aforementioned other drawing points when fitting the trajectory based on other drawing points of the second sub-screen, and fit these points together with the other drawing points of the second sub-screen. In this way, because the trajectory fitted based on other drawing points of the second sub-screen and the second sub-trajectory have the same endpoints, it can be guaranteed that they are connected, and the drawing trajectory will not be broken.

[0144] The execution order of steps S1001 to S1004 only needs to ensure that step S1001 is executed before step S1003 and step S1002 is executed before step S1004, and is not limited to... Figure 10 The content shown is as follows. For example, the electronic device can execute S1001 and S1003 first, and then execute S1002 and S1004; or it can execute S1001-S1003 and S1002-S1004 simultaneously. These are all possible and no specific limitation is made here.

[0145] In this embodiment, after obtaining the first virtual drawing point, the electronic device can perform trajectory fitting based on the second drawing point and the first virtual drawing point in the same coordinate system. Then, the fitted trajectory is divided according to the splicing point and the coordinates are transformed to two sub-screens, resulting in a first sub-trajectory corresponding to the first sub-screen and a second sub-trajectory corresponding to the second sub-screen. Furthermore, based on other drawing points in the first and second sub-screens, the remaining trajectory is fitted to obtain the complete trajectory corresponding to the first and second sub-screens. Thus, because the trajectory around the splicing line is a single, integrated trajectory fitted based on the second drawing point and the first virtual drawing point, the trajectory around the splicing line can maintain excellent smoothness, further optimizing the display effect of the spliced ​​screen.

[0146] As one embodiment of this application, the first quantity is the number of drawing points included in the first sub-screen, the second quantity is the number of drawing points included in the second sub-screen; the total trajectory is a fourth trajectory obtained by fitting the second drawing points and the first virtual drawing points together.

[0147] like Figure 11As shown, the total trajectory obtained by trajectory fitting based on the second drawing point and the first virtual drawing point, determining the first sub-trajectory corresponding to the splicing point and the first drawing point, and the second sub-trajectory corresponding to the splicing point and the second drawing point, determining the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory, and determining the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory, can include:

[0148] S1101, based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen, the first virtual drawing point and the part of the trajectory corresponding to the splicing point in the fourth trajectory are transformed to the coordinate system of the first sub-screen to obtain the first sub-trajectory;

[0149] After the electronic device transforms the first drawing point in the first sub-screen to the coordinate system of the second sub-screen to obtain the first virtual drawing point, it can perform trajectory fitting between the second drawing point and the first virtual drawing point in the coordinate system of the second sub-screen to obtain a fourth trajectory. Since the first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen, the second drawing point is all the drawing points in the second sub-screen, and the first virtual drawing point is the virtual drawing point corresponding to all the drawing points in the first sub-screen. Accordingly, the fourth trajectory obtained by fitting the second drawing point and the first virtual drawing point is the trajectory corresponding to all the drawing points in both the first and second sub-screens in the coordinate system of the second sub-screen.

[0150] Similarly, since the fourth trajectory obtained by fitting the second drawing point and the first virtual drawing point contains part of the trajectory corresponding to the first virtual drawing point, and the first virtual drawing point is a virtual drawing point obtained by transforming the drawing point in the first sub-screen, it actually belongs to the first sub-screen, but its coordinates have been transformed to the coordinate system of the second sub-screen, the electronic device can determine the drawing trajectory corresponding to the first sub-screen in the fourth trajectory, that is, the first virtual drawing point and part of the trajectory corresponding to the splicing point in the fourth trajectory.

[0151] After determining the drawing trajectory corresponding to the first sub-screen in the fourth trajectory, since the fourth drawing trajectory is located in the coordinate system of the second sub-screen, the electronic device can perform coordinate transformation on the drawing trajectory corresponding to the first sub-screen in the fourth trajectory according to the coordinate transformation relationship between the first sub-screen and the second sub-screen, and take the transformed trajectory as the first sub-trajectory.

[0152] S1102, the second drawing point in the fourth trajectory and the part of the trajectory corresponding to the splicing point are determined as the second sub-trajectory;

[0153] Since the fourth drawing trajectory itself is located in the coordinate system of the second sub-screen, the second drawing point and the part of the trajectory corresponding to the splicing point in the fourth trajectory can be directly determined and identified as the second sub-trajectory.

[0154] S1103, the first sub-trajectory is determined as the drawing trajectory of the first sub-screen;

[0155] S1104, the second sub-trajectory is determined as the drawing trajectory of the second sub-screen.

[0156] Similarly, since the first quantity is the number of drawing points included in the first sub-screen and the second quantity is the number of drawing points included in the second sub-screen, the first sub-trajectory determined based on the first virtual drawing point and the splicing point, and the second sub-trajectory determined based on the second drawing point and the splicing point, are respectively the complete drawing trajectory corresponding to the first sub-screen and the complete drawing trajectory corresponding to the second sub-screen.

[0157] Therefore, after obtaining the first sub-trajectory and the second sub-trajectory, the electronic device can directly use the first sub-trajectory and the second sub-trajectory as the drawing trajectory for the first sub-screen and the second sub-screen.

[0158] The execution order of steps S1101 to S1104 only needs to ensure that step S1101 is executed before step S1103 and step S1102 is executed before step S1104, and is not limited to... Figure 11 The content shown is as follows. For example, the electronic device can execute S1101 and S1103 first, and then execute S1102 and S1104; or it can execute S1101-S1103 and S1102-S1104 simultaneously. These are all possible and no specific limitation is made here.

[0159] In this embodiment, the electronic device can transform all drawing points on the first sub-screen to the coordinate system of the second sub-screen. Then, in the coordinate system of the second sub-screen, all drawing points on the first sub-screen are fitted to all drawing points on the second sub-screen to obtain the trajectories corresponding to all drawing points on the first and second sub-screens. Finally, the drawing trajectories corresponding to the first and second sub-screens are determined from these trajectories. Because the drawing trajectories corresponding to the first and second sub-screens are determined from a fitted trajectory, the drawing trajectory corresponding to the first sub-screen and the drawing trajectory corresponding to the second sub-screen can match well, thus solving the problem of display breaks at the seam of the two sub-screens where the fitted drawing content appears.

[0160] As one embodiment of this application, the first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen;

[0161] When the electronic device transforms the first drawing point into the coordinate system of the second sub-screen to obtain the first virtual drawing point, it can also transform the second drawing point into the coordinate system of the first sub-screen to obtain the second virtual drawing point based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen.

[0162] The content of the coordinate transformation of the second drawing point in this step is related to... Figure 6 Compared to the example shown, the coordinate transformation of the first drawing point differs only in the drawing point to be transformed and the transformed coordinate system; the transformation method remains the same. Therefore, the specific method for performing coordinate transformation on the second drawing point can be found in [reference needed]. Figure 6 The coordinate transformation of the first drawing point in the illustrated embodiment will not be repeated here.

[0163] After transforming all drawing points (first drawing points) on the first sub-screen to the coordinate system of the second sub-screen, and also transforming all drawing points on the second sub-screen to the coordinate system of the first sub-screen, the electronic device can fit the drawing points in the coordinate systems of the first and second sub-screens respectively. Specifically:

[0164] The electronic device can perform trajectory fitting on all drawing points of the second sub-screen (i.e., the second drawing points) and all drawing points of the first sub-screen (i.e., the first virtual drawing points) in the coordinate system of the second sub-screen to obtain a second trajectory. This second trajectory is the trajectory corresponding to all drawing points of the first and second sub-screens in the coordinate system of the second sub-screen.

[0165] The electronic device can also perform trajectory fitting on all drawing points of the first sub-screen (i.e., the first drawing points) and all drawing points of the second sub-screen (i.e., the second virtual drawing points) in the coordinate system of the first sub-screen to obtain a third trajectory. This third trajectory is the trajectory corresponding to all drawing points of the first and second sub-screens in the coordinate system of the first sub-screen.

[0166] For example, all the drawing points in the first sub-screen are drawing point A, drawing point B, and drawing point C, and all the drawing points in the second sub-screen are drawing point D, drawing point E, and drawing point F.

[0167] The electronic device can transform all the drawing points on the first sub-screen to the coordinate system of the second sub-screen to obtain the first virtual drawing point A', the first virtual drawing point B', and the first virtual drawing point C'. Then, the electronic device can fit the virtual drawing points A', B', C', D, E, and F belonging to the coordinate system of the second sub-screen to obtain the second trajectory.

[0168] The electronic device can also transform all the drawing points on the second sub-screen to the coordinate system of the first sub-screen to obtain the second virtual drawing point D', the second virtual drawing point E', and the second virtual drawing point F'. Then, the electronic device can fit the drawing points A, B, C, D', E', and F' belonging to the coordinate system of the first sub-screen to obtain the third trajectory.

[0169] At this point, the total trajectory mentioned above may include the second trajectory obtained by fitting the second drawing point and the first virtual drawing point together, and the third trajectory obtained by fitting the first drawing point and the second virtual drawing point together.

[0170] Correspondingly, such as Figure 12 As shown, the total trajectory obtained by trajectory fitting based on the second drawing point and the first virtual drawing point, determining the first sub-trajectory corresponding to the splicing point and the first drawing point, and the second sub-trajectory corresponding to the splicing point and the second drawing point, determining the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory, and determining the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory, can include:

[0171] S1201, perform trajectory fitting between the splicing point and the first drawing point to obtain a first sub-trajectory; or, if the total trajectory further includes a third trajectory obtained by fitting the trajectory of the first drawing point and the second virtual drawing point, take the portion of the trajectory corresponding to the splicing point and the first drawing point in the third trajectory as the first sub-trajectory;

[0172] In one implementation, when the electronic device fits the trajectory of the first drawing point and the second virtual drawing point to obtain a third trajectory, since the third trajectory includes a portion of the trajectory corresponding to the second virtual drawing point, and the second virtual drawing point is a virtual drawing point obtained by transforming the coordinates of the drawing point in the second sub-screen, it actually belongs to the second sub-screen, but its coordinates have been transformed to the coordinate system of the first sub-screen. Therefore, when the first sub-screen displays the third trajectory, it cannot actually display the portion of the trajectory corresponding to the second virtual drawing point. Thus, the electronic device can use only the portion of the trajectory corresponding to the first sub-screen in the third trajectory, that is, the portion of the trajectory corresponding to the splicing point and the first drawing point in the third trajectory, as the first sub-trajectory of the first sub-screen.

[0173] In another implementation, the electronic device may not need to perform coordinate system transformation on the second drawing point. Correspondingly, it may not need to perform trajectory fitting on the first drawing point and the second virtual drawing point to obtain the third trajectory. In this case, the electronic device can directly perform trajectory fitting on the splicing point and the first drawing point to obtain the first sub-trajectory.

[0174] S1202, the second drawing point in the second trajectory and the part of the trajectory corresponding to the splicing point are determined as the second sub-trajectory;

[0175] Because the second trajectory obtained by fitting the second drawing point and the first virtual drawing point includes a portion of the trajectory corresponding to the first virtual drawing point, and the first virtual drawing point is a virtual drawing point obtained by transforming the drawing point in the first sub-screen, it actually belongs to the first sub-screen, but its coordinates have been transformed to the coordinate system of the second sub-screen. Therefore, when the first sub-screen displays the second trajectory, it cannot actually display the portion of the trajectory corresponding to the first virtual drawing point. Thus, the electronic device can use only the portion of the trajectory corresponding to the second sub-screen in the second trajectory, that is, the portion of the trajectory corresponding to the second drawing point and the splicing point in the second trajectory, as the second sub-trajectory of the second sub-screen.

[0176] S1203, the first sub-trajectory is determined as the drawing trajectory of the first sub-screen;

[0177] S1204, the second sub-trajectory is determined as the drawing trajectory of the second sub-screen.

[0178] Since the first quantity is the number of drawing points included in the first sub-screen and the second quantity is the number of drawing points included in the second sub-screen, the first drawing point and the second drawing point are also all the drawing points in the first sub-screen and the second sub-screen, respectively. Accordingly, the first sub-trajectory determined based on the first drawing point and the splicing point, and the second sub-trajectory determined based on the second drawing point and the splicing point, are respectively the complete drawing trajectory corresponding to the first sub-screen and the complete drawing trajectory corresponding to the second sub-screen.

[0179] Therefore, after obtaining the first sub-trajectory and the second sub-trajectory, the electronic device can directly use the first sub-trajectory and the second sub-trajectory as the drawing trajectory for the first sub-screen and the second sub-screen.

[0180] The execution order of steps S1201 to S1204 only needs to ensure that step S1201 is executed before step S1203 and step S1202 is executed before step S1204, and is not limited to... Figure 12 The content shown is as follows. For example, the electronic device can execute S1201 and S1203 first, and then execute S1202 and S1204; or it can execute S1201-S1203 and S1202-S1204 simultaneously. These are all possible and no specific limitation is made here.

[0181] In this embodiment, the electronic device can convert all drawing points on the first sub-screen to the coordinate system of the second sub-screen, and vice versa. Thus, both the first and second sub-screen coordinate systems contain all drawing points. When the electronic device performs trajectory fitting in the first and second sub-screen coordinate systems, although the coordinates of each drawing point are not identical in the two fittings, the drawing points are essentially the same, and their relative positions are identical. Therefore, the two trajectories obtained from the two fittings are identical. Based on this, the electronic device determines the drawing trajectory corresponding to the first sub-screen from the third trajectory fitted in the first sub-screen coordinate system, and determines the drawing trajectory corresponding to the second sub-screen from the second trajectory fitted in the second sub-screen coordinate system. Since the second and third trajectories are essentially the same, the drawing trajectory corresponding to the first sub-screen determined from the second and third trajectories matches well with the drawing trajectory corresponding to the second sub-screen, thereby solving the problem of display breaks at the seam between the two sub-screens.

[0182] It should be noted that when the electronic device is the management device corresponding to the splicing screen, after determining the drawing trajectory of the first sub-screen and the second sub-screen, the electronic device can send the drawing trajectory of the first sub-screen and the drawing trajectory of the second sub-screen to the processor corresponding to the first sub-screen and the processor corresponding to the second sub-screen, respectively.

[0183] When an electronic device is a processor connected to a sub-screen, after determining the drawing trajectories of the first and second sub-screens, the electronic device can save the drawing trajectory of the sub-screen it is connected to and send the other drawing trajectories to the corresponding processor. For example, when an electronic device is a processor connected to a second sub-screen, after determining the drawing trajectories of the first and second sub-screens, the electronic device can save the drawing trajectory of the second sub-screen and send the drawing trajectory of the first sub-screen to the processor corresponding to the first sub-screen.

[0184] Because processors allow multiple programs to run concurrently, but due to limited resources, process execution is not continuous, but rather intermittent and progresses at an unpredictable speed. The time required for the processor to execute a program is uncertain. Therefore, when processors in various display systems work together to complete the display of a screen, the time required for each processor to complete the display of each sub-screen is uncertain, meaning that there will be an asynchronous problem between processors.

[0185] Therefore, multiple sub-screens are displaying Figure 3 When drawing the content shown, under normal circumstances, the content should be rendered and displayed step by step from sub-screen 1 -> sub-screen 3 -> sub-screen 4 -> sub-screen 2. However, due to the asynchronous nature of the processors on the multiple sub-screens in a video wall, this may result in... Figure 13 The problem shown is that at a certain moment, the content drawn on sub-screen 1 is rendered and displayed, but the content drawn on sub-screen 3 is not rendered and displayed, while the content drawn on sub-screen 4 and sub-screen 2 is rendered and displayed. This results in a rendering follow-up problem.

[0186] Therefore, in order to solve the rendering follow-up problem, when electronic devices control the display of drawn content on the sub-screens in the video wall according to the drawing trajectory, they can choose the corresponding display mode according to the actual usage needs, either synchronous display or display according to the drawing order, and control the sub-screens in the video wall to display the drawn content.

[0187] As one implementation method of this application, when the electronic device uses a synchronous display method to control the display of drawn content, such as Figure 14 As shown, controlling the display of the drawing content on the splicing screen according to the drawing trajectory can include:

[0188] S1401, Obtain rendering completion information for each sub-screen;

[0189] S1402, when the rendering completion information indicates that all sub-screens have completed rendering of the points to be displayed, the synchronous display of the drawn content is triggered.

[0190] When an electronic device is a processor connected to a sub-screen, each sub-screen's processor can be pre-programmed to return rendering completion information to the electronic device after rendering the drawing trajectory. When the electronic device receives rendering completion information from the processors of other sub-screens and determines that it has also completed rendering the drawing trajectory, it can confirm that all sub-screen processors in the splicing screen have completed rendering the points to be displayed. At this time, the electronic device can control the sub-screen it is connected to to display its own rendered drawing trajectory and send synchronous display commands to the processors of other sub-screens to trigger the other processors to control their corresponding sub-screens to display the rendered drawing trajectory, thereby achieving synchronous display of the drawn content on the splicing screen.

[0191] When the electronic device is the management device corresponding to the video wall, after the electronic device sends the drawing trajectory corresponding to each sub-screen to the processor corresponding to each sub-screen, the processor of each sub-screen can return rendering completion information to the electronic device after rendering the drawing trajectory. When the electronic device receives the rendering completion information sent by the processors of all sub-screens, it means that the processors of all sub-screens have completed the rendering of the points to be displayed. At this time, the electronic device can send a synchronous display command to the processors of each sub-screen to trigger each processor to control the corresponding sub-screen to display the drawing trajectory after rendering, thereby realizing the synchronous display of the drawn content on the video wall.

[0192] by Figure 15 For example, the electronic device is the management device corresponding to the video wall. At time T0, the electronic device sends the drawing trajectory corresponding to each sub-screen to the processor corresponding to each sub-screen. At time T1, it receives the rendering completion information sent by the processor corresponding to sub-screen 1. At time T2, it receives the rendering completion information sent by the processors corresponding to sub-screen 3 and sub-screen 4. At time T3, it receives the rendering completion information sent by the processor corresponding to sub-screen 2. At this time, the electronic device can determine that it has obtained the rendering completion information of all sub-screens. Then, the electronic device can send a synchronization display signal to the processor corresponding to each sub-screen to instruct the processor corresponding to each sub-screen to control the corresponding sub-screen to synchronously display the rendered content at time T4.

[0193] In one implementation, when determining whether rendering completion information for all processors corresponding to all sub-screens has been received, the electronic device can, after sending the drawing trajectory corresponding to each sub-screen to the processor corresponding to each sub-screen, obtain the sub-screen identifier in the received rendering completion information in real time, and determine whether the obtained sub-screen identifiers include preset sub-screen identifiers, in order to determine whether rendering completion information for all processors corresponding to all sub-screens has been obtained.

[0194] In another implementation, when the electronic device determines whether it has received rendering completion information from the processors corresponding to all sub-screens, it can send the drawing trajectory corresponding to each sub-screen to the processor corresponding to each sub-screen, and then determine in real time whether the number of received rendering completion information is equal to the target number, so as to determine whether the rendering completion information of all sub-screens has been obtained.

[0195] In this embodiment, the electronic device can obtain the rendering completion information of the processor corresponding to each sub-screen. After all sub-screens have been rendered, a synchronization display signal is sent to the processor corresponding to each sub-screen to instruct the processor corresponding to each sub-screen to control the corresponding sub-screen to synchronously display the rendered content, thereby solving the rendering follow-up problem.

[0196] As one embodiment of this application, when a terminal device sends content drawn by a user on the terminal device to an electronic device, it can also send the drawing order corresponding to the drawn content to the electronic device. This drawing order can be determined through methods such as... Figure 3 The drawing start point and drawing direction shown can also be represented by the sequence information of each drawing point in the drawing content, and no specific limitation is made here.

[0197] After the electronic device obtains the drawing trajectory through trajectory fitting, it can determine the drawing order of each point to be displayed in the drawing trajectory according to the drawing order corresponding to the received drawing content. This adds sequence information to each point to be displayed in the drawing trajectory, and the sequence information reflects the drawing order of each point to be displayed.

[0198] When an electronic device displays the drawn content in a manner that follows the drawing sequence, controlling the display of the drawn content on the video wall according to the drawing trajectory may include:

[0199] The drawing trajectory includes points to be displayed according to sequence information; target points to be displayed are determined among the points to be displayed; for each target point to be displayed, based on the sequence information of the already displayed target points to be displayed, it is determined whether the target point to be displayed is continuous with the already displayed target points to be displayed; if continuous, the display of the target point to be displayed is triggered, and the sequence information of the already displayed target points to be displayed is updated; if not continuous, the target duration is waited for, and the determination of whether the target point to be displayed is continuous with the already displayed target points to be displayed is returned based on the sequence information of the already displayed target points to be displayed; wherein, the sequence information is determined based on the drawing order of each point to be displayed.

[0200] In one implementation, when the electronic device is the management device corresponding to the splicing screen, the display point obtained by the electronic device can be all the display points, that is, each display point in the complete drawing trajectory. In this case, the above-mentioned step of triggering the display of the target display point can include: the electronic device sends a display instruction to the processor of the sub-screen to which the target display point belongs, so as to trigger the processor to control the corresponding sub-screen to display the target display point.

[0201] In another implementation, when the electronic device is a processor connected to a sub-screen, the display point obtained by the electronic device can be its own corresponding display point, i.e., each display point in the sub-screen to which the electronic device is connected. In this case, the step of triggering the display of the target display point can include: the electronic device controlling the sub-screen to which it is connected to display the target display point. In this situation, after updating the sequence information of the already displayed target display point, the electronic device needs to synchronize the updated sequence information to other processors.

[0202] In another embodiment, when the electronic device is a processor connected to a sub-screen, the display point obtained by the electronic device may include the display point corresponding to itself, that is, each display point in the sub-screen connected to the electronic device, or each display point in other sub-screens. In this case, the above-mentioned step of triggering the display of the target display point may include: when the target display point is the target display point corresponding to the electronic device itself, the electronic device controls the sub-screen connected to itself to display the target display point; when the target display point is the target display point corresponding to the processor of another sub-screen, a display command is sent to the processor of the other sub-screen to trigger the processor to control the corresponding sub-screen to display the target display point.

[0203] In the solution provided in this application embodiment, the electronic device can sequentially display the drawn content in each sub-screen of the splicing screen according to the sequence information of each point to be displayed in the drawing trajectory, thereby effectively solving the rendering follow-up problem and further optimizing the display effect of the splicing screen.

[0204] As one implementation of this application, determining the target point to be displayed among the points to be displayed may include: determining the obtained point to be displayed as the target point to be displayed.

[0205] Correspondingly, such as Figure 16 As shown, controlling the display of the drawing content on the splicing screen according to the drawing trajectory can include:

[0206] S1601, Obtain the points to be displayed included in the drawing trajectory according to the sequence information;

[0207] Because the sequence information of the points to be displayed in the drawing trajectory represents the drawing order of those points, when displaying the drawn content, the electronic device can, at certain time intervals, sequentially obtain and display the points to be displayed in the drawing trajectory according to the sequence information.

[0208] For example, an electronic device can sequentially acquire points to be displayed in the drawing trajectory, including points with sequence information of 1, points with sequence information of 2, ..., points with sequence information of N, according to the order of the sequence information.

[0209] S1602, the obtained point to be displayed is determined as the target point to be displayed;

[0210] For each point to be displayed that is acquired, the electronic device can identify it as the target point to be displayed.

[0211] S1603, for each target point to be displayed, based on the sequence information of the already displayed target points to be displayed, determine whether the target point to be displayed is continuous with the already displayed target points to be displayed;

[0212] After obtaining a target point to be displayed, if the target point to be displayed is displayed directly, the current target point to be displayed and the previous target point to be displayed may belong to different sub-screens. The processor of the sub-screen to which the previous target point to be displayed belongs may have a display task, while the processor of the sub-screen to which the current target point to be displayed belongs may not have a display task or the processor of the sub-screen may have better display performance. Therefore, it is possible that the current target point to be displayed will be displayed, while the previous target point to be displayed has not been displayed yet, which is a follow-up problem.

[0213] Therefore, when an electronic device acquires a target point to be displayed, it needs to determine, based on the sequence information of the already displayed target points, whether the target point to be displayed is continuous with the already displayed target points, and whether other target points before the target point to be displayed in the sequence information have been displayed.

[0214] S1604, If continuous, trigger the display of the target to be displayed point, and update the sequence information of the already displayed target to be displayed points;

[0215] If the target to be displayed is consecutive to the already displayed target to be displayed, then all target to be displayed before the target to be displayed have been displayed. At this time, the processor corresponding to the sub-screen to which the target to be displayed belongs can be triggered to display the target to be displayed, and after the display is completed, the sequence information of the already displayed target to be displayed is updated.

[0216] S1605, if not continuous, wait for the target duration and return the sequence information based on the already displayed target points to be displayed to determine whether the target points to be displayed are continuous with the already displayed target points to be displayed;

[0217] If the target to be displayed is not continuous with the already displayed target to be displayed, it means that there are target to be displayed points in the sequence information that have not been fully displayed. For example, if the sequence information of the current target to be displayed point is 5, and the sequence information of the already displayed target to be displayed points is 1, 2, 3, then it means that the target to be displayed point with column information 4 has not been fully displayed.

[0218] Therefore, if the target to be displayed is not continuous with the already displayed target to be displayed, the electronic device can wait for the target duration and then return to the sequence information based on the already displayed target to be displayed to determine whether the target to be displayed is continuous with the already displayed target to be displayed. Then, it can determine again whether all other target to be displayed before the target to be displayed has been displayed.

[0219] In the solution provided in this application embodiment, the electronic device obtains the target display point according to the sequence information and displays it. It determines whether to display the obtained target display point by judging whether the sequence information is continuous, which ensures that each target display point in the splicing screen is displayed in the drawing order and solves the display follow-up problem.

[0220] As one implementation method of this application, such as Figure 17 As shown, determining the target point among the points to be displayed can include: for each point to be displayed, determining whether the point to be displayed and the previous point to be displayed belong to the same sub-screen based on the screen information corresponding to the point to be displayed, wherein the screen information is used to identify the sub-screen displaying the point to be displayed; if the point to be displayed and the previous point to be displayed do not belong to the same sub-screen, then the point to be displayed is determined as the target point to be displayed.

[0221] Correspondingly, such as Figure 17 As shown, controlling the display of the drawing content on the splicing screen according to the drawing trajectory can include:

[0222] S1701, Obtain the points to be displayed included in the drawing trajectory according to the sequence information;

[0223] This step is the same as step S1601 above, and will not be repeated here.

[0224] S1702, for each point to be displayed, determine whether the point to be displayed and the previous point to be displayed belong to the same sub-screen based on the screen information corresponding to the point to be displayed;

[0225] After acquiring a point to be displayed, the electronic device can determine whether the screen information corresponding to the point to be displayed is the same as the screen information of the previous point to be displayed. If the screen information is the same, it is determined that the point to be displayed and the previous point to be displayed belong to the same sub-screen. If the screen information is different, it is determined that the point to be displayed and the previous point to be displayed do not belong to the same sub-screen.

[0226] The screen information is added by the electronic device based on the position of each sub-screen in the splicing screen to determine the sub-screen to which each point to be displayed in the drawing trajectory belongs, and is used to identify the sub-screen that displays the point to be displayed.

[0227] S1703, if the point to be displayed belongs to the same sub-screen as the previous point to be displayed, trigger the display of the point to be displayed;

[0228] When the target point to be displayed belongs to the same sub-screen as the previous target point to be displayed, assuming that each target point to be displayed is acquired and displayed sequentially according to the sequence information, if the previous target point to be displayed has already been displayed, then displaying the target target point to be displayed at this time can guarantee that each target point to be displayed is displayed in the drawing order. If the previous target point to be displayed has not been displayed, then because the previous target point to be displayed and the target point to be displayed are on the same sub-screen and are in the same display queue, and the previous target point to be displayed had already entered the display queue before the target point to be displayed, when the target point to be displayed is triggered to be displayed at this time, that is, when the target point to be displayed is placed into the display queue, the previous target point to be displayed can still be displayed before the target point to be displayed, that is, it can still guarantee that each target point to be displayed is displayed in the drawing order.

[0229] Therefore, when an electronic device determines that the acquired point to be displayed belongs to the same sub-screen as the previous point to be displayed, it can directly trigger the display of the point to be displayed. After the point to be displayed is displayed, it can update the sequence information of the displayed points to be displayed without having to determine whether the point to be displayed is continuous with the displayed points to be displayed.

[0230] S1704, if the point to be displayed does not belong to the same sub-screen as the previous point to be displayed, then the point to be displayed is determined as the target point to be displayed;

[0231] If the point to be displayed does not belong to the same sub-screen as the previous point to be displayed, then there may be a display task in the processor of the sub-screen to which the previous point to be displayed belongs, while the processor of the sub-screen to which the current point to be displayed belongs did not have a display task before, or the processor of the sub-screen has better display performance. In this case, if the point to be displayed is displayed directly, the current point to be displayed may be displayed, while the previous point to be displayed has not yet been displayed, that is, a display following problem occurs.

[0232] Therefore, when an electronic device determines that a point to be displayed does not belong to the same sub-screen as the previous point to be displayed, it needs to determine whether the point to be displayed is continuous with the previously displayed points based on the sequence information of the displayed points. That is, it needs to determine whether all points to be displayed in the sub-screen to which the previous point belongs have been rendered and displayed. Therefore, when a point to be displayed does not belong to the same sub-screen as the previous point, the electronic device can designate the current point as the target point to be displayed and control its display according to the sequence information.

[0233] S1705, for each target point to be displayed, based on the sequence information of the already displayed target points to be displayed, determine whether the target point to be displayed is continuous with the already displayed target points to be displayed;

[0234] S1706, If continuous, trigger the display of the target to be displayed point, and update the sequence information of the already displayed target to be displayed points;

[0235] S1707, if not continuous, wait for the target duration and return the sequence information based on the already displayed target points to be displayed to determine whether the target points to be displayed are continuous with the already displayed target points to be displayed.

[0236] Steps S1705-S1707 are the same as steps S1603-S1605, and will not be repeated here.

[0237] In the solution provided in this application embodiment, the electronic device obtains and displays the points to be displayed according to the sequence information. Before determining whether the sequence information of the points to be displayed is continuous, it can first determine whether the point to be displayed and the previous point to be displayed belong to the same sub-screen. If they belong to the same sub-screen, since the previous point to be displayed and the point to be displayed are on the same sub-screen, they are in the same display queue, and the previous point to be displayed had already entered the display queue before the point to be displayed. Therefore, it is not necessary to wait for the previous point to be displayed to finish displaying before displaying; the display of the point to be displayed can be triggered directly. At this time, it can also be ensured that the point to be displayed and the previous point to be displayed are displayed in the drawing order. If they do not belong to the same sub-screen, it can be determined whether to display the obtained target point to be displayed by judging whether the sequence information is continuous. Thus, while ensuring that each point to be displayed in the splicing screen is displayed in the drawing order and solving the display follow-up problem, the display speed is improved because the previous point to be displayed and the point to be displayed are on the same sub-screen.

[0238] It should be noted that the points to be displayed in the above drawing trajectory can be either unrendered points or rendered points that have not yet been displayed. In other words, the electronic device can first determine whether the currently acquired drawing points need to be displayed, i.e., whether the currently acquired drawing points are displayed in the order they were drawn. If so, it will render and display the drawing point. Alternatively, the electronic device can also determine whether the currently acquired drawing points need to be displayed after all the drawing points have been rendered, i.e., whether the currently acquired drawing points are displayed in the order they were drawn. If so, it will display the drawing point.

[0239] When the point to be displayed is an unrendered drawing point, triggering the display of the target point can include triggering the processor corresponding to the target point to render and display the target point.

[0240] When the point to be displayed is a rendered but not yet displayed drawing point, triggering the display of the target point can include triggering the processor corresponding to the target point to display the target point.

[0241] As one implementation method of this application, such as Figure 18 As shown, after controlling the display of the drawing content on the splicing screen according to the drawing trajectory, the above method may further include:

[0242] S1801, Upon receiving a screen switching instruction, display the switched screen based on the screen switching instruction;

[0243] In some use cases, users need to switch screens, such as zooming in on a target object in the original display or changing the target object's position on the screen. In these situations, users can send a screen switching command to the electronic device via their terminal device. After receiving the screen switching command, the electronic device can adaptively adjust the original display screen according to the command and display the switched screen.

[0244] by Figure 19 For example, Figure 19 In the diagram, labels 1, 2, 3, and 4 represent sub-screen 1, sub-screen 2, sub-screen 3, and sub-screen 4, respectively. The target object, a hexagonal star, is located on the left side of the splicing screen and is relatively small. If the user wants to highlight the hexagonal star, the screen switching command sent from the terminal device to the electronic device is to move the hexagonal star to the center of the splicing screen and enlarge it by 1.5 times.

[0245] After receiving the screen switching command, the electronic device can move the center point of the hexagon to the center of the splicing screen, and then magnify the hexagon by 1.5 times at the center of the splicing screen to determine and display the switched screen.

[0246] S1802, Based on the relationship between the switched screen and the screen before the switch, determine the drawing trajectory after the switch;

[0247] After displaying the switched screen, the electronic device can determine the drawing trajectory based on the relationship between the switched screen and the screen before the switch.

[0248] For example, with Figure 19 For example, if the drawn content is a hexagonal marker representing the target object, then when the hexagonal marker is moved to the center of the video wall and magnified 1.5 times, the drawn content must also be moved and magnified 1.5 times accordingly. At this point, the electronic device can determine the change in coordinates of the hexagonal marker's center point in the video wall's coordinate system before and after the switch, and move the center point of the drawn trajectory by the same amount of coordinate change. Simultaneously, the electronic device can also magnify the drawn trajectory by the same factor based on the hexagonal marker's magnification, thus obtaining the drawn trajectory after the switch.

[0249] S1803: Obtain the points to be displayed included in the switched drawing trajectory according to the sequence information; determine the target points to be displayed among the points to be displayed; for each target point to be displayed, determine whether the target point to be displayed is continuous with the already displayed target points based on the sequence information of the already displayed target points; if continuous, trigger the display of the target point to be displayed and update the sequence information of the already displayed target points; if not continuous, wait for the target duration and return the determination of whether the target point to be displayed is continuous with the already displayed target points based on the sequence information of the already displayed target points.

[0250] The sequence information is determined based on the drawing order of each target point to be displayed. Alternatively,

[0251] S1804, obtain rendering completion information for each sub-screen; if the rendering completion information indicates that each sub-screen has completed rendering for the points to be displayed, trigger the synchronous display of the drawn content after switching.

[0252] The rendering completion information is used to identify the rendering status of each sub-screen for the target point to be displayed after the switch.

[0253] The synchronous display or display according to the drawing order in steps S1803 and S1804 above are the same as Figure 14-17 The synchronous display or display according to the drawing order method in the illustrated embodiment is the same, so it will not be described again here. Furthermore, since the display method is selected from synchronous display or display according to the drawing order, the execution logic of steps S1803 and S1804 is to execute step S1803 or step S1804, not simultaneously.

[0254] In the solution provided in this application embodiment, when the displayed screen of an electronic device changes, the drawing trajectory after the change can be determined based on the relationship between the changed screen and the screen before the change, and the drawing trajectory can be changed accordingly. This allows the drawing content to change according to the screen change, greatly improving the user experience. Furthermore, the drawn content after the change can also be displayed sequentially on each sub-screen of the splicing screen according to the sequence information of each point to be displayed included in the drawing trajectory, or synchronously displayed on each sub-screen of the splicing screen based on rendering completion information. This effectively solves the display following problem and further optimizes the display effect of the splicing screen.

[0255] Corresponding to the above-described method for displaying drawn content, this application also provides a device for displaying drawn content. The following describes a device for displaying drawn content provided by this application.

[0256] like Figure 20 As shown, a display device for drawing content includes:

[0257] The drawing point acquisition module 2010 is used to acquire a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing line of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of the adjacent splicing line of the second sub-screen. The first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen. The splicing line is the splicing line between the first sub-screen and the second sub-screen.

[0258] The trajectory fitting module 2020 is used to perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory;

[0259] The display control module 2030 is used to control the sub-screens in the splicing screen to display the drawn content according to the drawing trajectory.

[0260] As one embodiment of this application, the method for obtaining the first drawing point may include:

[0261] Based on the splicing line between the first sub-screen and the second sub-screen, a region of target length is extended in the direction of the first sub-screen, and the coordinate range of the region is determined; from the drawing points of the first sub-screen, a first number of drawing points whose corresponding coordinates are located within the coordinate range are determined as the first drawing points.

[0262] As one embodiment of this application, the trajectory fitting module 2020 may include:

[0263] The splicing point determination submodule is used to perform trajectory fitting based on the second drawing point and the first virtual drawing point to determine the splicing point, wherein the splicing point is the intersection of the fitted trajectory corresponding to the second drawing point and the first virtual drawing point and the splicing line;

[0264] The trajectory determination submodule is used to determine the drawing trajectory based on the splicing point and the second drawing point.

[0265] As one embodiment of this application, the trajectory determination submodule may include:

[0266] A first determining unit is configured to perform trajectory fitting on the splicing point and the drawing points of the first sub-screen to obtain the drawing trajectory of the first sub-screen; and to perform trajectory fitting on the splicing point and the drawing points of the second sub-screen to obtain the drawing trajectory of the second sub-screen, wherein, when the first number is less than the number of drawing points included in the first sub-screen, and the second number is less than the number of drawing points included in the second sub-screen, the drawing points of the first sub-screen include the first drawing point and other drawing points of the first sub-screen excluding the first drawing point, and the drawing points of the second sub-screen include the second drawing point and other drawing points of the second sub-screen excluding the second drawing point; or, when the first number is equal to the number of drawing points included in the first sub-screen, and the second number is equal to the number of drawing points included in the second sub-screen, the drawing point of the first sub-screen is the first drawing point, and the drawing point of the second sub-screen is the second drawing point; or...

[0267] The second determining unit is used to determine the first sub-trajectory corresponding to the splicing point and the first drawing point and the second sub-trajectory corresponding to the splicing point and the second drawing point based on the total trajectory obtained by trajectory fitting based on the second drawing point and the first virtual drawing point, and to determine the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory and the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory.

[0268] As one embodiment of this application, the total trajectory is a first trajectory obtained by fitting the second drawing point and the first virtual drawing point together;

[0269] The second determining unit can be specifically used to transform the first virtual drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory to the coordinate system of the first sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen, to obtain a first sub-trajectory; determine the second drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory as a second sub-trajectory; if the first quantity is less than the number of drawing points included in the first sub-screen and the second quantity is less than the number of drawing points included in the second sub-screen, then the trajectory formed by the other drawing points of the first sub-screen and the first sub-trajectory are taken as the drawing trajectory of the first sub-screen; the trajectory formed by the other drawing points of the second sub-screen and the second sub-trajectory are taken as the drawing trajectory of the second sub-screen; or, if the first quantity is the number of drawing points included in the first sub-screen and the second quantity is the number of drawing points included in the second sub-screen, then the first sub-trajectory is determined as the drawing trajectory of the first sub-screen and the second sub-trajectory is determined as the drawing trajectory of the second sub-screen.

[0270] As one embodiment of this application, the first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen; the total trajectory includes a second trajectory obtained by fitting the second drawing points and the first virtual drawing points together.

[0271] The second determining unit can be specifically used to determine the second drawing point and the part of the trajectory corresponding to the splicing point in the second trajectory as a second sub-trajectory; to perform trajectory fitting between the splicing point and the first drawing point to obtain a first sub-trajectory; or, if the total trajectory also includes a third trajectory obtained by fitting the trajectory of the first drawing point and the second virtual drawing point, to take the part of the trajectory corresponding to the splicing point and the first drawing point in the third trajectory as the first sub-trajectory, and the second virtual drawing point is obtained by transforming the second drawing point to the coordinate system of the first sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen; to determine the first sub-trajectory as the drawing trajectory of the first sub-screen; and to determine the second sub-trajectory as the drawing trajectory of the second sub-screen.

[0272] As one embodiment of this application, the display control module 2030 may include a sequential display control submodule and a synchronous display control submodule;

[0273] The sequential display control submodule may include:

[0274] The point to be displayed acquisition unit is used to acquire the points to be displayed included in the drawing trajectory according to the sequence information;

[0275] A target point to be displayed determination unit is used to determine the target point to be displayed among the points to be displayed;

[0276] The judgment unit is used to determine whether the target to be displayed is continuous with the already displayed target to be displayed points based on the sequence information of the already displayed target to be displayed points when a target to be displayed point is acquired;

[0277] The display trigger unit is used to trigger the display of the target point to be displayed when the judgment result of the judgment unit is yes, and to update the sequence information of the already displayed target point to be displayed;

[0278] A waiting unit is configured to trigger the judgment unit after waiting for a target duration if the judgment result of the judgment unit is negative; wherein the sequence information is determined based on the drawing order of each point to be displayed;

[0279] The synchronous display control submodule can be used to obtain rendering completion information of each sub-screen; when the rendering completion information indicates that each sub-screen has completed rendering of the points to be displayed, the synchronous display of the drawn content is triggered, wherein the rendering completion information is used to indicate the rendering status of the points to be displayed corresponding to each sub-screen.

[0280] As one embodiment of this application, the target display point determination unit can be specifically used to determine the acquired display point as the target display point; or, for each acquired display point, based on the screen information corresponding to the display point, determine whether the display point and the previous display point belong to the same sub-screen; if the display point and the previous display point do not belong to the same sub-screen, then determine the display point as the target display point; wherein, the screen information is used to identify the sub-screen displaying the display point;

[0281] The display triggering unit can also be used to trigger the display of the target display point when the target display point determination unit determines that the display point and the previous display point belong to the same sub-screen.

[0282] As one embodiment of this application, the apparatus may further include:

[0283] The screen switching module is used to display the switched screen based on the screen switching command when a screen switching command is received;

[0284] The trajectory update module is used to determine the drawing trajectory after the switch based on the relationship between the switched screen and the screen before the switch.

[0285] The sequential display control submodule can also be used to obtain the points to be displayed included in the switched drawing trajectory according to the sequence information; determine the target points to be displayed among the points to be displayed; for each target point to be displayed, based on the sequence information of the already displayed target points to be displayed, determine whether the target point to be displayed is continuous with the already displayed target points to be displayed; if continuous, trigger the display of the target point to be displayed and update the sequence information of the already displayed target points to be displayed; if not continuous, wait for the target duration and return the determination of whether the target point to be displayed is continuous with the already displayed target points to be displayed based on the sequence information of the already displayed target points to be displayed; wherein, the sequence information is determined based on the drawing order of each point to be displayed;

[0286] The synchronous display control submodule can also be used to obtain rendering completion information for each sub-screen; when the rendering completion information indicates that each sub-screen has completed rendering of the points to be displayed, the synchronous display of the drawing content after switching is triggered, wherein the rendering completion information is used to indicate the rendering status of the points to be displayed after switching for each sub-screen.

[0287] Corresponding to the above-described method for displaying drawn content, this application also provides a system for displaying drawn content. The following describes a system for displaying drawn content provided by this application.

[0288] like Figure 21 As shown, a display system for drawing content includes a video wall 2101, which comprises multiple display systems 2102. Each display system 2102 includes a sub-screen 2103 and a processor 2104, wherein:

[0289] The processor 2104 is configured to acquire a first virtual drawing point and a second drawing point, wherein the first virtual drawing point is obtained by transforming a first number of drawing points of the adjacent splicing lines of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen; the second drawing point is a second number of drawing points of the adjacent splicing lines of the second sub-screen; the first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen; the splicing line is the splicing line between the first sub-screen and the second sub-screen; perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain a drawing trajectory; determine rendering information according to the drawing trajectory; perform rendering based on the rendering information to obtain a rendering result; and trigger the corresponding sub-screen to display the drawing content based on the rendering result.

[0290] The following is based on Figure 22 For example, based on Figure 21 The system for displaying drawn content shown will be described below. The method for displaying drawn content in the embodiments of this application will also be described:

[0291] Users can draw content on the image displayed on the splicing screen through the terminal device 2203, which can be a tablet computer, computer, mobile phone or other devices.

[0292] After receiving the drawing content sent by the terminal device 2203, the rendering device 2202, i.e. the processor mentioned above, can first convert the coordinate information of each drawing point in the drawing content on the screen of the terminal device 2203 to the coordinate system of the splicing screen 2201 according to the coordinate system transformation relationship between the terminal device 2203 and the splicing screen 2201, so as to obtain the coordinate information of each drawing point in the splicing screen 2201.

[0293] Furthermore, the rendering device 2202 can determine the sub-screen to which each drawing point in the splicing screen 2201 belongs based on the position of each sub-screen in the splicing screen 2201, and transform the coordinate information of each drawing point in the splicing screen 2201 to the coordinate system of the sub-screen to which the drawing point belongs based on the coordinate system transformation relationship between the splicing screen and each sub-screen in the splicing screen, so as to determine the position of each drawing point in each sub-screen.

[0294] It should be noted that the rendering device 2202 performing the above-mentioned drawing point mapping can be one rendering device in the display system. After completing the drawing point mapping, this rendering device can send the mapping results to other rendering devices. Alternatively, the rendering device 2202 performing the above-mentioned drawing point mapping can be any of the rendering devices in the display system. Each rendering device can save its own mapping results after completing the drawing point mapping.

[0295] After determining the drawing points in each sub-screen, the rendering device 2202 can take the sub-screen it is connected to as the second sub-screen, and take any sub-screen adjacent to the second sub-screen as the first sub-screen. Then, it can obtain the first number of first drawing points of the adjacent splicing line of the first sub-screen, and obtain the second number of second drawing points of the adjacent splicing line of the second sub-screen.

[0296] After obtaining the first drawing point and the second drawing point, the rendering device 2202 can transform the first drawing point into the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen to obtain the first virtual drawing point; perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory; determine the rendering information based on the drawing trajectory, perform rendering based on the rendering information to obtain the rendering result, and trigger the corresponding sub-screen to display the drawn content based on the rendering result. The rendering information may include each point in the drawing trajectory, as well as the drawing information corresponding to the drawing trajectory, such as line thickness, line density, line shape, line color, texture information, and boundary information.

[0297] In one implementation, the rendering device 2202 may determine only the drawing trajectory corresponding to the sub-screen it is connected to, and thus trigger only the sub-screen it is connected to to display the drawing content.

[0298] In another implementation, in addition to determining the drawing trajectory corresponding to the sub-screen it is connected to, the rendering device 2202 can also determine the drawing trajectory corresponding to the sub-screen adjacent to the sub-screen it is connected to, and then send the drawing trajectory to other rendering devices corresponding to the adjacent sub-screen, thereby triggering the sub-screen it is connected to to display drawing content, and triggering the adjacent sub-screen to display drawing content.

[0299] In the solution provided in this application embodiment, the processor can obtain a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing line of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of the adjacent splicing line of the second sub-screen. The first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen, and the splicing line is the splicing line between the first sub-screen and the second sub-screen. A drawing trajectory is obtained by performing trajectory fitting based on the second drawing point and the first virtual drawing point. Rendering information is determined according to the drawing trajectory, and rendering is performed based on the rendering information to obtain a rendering result. The corresponding sub-screen is then triggered to display the drawing content based on the rendering result. For any two sub-screens with splicing lines in a video wall, the processor can transform the drawing points of adjacent splicing lines in the two sub-screens to the same coordinate system, and then perform trajectory fitting based on the drawing points in the same coordinate system. This ensures the consistency of the drawing trajectory corresponding to the drawing points of adjacent splicing lines in the two sub-screens at the splicing line, thereby avoiding the situation where the drawing content is broken at the splicing point of each sub-screen in the video wall and optimizing the display effect of the video wall.

[0300] Corresponding to the above-described method for displaying drawn content, this application also provides another system for displaying drawn content. The following describes a system for displaying drawn content provided by this application.

[0301] like Figure 23 As shown, a display system for drawing content includes a management device 2301 and a video wall 2302. The video wall 2302 includes multiple display systems 2303, each display system 2303 including a sub-screen 2305 and a processor 2304, wherein:

[0302] The management device 2301 is used to acquire a first virtual drawing point and a second drawing point. The first virtual drawing point is obtained by transforming a first number of drawing points of adjacent splicing lines of the first sub-screen to the coordinate system of the second sub-screen based on the coordinate system transformation relationship between the first and second sub-screens. The second drawing point is a second number of drawing points of adjacent splicing lines of the second sub-screen. The first and second sub-screens are adjacent sub-screens in a splicing screen, and the splicing line is the splicing line between the first and second sub-screens. A drawing trajectory is obtained by performing trajectory fitting based on the second drawing point and the first virtual drawing point. The rendering information of the sub-screen is determined based on the drawing trajectory, and the rendering information is sent to the corresponding processor.

[0303] The processor 2304 is used to perform rendering based on the rendering information, obtain a rendering result, and trigger the corresponding sub-screen to display the drawn content based on the rendering result.

[0304] The following is based on Figure 24 For example, based on Figure 23 The system for displaying drawn content shown will be described below. The method for displaying drawn content in the embodiments of this application will also be described:

[0305] Users can draw content on the image displayed on the video wall using the terminal device 2404, which can be a tablet computer, computer, mobile phone, or other similar device.

[0306] After receiving the drawing content sent by the terminal device 2404, the splicing controller 2403, i.e. the aforementioned management device, can first convert the coordinate information of each drawing point in the drawing content on the screen of the terminal device 2404 to the coordinate system of the splicing screen 2401 according to the coordinate system transformation relationship between the terminal device 2404 and the splicing screen 2401, so as to obtain the coordinate information of each drawing point in the splicing screen 2401.

[0307] Furthermore, the splicing controller 2403 can determine the sub-screen to which each drawing point in the splicing screen 2401 belongs based on the position of each sub-screen in the splicing screen 2401, and according to the coordinate system transformation relationship between the splicing screen and each sub-screen in the splicing screen, transform the coordinate information of each drawing point in the splicing screen 2401 to the coordinate system of the sub-screen to which the drawing point belongs, so as to determine the position of each drawing point in each sub-screen.

[0308] After determining the drawing points in each sub-screen, the splicing controller 2403 can obtain a first number of first drawing points for adjacent splicing lines of the first sub-screen and a second number of second drawing points for adjacent splicing lines of the second sub-screen in the splicing screen 2401. Then, the splicing controller 2403 can transform the first drawing points into the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first and second sub-screens to obtain the first virtual drawing points; perform trajectory fitting based on the second drawing points and the first virtual drawing points to obtain the drawing trajectory; determine the rendering information of the sub-screen based on the drawing trajectory, and send the rendering information to the corresponding rendering device 2402, i.e., the aforementioned processor; wherein, the rendering information may include each point in the drawing trajectory, as well as the drawing information such as line thickness, line density, line shape, line color, texture information, and boundary information corresponding to the drawing trajectory.

[0309] After receiving the rendering information from the splicing controller 2403, the rendering device 2402 can perform rendering based on the rendering information, obtain the rendering result, and trigger the connected sub-screen to display the drawn content based on the rendering result.

[0310] In the solution provided in this application embodiment, the management device can obtain a first virtual drawing point and a second drawing point. The first virtual drawing point is obtained by transforming a first number of drawing points of adjacent splicing lines of the first sub-screen to the coordinate system of the second sub-screen based on the coordinate system transformation relationship between the first and second sub-screens. The second drawing point is a second number of drawing points of adjacent splicing lines of the second sub-screen. The first and second sub-screens are adjacent sub-screens in a splicing screen, and the splicing line is the splicing line between the first and second sub-screens. A drawing trajectory is obtained by fitting a trajectory based on the second drawing point and the first virtual drawing point. The rendering information of the sub-screen is determined based on the drawing trajectory, and the rendering information is sent to the corresponding processor. The processor can perform rendering based on the rendering information to obtain a rendering result, and trigger the corresponding sub-screen to display the drawing content based on the rendering result. For any two sub-screens with splicing lines in a video wall, the management device can transform the drawing points of adjacent splicing lines in the two sub-screens to the same coordinate system, and then perform trajectory fitting based on the drawing points in the same coordinate system. This ensures the consistency of the drawing trajectory corresponding to the drawing points of adjacent splicing lines in the two sub-screens at the splicing line, thereby avoiding the situation where the drawing content is broken at the splicing point of each sub-screen in the video wall and optimizing the display effect of the video wall.

[0311] This application also provides an electronic device, such as... Figure 25 As shown, it includes:

[0312] Memory 2501 is used to store computer programs;

[0313] The processor 2502, when executing the program stored in the memory 2501, implements the display method steps of the drawing content described in any of the above embodiments.

[0314] Furthermore, the aforementioned electronic device may also include a communication bus and / or a communication interface, with the processor 2502, the communication interface, and the memory 2501 communicating with each other via the communication bus.

[0315] In the solution provided in this application embodiment, the electronic device can obtain a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing lines of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of the adjacent splicing lines of the second sub-screen. The first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen, and the splicing line is the splicing line between the first sub-screen and the second sub-screen. A drawing trajectory is obtained by performing trajectory fitting based on the second drawing point and the first virtual drawing point. The drawing content is displayed on the sub-screens in the splicing screen according to the drawing trajectory. For any two sub-screens with splicing lines in a video wall, the electronic device can transform the drawing points of adjacent splicing lines in the two sub-screens to the same coordinate system, and then perform trajectory fitting based on the drawing points in the same coordinate system. This ensures the consistency of the drawing trajectory corresponding to the drawing points of adjacent splicing lines in the two sub-screens at the splicing line, thereby avoiding the situation where the drawing content is broken at the splicing point of each sub-screen in the video wall and optimizing the display effect of the video wall.

[0316] The communication bus mentioned in the above electronic devices can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in the diagram, but this does not mean that there is only one bus or one type of bus.

[0317] The communication interface is used for communication between the aforementioned electronic devices and other devices.

[0318] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0319] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0320] In another embodiment provided in this application, a computer-readable storage medium is also provided, which stores a computer program. When executed by a processor, the computer program implements the display method steps for drawing content described in any of the above embodiments.

[0321] In another embodiment provided in this application, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to perform the display method steps of the drawing content described in any of the above embodiments.

[0322] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), etc.

[0323] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0324] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the embodiments of apparatus, systems, electronic devices, computer-readable storage media, and computer program products are basically similar to the method embodiments, and therefore the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0325] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application are included within the scope of protection of this application.

Claims

1. A method for displaying drawn content, characterized in that, The method includes: Obtain a first virtual drawing point and a second drawing point, wherein the first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing line of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen; the second drawing point is a second number of drawing points of the adjacent splicing line of the second sub-screen; the first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen; and the splicing line is the splicing line between the first sub-screen and the second sub-screen. The drawing trajectory is obtained by fitting the trajectory based on the second drawing point and the first virtual drawing point; Based on the drawing trajectory, control the sub-screens in the splicing screen to display the drawn content; The step of fitting the trajectory based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory includes: Based on the second drawing point and the first virtual drawing point, a trajectory is fitted to determine the splicing point, wherein the splicing point is the intersection of the fitted trajectory corresponding to the second drawing point and the first virtual drawing point and the splicing line; The drawing trajectory is determined based on the splicing point and the second drawing point.

2. The method according to claim 1, characterized in that, The methods for obtaining the first drawing point include: Based on the splicing line between the first sub-screen and the second sub-screen, extend a region of target length in the direction of the first sub-screen, and determine the coordinate range of the region; From the drawing points of the first sub-screen, determine a first number of drawing points whose corresponding coordinates are located within the coordinate range, and use them as the first drawing points.

3. The method according to claim 1, characterized in that, Determining the drawing trajectory based on the splicing point and the second drawing point includes: The splicing points and the drawing points of the first sub-screen are fitted with trajectories to obtain the drawing trajectory of the first sub-screen; the splicing points and the drawing points of the second sub-screen are fitted with trajectories to obtain the drawing trajectory of the second sub-screen. Wherein, if the first number is less than the number of drawing points included in the first sub-screen, and the second number is less than the number of drawing points included in the second sub-screen, the drawing points of the first sub-screen include the first drawing point and other drawing points of the first sub-screen excluding the first drawing point; and the drawing points of the second sub-screen include the second drawing point and other drawing points of the second sub-screen excluding the second drawing point. Alternatively, if the first number is equal to the number of drawing points included in the first sub-screen, and the second number is equal to the number of drawing points included in the second sub-screen, the drawing point of the first sub-screen is the first drawing point, and the drawing point of the second sub-screen is the second drawing point. Based on the total trajectory obtained by trajectory fitting of the second drawing point and the first virtual drawing point, the first sub-trajectory corresponding to the splicing point and the first drawing point and the second sub-trajectory corresponding to the splicing point and the second drawing point are determined. Based on the first sub-trajectory, the drawing trajectory corresponding to the first sub-screen is determined, and based on the second sub-trajectory, the drawing trajectory corresponding to the second sub-screen is determined.

4. The method according to claim 3, characterized in that, The total trajectory is the first trajectory obtained by fitting the second drawing point and the first virtual drawing point together. The determination of the first sub-trajectory corresponding to the splicing point and the first drawing point, and the second sub-trajectory corresponding to the splicing point and the second drawing point, based on the total trajectory obtained by trajectory fitting based on the second drawing point and the first virtual drawing point, includes: Based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen, the first virtual drawing point and the part of the trajectory corresponding to the splicing point in the first trajectory are transformed to the coordinate system of the first sub-screen to obtain the first sub-trajectory; The second drawing point in the first trajectory and the part of the trajectory corresponding to the splicing point are determined as the second sub-trajectory; The steps of determining the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory and determining the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory include: If the first number is less than the number of drawing points included in the first sub-screen, and the second number is less than the number of drawing points included in the second sub-screen, then the trajectory formed by the other drawing points of the first sub-screen and the first sub-trajectory are used as the drawing trajectory of the first sub-screen; the trajectory formed by the other drawing points of the second sub-screen and the second sub-trajectory are used as the drawing trajectory of the second sub-screen; or... If the first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen, then the first sub-trajectory is determined as the drawing trajectory of the first sub-screen, and the second sub-trajectory is determined as the drawing trajectory of the second sub-screen.

5. The method according to claim 3, characterized in that, The first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen; the total trajectory includes a second trajectory obtained by fitting the second drawing points and the first virtual drawing points together. The determination of the first sub-trajectory corresponding to the splicing point and the first drawing point, and the second sub-trajectory corresponding to the splicing point and the second drawing point, based on the total trajectory obtained by trajectory fitting based on the second drawing point and the first virtual drawing point, includes: The second drawing point in the second trajectory and the part of the trajectory corresponding to the splicing point are determined as the second sub-trajectory; The first sub-trajectory is obtained by fitting the splicing point and the first drawing point together; or, if the total trajectory also includes a third trajectory obtained by fitting the first drawing point and the second virtual drawing point together, the portion of the trajectory corresponding to the splicing point and the first drawing point in the third trajectory is taken as the first sub-trajectory, and the second virtual drawing point is obtained by transforming the second drawing point to the coordinate system of the first sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The steps of determining the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory and determining the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory include: The first sub-trajectory is determined as the drawing trajectory of the first sub-screen; The second sub-trajectory is determined as the drawing trajectory of the second sub-screen.

6. The method according to any one of claims 1-5, characterized in that, The step of controlling the sub-screens in the splicing screen to display the drawn content according to the drawn trajectory includes: The drawing trajectory includes points to be displayed according to sequence information; target points to be displayed among these points are determined; for each target point to be displayed, based on the sequence information of already displayed target points, it is determined whether the target point to be displayed is continuous with other displayed target points; if continuous, the display of the target point to be displayed is triggered, and the sequence information of already displayed target points is updated; if not continuous, the target duration is waited for, and the determination of whether the target point to be displayed is continuous with other displayed target points is returned based on the sequence information of already displayed target points; wherein, the sequence information is determined based on the drawing order of each point to be displayed; or, Obtain rendering completion information for each sub-screen; if the rendering completion information indicates that each sub-screen has completed rendering of the points to be displayed, trigger the synchronous display of the drawn content, wherein the rendering completion information is used to indicate the rendering status of the points to be displayed corresponding to each sub-screen.

7. The method according to claim 6, characterized in that, Determining the target point to be displayed among the points to be displayed includes: The obtained point to be displayed is determined as the target point to be displayed; or, For each point to be displayed, the screen information corresponding to the point to be displayed is used to determine whether the point to be displayed and the previous point to be displayed belong to the same sub-screen. The screen information is used to identify the sub-screen that displays the point to be displayed. If the point to be displayed does not belong to the same sub-screen as the previous point to be displayed, then the point to be displayed is determined as the target point to be displayed; The method further includes: If the point to be displayed belongs to the same sub-screen as the previous point to be displayed, the display of the point to be displayed will be triggered.

8. The method according to any one of claims 1-5, characterized in that, After controlling the sub-screens in the splicing screen to display the drawn content according to the drawn trajectory, the method further includes: Upon receiving a screen switching command, the switched screen is displayed based on the screen switching command; Based on the relationship between the switched screen and the screen before the switch, the drawing trajectory after the switch is determined; According to the sequence information, obtain the points to be displayed in the switched drawing trajectory; determine the target points to be displayed among the points to be displayed; for each target point to be displayed, based on the sequence information of the already displayed target points to be displayed, determine whether the target point to be displayed is continuous with the already displayed target points to be displayed; if continuous, trigger the display of the target point to be displayed and update the sequence information of the already displayed target points to be displayed; if not continuous, wait for the target duration and return the determination of whether the target point to be displayed is continuous with the already displayed target points to be displayed based on the sequence information of the already displayed target points to be displayed; wherein, the sequence information is determined based on the drawing order of each point to be displayed; or, Obtain rendering completion information for each sub-screen; if the rendering completion information indicates that each sub-screen has completed rendering of the points to be displayed, trigger the synchronous display of the drawn content after switching, wherein the rendering completion information is used to indicate the rendering status of the points to be displayed after switching for each sub-screen.

9. A display device for drawing content, characterized in that, The device includes: The drawing point acquisition module is used to acquire a first virtual drawing point and a second drawing point. The first virtual drawing point is a virtual drawing point obtained by transforming a first number of first drawing points of the adjacent splicing line of the first sub-screen to the coordinate system of the second sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen. The second drawing point is a second number of drawing points of the adjacent splicing line of the second sub-screen. The first sub-screen and the second sub-screen are adjacent sub-screens in the splicing screen. The splicing line is the splicing line between the first sub-screen and the second sub-screen. The trajectory fitting module is used to perform trajectory fitting based on the second drawing point and the first virtual drawing point to obtain the drawing trajectory; The display control module is used to control the sub-screens in the splicing screen to display the drawn content according to the drawing trajectory; The trajectory fitting module includes: The splicing point determination submodule is used to perform trajectory fitting based on the second drawing point and the first virtual drawing point to determine the splicing point, wherein the splicing point is the intersection of the fitted trajectory corresponding to the second drawing point and the first virtual drawing point and the splicing line; The trajectory determination submodule is used to determine the drawing trajectory based on the splicing point and the second drawing point.

10. The apparatus according to claim 9, characterized in that, The methods for obtaining the first drawing point include: Based on the splicing line between the first sub-screen and the second sub-screen, extend a region of target length in the direction of the first sub-screen, and determine the coordinate range of the region; From the drawing points of the first sub-screen, determine a first number of drawing points whose corresponding coordinates are located within the coordinate range, and use them as the first drawing points; The trajectory determination submodule includes: A first determining unit is configured to perform trajectory fitting on the splicing point and the drawing point of the first sub-screen to obtain the drawing trajectory of the first sub-screen; and to perform trajectory fitting on the splicing point and the drawing point of the second sub-screen to obtain the drawing trajectory of the second sub-screen, wherein, when the first number is less than the number of drawing points included in the first sub-screen and the second number is less than the number of drawing points included in the second sub-screen, the drawing points of the first sub-screen include the first drawing point and other drawing points of the first sub-screen other than the first drawing point, and the drawing points of the second sub-screen include the second drawing point and other drawing points of the second sub-screen other than the second drawing point; or, when the first number is equal to the number of drawing points included in the first sub-screen and the second number is equal to the number of drawing points included in the second sub-screen, the drawing point of the first sub-screen is the first drawing point, and the drawing point of the second sub-screen is the second drawing point; or The second determining unit is used to determine the first sub-trajectory corresponding to the splicing point and the first drawing point and the second sub-trajectory corresponding to the splicing point and the second drawing point based on the total trajectory obtained by trajectory fitting based on the second drawing point and the first virtual drawing point, and to determine the drawing trajectory corresponding to the first sub-screen based on the first sub-trajectory and the drawing trajectory corresponding to the second sub-screen based on the second sub-trajectory. The total trajectory is the first trajectory obtained by fitting the second drawing point and the first virtual drawing point together. The second determining unit is specifically configured to, based on the coordinate system transformation relationship between the first sub-screen and the second sub-screen, transform the first virtual drawing point and the portion of the trajectory corresponding to the splicing point in the first trajectory to the coordinate system of the first sub-screen to obtain a first sub-trajectory; determine the second drawing point and the portion of the trajectory corresponding to the splicing point in the first trajectory as a second sub-trajectory; if the first quantity is less than the number of drawing points included in the first sub-screen, and the second quantity is less than the number of drawing points included in the second sub-screen, then the trajectory formed by the other drawing points of the first sub-screen and the first sub-trajectory are used as the drawing trajectory of the first sub-screen; the trajectory formed by the other drawing points of the second sub-screen and the second sub-trajectory are used as the drawing trajectory of the second sub-screen; or, if the first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen, then the first sub-trajectory is determined as the drawing trajectory of the first sub-screen, and the second sub-trajectory is determined as the drawing trajectory of the second sub-screen; The first quantity is the number of drawing points included in the first sub-screen, and the second quantity is the number of drawing points included in the second sub-screen; the total trajectory includes a second trajectory obtained by fitting the second drawing points and the first virtual drawing points together. The second determining unit is specifically used to determine the second drawing point and the portion of the trajectory corresponding to the splicing point in the second trajectory as a second sub-trajectory; to perform trajectory fitting between the splicing point and the first drawing point to obtain a first sub-trajectory; or, if the total trajectory also includes a third trajectory obtained by fitting the trajectory of the first drawing point and the second virtual drawing point, to take the portion of the trajectory corresponding to the splicing point and the first drawing point in the third trajectory as the first sub-trajectory, wherein the second virtual drawing point is obtained by transforming the second drawing point to the coordinate system of the first sub-screen according to the coordinate system transformation relationship between the first sub-screen and the second sub-screen; to determine the first sub-trajectory as the drawing trajectory of the first sub-screen; and to determine the second sub-trajectory as the drawing trajectory of the second sub-screen. The display control module includes a sequential display control submodule and a synchronous display control submodule; The sequential display control submodule includes: The point-to-be-displayed acquisition unit is used to acquire the points to be-displayed included in the drawing trajectory according to the sequence information; wherein, the sequence information is determined based on the drawing order of each point to be-displayed. A target point to be displayed determination unit is used to determine the target point to be displayed among the points to be displayed; The judgment unit is used to determine whether the target to be displayed is continuous with the already displayed target to be displayed points based on the sequence information of the already displayed target to be displayed points when a target to be displayed point is acquired; The display trigger unit is used to trigger the display of the target point to be displayed when the judgment result of the judgment unit is yes, and to update the sequence information of the already displayed target point to be displayed; A waiting unit is used to trigger the judgment unit after waiting for a target duration if the judgment result of the judgment unit is negative. The synchronous display control submodule is used to obtain the rendering completion information of each sub-screen; when the rendering completion information indicates that each sub-screen has completed rendering of the points to be displayed, the synchronous display of the drawn content is triggered, wherein the rendering completion information is used to indicate the rendering status of the points to be displayed corresponding to each sub-screen. The target display point determination unit is specifically used to determine the acquired display point as the target display point; or, for each acquired display point, based on the screen information corresponding to the display point, to determine whether the display point and the previous display point belong to the same sub-screen; if the display point and the previous display point do not belong to the same sub-screen, then the display point is determined as the target display point; wherein, the screen information is used to identify the sub-screen displaying the display point; The display triggering unit is further configured to trigger the display of the target display point when the target display point determination unit determines that the display point and the previous display point belong to the same sub-screen; The device further includes: The screen switching module is used to display the switched screen based on the screen switching command when a screen switching command is received; The trajectory update module is used to determine the drawing trajectory after the switch based on the relationship between the switched screen and the screen before the switch. The sequential display control submodule is further configured to: acquire the points to be displayed included in the switched drawing trajectory according to the sequence information; determine the target points to be displayed among the points to be displayed; for each target point to be displayed acquired, determine whether the target point to be displayed is continuous with the already displayed target points based on the sequence information of the already displayed target points; if continuous, trigger the display of the target point to be displayed and update the sequence information of the already displayed target points; if not continuous, wait for the target duration and return the determination of whether the target point to be displayed is continuous with the already displayed target points based on the sequence information of the already displayed target points; wherein, the sequence information is determined based on the drawing order of each point to be displayed. The synchronous display control submodule is also used to obtain rendering completion information for each sub-screen; when the rendering completion information indicates that each sub-screen has completed rendering of the points to be displayed, the synchronous display of the drawing content after switching is triggered, wherein the rendering completion information is used to indicate the rendering status of the points to be displayed after switching for each sub-screen.

11. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor, when executing a program stored in memory, implements the method described in any one of claims 1-8.

Images