Data display method for special-shaped display medium and related product

Abstract

The invention is suitable for the technical field of display, and provides a data display method for a special-shaped display medium and a related product. The data display method for the special-shaped display medium comprises the steps that a real-scene image is displayed, and the real-scene image comprises a first output grid matched with the special-shaped display medium; in response to a first operation of a user on the first control, displaying a first interface; the first interface is used for indicating that the second output grid is matched with the first output grid, and the second output grid is a grid corresponding to an output channel for displaying data; and in response to a second operation of the user, displaying the display data on the special-shaped display medium according to the position of the second output grid. According to the embodiment of the invention, the display data can be quickly matched with the special-shaped display medium.

Description

Technical Field

[0001] This application belongs to the field of display technology, and in particular relates to a data display method and related products for irregularly shaped display media. Background Technology

[0002] When displaying images on irregularly shaped display media (such as spherical screens or curved wall projections), the geometry of the display data is typically adjusted to fit the shape of the display medium to avoid significant distortion. However, this adjustment process requires repeatedly adjusting the positions of various anchor points in the grid according to the shape of the irregular display medium. The grid can refer to a UV grid, which is used to accurately project a planar, two-dimensional image (i.e., display data) onto a complex three-dimensional model surface. Anchor points in the grid control its deformation. However, repeatedly adjusting the positions of each anchor point is tedious and time-consuming, especially for complex irregularly shaped display media where anchor points are prone to deviating from their accurate positions. Each anchor point needs repeated adjustments when displaying different display data, making it difficult to quickly adapt the display data to irregularly shaped display media. Summary of the Invention

[0003] This application provides a data display method and related products for irregularly shaped display media, which can enable display data to be quickly adapted to irregularly shaped display media.

[0004] A first aspect of this application provides a data display method for an irregularly shaped display medium, comprising: displaying a real-scene image, the real-scene image including a first output grid that matches the irregularly shaped display medium; displaying a first interface in response to a first operation by a user on a first control; the first interface being used to indicate that a second output grid matches the first output grid, the second output grid being a grid corresponding to an output channel for display data; and displaying the display data on the irregularly shaped display medium according to the position of the second output grid in response to a second operation by the user.

[0005] In some embodiments of this application, before displaying the real-scene image, the data display method for the irregularly shaped display medium further includes: displaying an initial grid, the initial grid being generated based on grid attribute information; and, in response to a third operation by the user, adjusting the initial grid according to the shape of the irregularly shaped display medium to obtain the first output grid, the first output grid being displayed on the irregularly shaped display medium.

[0006] In some embodiments of this application, the grid attribute information includes the number of grids; the number of grids is determined based on at least one of the following: the resolution of the irregular display medium, the shape of the irregular display medium, the total number of projection devices or display control devices, and the number of output channels of the projection devices or the display control devices; wherein, the projection device is used to project the display data onto the irregular display medium, and the display control device is used to control the irregular display medium to display.

[0007] In some embodiments of this application, the step of adjusting the initial grid according to the shape of the irregular display medium in response to a third user operation to obtain the first output grid includes: adjusting the position of the first grid point of the initial grid in response to a user's drag operation on the second control on the initial grid until the adjusted grid matches the shape of the irregular display medium to obtain the first output grid.

[0008] In some embodiments of this application, the grid attribute information further includes a grid adjustment mode; if the grid adjustment mode is a straight line mode, then in response to the drag operation, when adjusting the position of the first grid point of the initial grid, the second grid point and the adjusted first grid point are located on the same straight line, and the second grid point is a grid point located on the same straight line as the first grid point before adjustment; if the grid adjustment mode is a curve mode, then in response to the drag operation, when adjusting the position of the first grid point of the initial grid, the third grid point and the adjusted first grid point are connected by a straight line or a curve, and the third grid point is a grid point connected to the first grid point before adjustment.

[0009] In some embodiments of this application, the step of displaying the first interface in response to a user's first operation on the first control includes: displaying the second output grid; and adjusting the position of the fourth grid point of the initial grid in response to a user's operation on the first control on the second output grid until the adjusted second output grid matches the first output grid in the real-world image, thereby obtaining and displaying the first interface.

[0010] In some embodiments of this application, the real-scene image is captured at the observation position of the irregularly shaped display medium, and the shooting method and / or shooting angle of the real-scene image are related to the positional relationship between the observation position and the irregularly shaped display medium.

[0011] A second aspect of this application provides a data display device for an irregularly shaped display medium, comprising: an image display unit for displaying a real-scene image, the real-scene image including a first output grid that matches the irregularly shaped display medium; an interface display unit for displaying a first interface in response to a first operation by a user on a first control; the first interface for indicating that a second output grid matches the first output grid, the second output grid being a grid corresponding to an output channel for displaying data; and a data display unit for displaying the display data on the irregularly shaped display medium according to the position of the second output grid in response to a second operation by the user.

[0012] A third aspect of this application provides an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the data display method for irregularly shaped display media as described in any of the first aspects.

[0013] A fourth aspect of this application provides a display system, comprising: an irregularly shaped display medium; an electronic device as described in the third aspect; a projection device or a display control device, wherein the projection device is connected to the electronic device and is used to project the display data onto the irregularly shaped display medium according to the position of the second output grid; the display control device is connected to the electronic device and is used to control the irregularly shaped display medium to display the display data according to the position of the second output grid.

[0014] A fifth aspect of this application provides a computer program product, including a computer program that, when run, causes a data display method for an irregularly shaped display medium as described in any of the first aspects to be executed.

[0015] In the embodiments of this application, by displaying a real-world image including a first output grid that matches the irregularly shaped display medium, in response to a user's first operation on a first control, a first interface is displayed with a second output grid matching the first output grid, and in response to a user's second operation, display data is displayed on the irregularly shaped display medium according to the position of the second output grid, wherein the second output grid is the grid corresponding to the output channel of the display data. Thus, the second output grid can be adjusted according to the situation of the first output grid on the irregularly shaped display medium, which helps to quickly adjust each grid point corresponding to the output channel of the display data to the accurate position. Especially in scenarios where different display data are displayed, it can significantly reduce repeated debugging operations and enable the display data to quickly adapt to the irregularly shaped display medium. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a schematic diagram illustrating how related technologies adjust the geometry of the image;

[0018] Figure 2 This is a schematic diagram illustrating the implementation process of a data display method for irregularly shaped display media provided in an embodiment of this application;

[0019] Figure 3 This is a schematic diagram of the real-scene image provided in the embodiments of this application;

[0020] Figure 4 This is a schematic diagram illustrating the specific implementation process of obtaining the first output mesh provided in an embodiment of this application;

[0021] Figure 5 This is a schematic diagram illustrating the adjustment of the initial mesh according to an embodiment of this application;

[0022] Figure 6 This is a schematic diagram illustrating the effect of applying the data display method provided in this application on a spherical display medium, as provided in an embodiment of this application.

[0023] Figure 7 This is a schematic diagram of the transformed display data provided in an embodiment of this application;

[0024] Figure 8 This is a schematic diagram of a data display device for irregularly shaped display media provided in an embodiment of this application;

[0025] Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0026] Figure 10 This is a schematic diagram of the structure of the first display system provided in the embodiments of this application;

[0027] Figure 11 This is a schematic diagram of the structure of the second display system provided in the embodiments of this application. Detailed Implementation

[0028] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are protected by this application.

[0029] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0030] In the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0031] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0032] When displaying images on irregularly shaped display media (such as spherical screens or curved wall projections), the geometry of the displayed data is usually adjusted to fit the shape of the irregular display media in order to avoid significant image distortion. Please refer to [reference needed]. Figure 1 , Figure 1 This illustrates the process of adjusting display data on a spherical screen using related technologies. These technologies adjust the positions of each anchor point in the display data's grid according to the shape of the irregularly shaped display medium, stretching or compressing the display data's geometry to match the irregularly shaped medium. However, this anchor-point-by-anchor-point adjustment method is cumbersome and time-consuming, especially for complex irregularly shaped display media, where anchor points are prone to deviating from their accurate positions. When displaying different display data, each anchor point requires repeated adjustments, making it difficult to quickly adapt the display data to the irregularly shaped display medium.

[0033] In view of this, this application proposes a data display method for irregularly shaped display media, which can adjust the second output grid according to the first output grid on the irregularly shaped display media. This helps to quickly adjust each grid point corresponding to the output channel of the display data to the accurate position. Especially in the scenario of displaying different display data, it can significantly reduce repeated debugging operations and enable the display data to quickly adapt to the irregularly shaped display media.

[0034] To illustrate the technical solution of this application, specific embodiments are described below.

[0035] Figure 2 The illustration shows a schematic flowchart of a data display method for irregularly shaped display media provided in an embodiment of this application. This method can be applied to electronic devices.

[0036] Specifically, the above display control method may include the following steps S201 to S203.

[0037] Step S201: Display the real-world image.

[0038] Among them, irregularly shaped display media refers to display screens or display carriers with irregular shapes. Such irregularly shaped display media can be LED displays, projection screens, etc., and this application does not limit this.

[0039] A real-world image is an image captured on an irregularly shaped display medium. The real-world image includes a first output grid that matches the irregularly shaped display medium. The first output grid can refer to a UV grid, where UV stands for Texture Coordinates, used to define how a two-dimensional image (i.e., texture) is mapped onto the surface of a three-dimensional model. "U" and "V" represent two coordinate axes in two-dimensional space. Matching the shape of the first output grid to the irregularly shaped display medium means that the shape of the first output grid is consistent with the shape of the irregularly shaped display medium. The first output grid can be displayed on the irregularly shaped display medium, and thus, the real-world image captured on the irregularly shaped display medium can include the first output grid displayed on the irregularly shaped display medium.

[0040] It should be noted that the number of first output grids can be set according to actual needs. When there are multiple first output grids, the shape formed by the superposition of these multiple first output grids matches the irregularly shaped display medium, for example... Figure 3 The diagram shows the case of two first output grids, with the shape formed by the superposition of the left and right first output grids matching the shape of the CAVE box (irregular display medium).

[0041] Step S202: In response to the user's first operation on the first control, the first interface is displayed.

[0042] The first control can be used to control the adjustment of the second output grid, which may include, but is not limited to, anchor points on the second output grid for adjusting grid points, and line markers on the second output grid for adjusting grid point connecting lines.

[0043] The second output grid corresponds to the output channel of the display data and is used to indicate the image changes of the displayed data. Display data refers to the data that needs to be displayed on an irregularly shaped display medium, and can refer to non-panoramic video (i.e., video that has not been distorted according to the display model).

[0044] The first operation can be a single operation or a combination of multiple operations. The first operation is used to adjust the second output grid so that the first interface is displayed. The first interface can be used to indicate that the second output grid matches the first output grid. That is, the electronic device can adjust the second output grid based on the first operation, and the interface displayed when the second output grid matches the first output grid is the first interface. Here, "the second output grid matches the first output grid" can mean that the second output grid is aligned with the first output grid, or that the deviation in shape and position is within a preset range.

[0045] In step S203, in response to the user's second operation, the display data is displayed on the irregular display medium according to the position of the second output grid.

[0046] Similarly, the second operation can be a single operation or a combination of multiple operations.

[0047] In embodiments of this application, the second operation can be used to display display data on an irregularly shaped display medium according to the position of the second output grid. Since the first output grid in the real-world image can characterize the shape of the irregularly shaped display medium, and the second output grid matches the first output grid, display control according to the position of the second output grid can cause the display data to change according to the position of the second output grid. Thus, the visual effect of the display data on the irregularly shaped display medium can be adapted to the shape of the irregularly shaped display medium.

[0048] In some specific implementations, the geometric shape of the displayed data is consistent before and after the transformation according to the position of the second output grid. Thus, while the geometric shape of the image remains unchanged, the image of the displayed data can be distorted according to the shape of the irregular display medium, and the visual effect of the image displayed on the irregular display medium can be adapted to the irregular display medium.

[0049] In the embodiments of this application, by displaying a real-world image including a first output grid that matches the irregularly shaped display medium, in response to a user's first operation on a first control, a first interface is displayed with a second output grid matching the first output grid, and in response to a user's second operation, display data is displayed on the irregularly shaped display medium according to the position of the second output grid, wherein the second output grid is the grid corresponding to the output channel of the display data. Thus, the second output grid can be adjusted according to the situation of the first output grid on the irregularly shaped display medium, which helps to quickly adjust each grid point corresponding to the output channel of the display data to the accurate position. Especially in scenarios where different display data are displayed, it can significantly reduce repeated debugging operations and enable the display data to quickly adapt to the irregularly shaped display medium.

[0050] In some embodiments of this application, such as Figure 4 As shown, before displaying the real-scene image, the data display method for the irregularly shaped display medium may further include steps S401 and S402.

[0051] Step S401: Display the initial grid.

[0052] The initial mesh is generated based on mesh attribute information. Mesh attribute information represents the properties the mesh must satisfy, including but not limited to the number of meshes, mesh size, and mesh adjustment mode. The number of meshes refers to the total number of output meshes. The mesh size refers to the size of the output meshes. The mesh adjustment mode represents how the mesh lines change when adjusting the mesh, and can include straight line mode and curved line mode.

[0053] In some embodiments of this application, the aforementioned grid attribute information can be determined based on information from irregularly shaped display media.

[0054] Specifically, in some embodiments of this application, the grid attribute information may include the number of grids; the number of grids is determined based on at least one of the following: the resolution of the irregular display medium, the shape of the irregular display medium, the total number of projection devices or display control devices, and the number of output channels of the projection devices or display control devices.

[0055] The projection device is used to project display data onto an irregularly shaped display medium. When the irregularly shaped display medium is a projection screen, it does not have the ability to emit light and needs to be projected onto the irregularly shaped display medium by the projection device for display.

[0056] The display control device is used to control irregularly shaped display media for display. When the irregularly shaped display media is a display module / screen, the irregularly shaped display media has the ability to emit light, and the display control device can control the irregularly shaped display media to display display data.

[0057] In some embodiments of this application, there is a one-to-one correspondence between the output grid and the output channel. An output channel refers to the path through which display data is output to the irregularly shaped display medium. A projection device or display control device may include one or more output channels, and different output channels of the same projection device or display control device are used to output different parts of the display data. The display data of the output channels can be displayed according to the position of the corresponding output grid.

[0058] The resolution and shape of irregularly shaped display media determine the required number of projection devices / display control devices, and / or the required number of output channels. A single output channel of a single projection device / display control device can only handle a limited resolution, and the actual display area it covers is also limited. Higher resolution and more complex shapes require more projection devices / display control devices, and / or more output channels, to meet the display needs of irregularly shaped display media. The total number of projection devices / display control devices and the number of output channels determine the actual total number of output channels. Based on one or more of the resolution, shape, total number of projection devices or display control devices, and number of output channels of the projection devices or display control devices, the actual number of output channels can be determined so that an output grid matching the number of output channels can be set up.

[0059] In some embodiments of this application, the grid size can be determined based on the size and shape of the irregularly shaped display medium. For example... Figure 3 In this case, the irregularly shaped display medium is a CAVE box, which means that there are 2 output channels, and the grid size is the same as the size of the CAVE box.

[0060] In some embodiments of this application, an initial mesh can be generated based on mesh attribute information, ensuring that the initial mesh meets the requirements for the number of meshes and mesh size specified in the mesh attribute information. The initial mesh can be a rectangular mesh. Displaying the generated initial mesh allows users to easily adjust its shape to obtain the first output mesh.

[0061] In step S402, in response to the user's third operation, the initial grid is adjusted according to the shape of the irregular display medium to obtain the first output grid.

[0062] The third operation can be used to adjust the initial mesh.

[0063] In some embodiments of this application, since the shape of the initial grid may differ from the shape of the irregularly shaped display medium, the initial grid can be adjusted according to the shape of the irregularly shaped display medium through a third user operation. This allows the adjusted first output grid to match the shape of the irregularly shaped display medium, thus enabling the adjusted first output grid to be displayed on the irregularly shaped display medium. When the first output grid is displayed on the irregularly shaped display medium, it can cover the irregularly shaped display medium and reflect its actual shape.

[0064] Specifically, in response to a third user operation, adjusting the initial grid according to the shape of the irregular display medium to obtain a first output grid may include: in response to a user dragging operation on a second control on the initial grid, adjusting the position of the first grid point of the initial grid until the adjusted grid matches the shape of the irregular display medium to obtain the first output grid.

[0065] The second control can be used to adjust the first grid point, and can serve as an anchor point for adjusting the first grid point. The first grid point can be any one or more grid points on the initial grid. Users can add geometry adjustment layers in the geometry adjustment properties interface, each corresponding to an initial grid. Then, they can drag the first grid point on the initial grid horizontally and vertically once or multiple times, adjusting the position of the dragged first grid point according to the step size of the drag operation. The step size of each drag operation can be determined based on the area of ​​the irregularly shaped display medium. The final adjusted grid matches the shape of the irregularly shaped display medium, resulting in the first output grid, which perfectly fills the irregularly shaped display medium.

[0066] In some embodiments of this application, if the grid adjustment mode is a straight line mode, then in response to a drag operation, when the position of the first grid point of the initial grid is adjusted, the second grid point and the adjusted first grid point are located on the same straight line. Here, the second grid point is a grid point that is on the same straight line as the first grid point before adjustment. For example... Figure 5 In the first grid point 51 and the second grid point 52 are on the same straight line. After adjustment, the first grid point 51 and the second grid point 52 are still on the same straight line.

[0067] In other embodiments of this application, if the grid adjustment mode is a curve mode, then in response to a drag operation, when adjusting the position of the first grid point of the initial grid, the third grid point is connected to the adjusted first grid point by a straight line or a curve. The third grid point is the grid point connected to the first grid point before adjustment. Specifically, when adjusting the first grid point, the grid points between each grid point in the local area where the first grid point is located change to straight lines or curves as the adjustment is performed.

[0068] Curve mode can be applied when there are curved surfaces on irregularly shaped display media, while straight mode can be applied when each surface of the irregularly shaped display media is flat. This allows the resulting first output mesh to adapt to the surface texture of the irregularly shaped display media.

[0069] In some embodiments of this application, before displaying the real-scene image, the method may further include: controlling an image acquisition device to take a picture of the irregularly shaped display medium to obtain the real-scene image.

[0070] Specifically, the real-scene image can be captured from the observation position of the irregularly shaped display medium. The observation position refers to the user's location when viewing the irregularly shaped display medium, and can refer to the optimal observation position. By placing the image acquisition device at the observation position, a real-scene image can be obtained by capturing images of the irregularly shaped display medium from that position.

[0071] Among them, the shooting method and / or shooting angle of the real scene image can be related to the positional relationship between the observation position and the irregular display medium.

[0072] Specifically, when the observation position is located within the smallest outer cube of the irregularly shaped display medium, a panoramic image shooting mode can be used to capture panoramic images from 180° to 360° to obtain real-scene images.

[0073] When the observation position is outside the smallest outer cube of the irregular display medium, and the field of view of the image acquisition device covers the entire irregular display medium, it means that the image acquisition device can capture the complete irregular display medium in one imaging at a fixed angle. Ordinary image shooting mode can be used to take pictures and obtain real-scene images.

[0074] When the observation position is outside the smallest outer cube of the irregular display medium, and the field of view of the image acquisition device cannot cover the entire irregular display medium, a panoramic image shooting mode can be used to shoot a 180° panoramic image to obtain a real-scene image.

[0075] In some other embodiments of this application, before displaying the real-scene image, the process may further include: after the first output grid in the real-time imaging screen of the image acquisition device is fully matched with the irregularly shaped display medium, triggering the image acquisition device to take a picture to obtain the real-scene image. The position of the image acquisition device can be fixed or movable; when the position of the image acquisition device is movable, it can be automatically adjusted based on the observation position.

[0076] In some embodiments of this application, displaying a first interface in response to a user's first operation on a first control may include: displaying a second output grid; and adjusting the position of a fourth grid point of an initial grid in response to a user's operation on a first control on the second output grid until the adjusted second output grid matches the first output grid in the real-world image, thereby obtaining and displaying the first interface.

[0077] The second output grid before position adjustment can be generated according to the geometry of the displayed data. For example, for regular display data, since the image is rectangular, the second output grid can be rectangular.

[0078] Specifically, a real-world image can be imported into the software interface of an electronic device, and a second output grid can be displayed. At this point, the first and second output grids do not match. Based on the user's operation of the first control, the position of a fourth grid point on the second output grid can be adjusted so that the adjusted second output grid matches the first output grid displayed in the real-world image. The fourth grid point can be any one or more grids on the second output grid. The interface when the second output grid matches the first output grid is the first interface.

[0079] As an example, such as Figure 6 As shown, the real-scene image includes a first output grid on a spherical display medium. The real-scene image is imported into the 3D editing area, and the position of the fourth grid point on the second output grid (shown in blue) is adjusted so that the adjusted second output grid is aligned with the first output grid displayed on the real-scene image. The resulting interface is the first interface.

[0080] In this way, the output grid for displaying data can be matched with the shape of irregularly shaped display media.

[0081] For the displayed data, the geometric shape of the image remains consistent before and after adjustment, but the image displaying the data can be transformed according to the position of the second output grid. Specifically, the image within each sub-grid of the second output grid can be distorted according to the adjusted position of the second output grid to adapt to the shape of the irregularly shaped display medium. For example... Figure 7 The middle presents according to Figure 3 After the real-world image is adjusted using the second output grid, the display data is transformed based on the second output grid. As you can see, the display data retains the rectangular shape, but the image is distorted according to the position of the adjusted second output grid, so that the actual visual effect presented when the image is displayed on an irregularly shaped display medium can be adapted to the irregularly shaped display medium.

[0082] Figure 6 The document also illustrates the method provided in the embodiments of this application, in... Figure 6The image shown is the actual display effect of projecting the adjusted display data onto a spherical display medium. This method of preserving the geometry of the image avoids excessive stretching or compression, helping to maintain the viewability of the image.

[0083] Furthermore, in the embodiments of this application, when the real-scene image is obtained from the observation position, the first output grid in the real-scene image obtained from the observation position can be used as a reference to adjust the second output grid so that the shape of the second output grid matches the shape of the irregular display medium observed from the observation position. This helps to quickly adjust each grid point to the accurate position, reduce repeated debugging operations, enable the display data to quickly adapt to the irregular display medium, and improve the display effect.

[0084] Furthermore, when multiple outputs exist (i.e., multiple output channels), the second output grids corresponding to all display output channels can be displayed. Within the same interface, the positions of the fourth grid points of multiple second output grids can be adjusted so that the superimposed adjusted second output grids match the first output grid displayed on the real-world image. Completing the adjustment of multiple outputs within the same interface improves the operational efficiency when adjusting grids.

[0085] It should be noted that, for the sake of simplicity, the aforementioned method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, because according to this application, some steps can be performed in other orders.

[0086] like Figure 8 The diagram shown is a structural schematic of a data display device 800 for irregularly shaped display media provided in an embodiment of this application. The data display device 800 for irregularly shaped display media is disposed on an electronic device.

[0087] Specifically, the data display device 800 for irregularly shaped display media may include:

[0088] An image display unit 801 is used to display a real-scene image, the real-scene image including a first output grid that matches the irregularly shaped display medium;

[0089] The interface display unit 802 is used to display a first interface in response to a user's first operation on the first control; the first interface is used to indicate that the second output grid matches the first output grid, and the second output grid is the grid corresponding to the output channel of the display data;

[0090] The data display unit 803 is used to display the display data on the irregular display medium according to the position of the second output grid in response to the second operation of the user.

[0091] In some embodiments of this application, the data display device 800 for the irregularly shaped display medium further includes a grid processing unit for: displaying an initial grid, the initial grid being generated based on grid attribute information; and, in response to a third operation by a user, adjusting the initial grid according to the shape of the irregularly shaped display medium to obtain the first output grid, the first output grid being displayed on the irregularly shaped display medium.

[0092] In some embodiments of this application, the grid attribute information includes the number of grids; the number of grids is determined based on at least one of the following: the resolution of the irregular display medium, the shape of the irregular display medium, the total number of projection devices or display control devices, and the number of output channels of the projection devices or the display control devices; wherein, the projection device is used to project the display data onto the irregular display medium, and the display control device is used to control the irregular display medium to display.

[0093] In some embodiments of this application, the above-mentioned grid processing unit is further configured to: adjust the position of the first grid point of the initial grid in response to the user's drag operation on the second control on the initial grid, until the adjusted grid matches the shape of the irregular display medium, thereby obtaining the first output grid.

[0094] In some embodiments of this application, the grid attribute information further includes a grid adjustment mode; if the grid adjustment mode is a straight line mode, then in response to the drag operation, when the position of the first grid point of the initial grid is adjusted, the second grid point and the adjusted first grid point are located on the same straight line, and the second grid point is a grid point located on the same straight line as the first grid point before adjustment; if the grid adjustment mode is a curve mode, then in response to the drag operation, when the position of the first grid point of the initial grid is adjusted, the third grid point and the adjusted first grid point are connected by a straight line or a curve, and the third grid point is a grid point connected to the first grid point before adjustment.

[0095] In some embodiments of this application, the interface display unit 802 is specifically used to: display the second output grid; and, in response to the user's operation on the first control on the second output grid, adjust the position of the fourth grid point of the initial grid until the adjusted second output grid matches the first output grid in the real scene image, thereby obtaining and displaying the first interface.

[0096] In some embodiments of this application, the real-scene image is taken at the observation position of the irregularly shaped display medium, and the shooting method and / or shooting angle of the real-scene image are related to the positional relationship between the observation position and the irregularly shaped display medium.

[0097] It should be noted that, for the sake of convenience and brevity, the specific working process of the data display device 800 for irregularly shaped display media described above can be found in the following reference: Figures 2 to 7 The corresponding process of the method will not be described in detail here.

[0098] like Figure 9 The diagram shown is a schematic of an electronic device provided in an embodiment of this application. Specifically, the electronic device 9 may include: a processor 90, a memory 91, and a computer program 92 stored in the memory 91 and executable on the processor 90, such as a data display program for irregularly shaped display media. When the processor 90 executes the computer program 92, it implements the steps in the various embodiments of the data display method for irregularly shaped display media described above, for example... Figure 2 Steps S201 to S203 are shown. Alternatively, when the processor 90 executes the computer program 92, it implements the functions of each module / unit in the above-described device embodiments, for example... Figure 8 The functions of the image display unit 801, interface display unit 802, and data display unit 803 shown are illustrated.

[0099] The computer program can be divided into one or more modules / units, which are stored in the memory 91 and executed by the processor 90 to complete this application. The one or more modules / units can be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the electronic device.

[0100] For example, the computer program can be divided into: an image display unit, an interface display unit, and a data display unit. The specific functions of each unit are as follows: the image display unit is used to display a real-scene image, the real-scene image including a first output grid that matches the irregularly shaped display medium; the interface display unit is used to display a first interface in response to a user's first operation on a first control; the first interface is used to indicate that a second output grid matches the first output grid, the second output grid being the grid corresponding to the output channel of the displayed data; the data display unit is used to display the displayed data on the irregularly shaped display medium according to the position of the second output grid in response to a second operation by the user.

[0101] The electronic device may include, but is not limited to, a processor 90 and a memory 91. Those skilled in the art will understand that... Figure 9 This is merely an example of an electronic device and does not constitute a limitation on the electronic device. It may include more or fewer components than illustrated, or combine certain components, or different components. For example, the electronic device may also include input / output devices, network access devices, buses, etc.

[0102] The processor 90 referred to can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0103] The memory 91 can be an internal storage unit of the electronic device, such as a hard drive or memory. The memory 91 can also be an external storage device of the electronic device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, the memory 91 can include both internal and external storage units. The memory 91 is used to store the computer program and other programs and data required by the electronic device. The memory 91 can also be used to temporarily store data that has been output or will be output.

[0104] It should be noted that, for the sake of convenience and brevity, the structure of the above-mentioned electronic device can also be referred to the specific description of the structure in the method embodiment, which will not be repeated here.

[0105] Figure 10 and Figure 11 Two display systems provided in this application are shown.

[0106] Figure 10 The display system shown includes:

[0107] Irregularly shaped display medium 10;

[0108] Electronic devices 11;

[0109] Projection device 12, which is connected to electronic device 11, is used to project display data onto irregular display medium 10 according to the position of the second output grid.

[0110] Figure 11 The display system shown includes:

[0111] Irregularly shaped display medium 10;

[0112] Electronic devices 11;

[0113] Display control device 13 is connected to electronic device 11 and is used to control irregular display medium 10 to display display data according to the position of the second output grid.

[0114] The electronic device 11 can be used to perform the steps of the aforementioned data display method for irregularly shaped display media to obtain the position of the second output grid.

[0115] Figure 10 and Figure 11 The difference between the two display systems is: Figure 10 The projection device 12 is used, which is suitable for situations where the irregularly shaped display medium 10 is a projection screen. Figure 11 The display control device 13 is used in cases where the irregularly shaped display medium 10 is a display module / screen.

[0116] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0117] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0118] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for various specific applications, but such implementations should not be considered beyond the scope of this application.

[0119] In the embodiments provided in this application, it should be understood that the disclosed apparatus / device can be implemented in other ways. For example, the apparatus / device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0120] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0121] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0122] If the integrated module / unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electrical carrier signals and telecommunication signals.

[0123] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A data display method for irregularly shaped display media, characterized in that, include: Displaying a real-world image, the real-world image including a first output grid that matches the irregularly shaped display medium; The first interface is displayed in response to the user's first action on the first control; The first interface is used to indicate that the second output grid matches the first output grid, and the second output grid is the grid corresponding to the output channel for displaying data; In response to the user's second operation, the display data is displayed on the irregular display medium according to the position of the second output grid.

2. The data display method for irregularly shaped display media as described in claim 1, characterized in that, Before displaying the real-scene image, the data display method for the irregularly shaped display medium further includes: Display the initial grid, which is generated based on grid attribute information; In response to a third user action, the initial grid is adjusted to fit the shape of the irregular display medium to obtain the first output grid, which is then displayed on the irregular display medium.

3. The data display method for irregularly shaped display media as described in claim 2, characterized in that, The grid attribute information includes the number of grids; The number of grids is determined based on at least one of the following: the resolution of the irregular display medium, the shape of the irregular display medium, the total number of projection devices or display control devices, and the number of output channels of the projection devices or display control devices; wherein the projection device is used to project the display data onto the irregular display medium, and the display control device is used to control the irregular display medium to display.

4. The data display method for irregularly shaped display media as described in claim 2, characterized in that, The step of adjusting the initial grid according to the shape of the irregular display medium in response to a third user operation to obtain the first output grid includes: In response to the user's drag operation on the second control on the initial grid, the position of the first grid point of the initial grid is adjusted until the adjusted grid matches the shape of the irregular display medium, thus obtaining the first output grid.

5. The data display method for irregularly shaped display media as described in claim 4, characterized in that, The grid attribute information also includes the grid adjustment mode; If the grid adjustment mode is a straight line mode, then in response to the drag operation, when the position of the first grid point of the initial grid is adjusted, the second grid point and the adjusted first grid point are located on the same straight line. The second grid point is a grid point that is on the same straight line as the first grid point before adjustment. If the grid adjustment mode is curve mode, then in response to the drag operation, when the position of the first grid point of the initial grid is adjusted, the third grid point is connected to the adjusted first grid point by a straight line or curve, and the third grid point is the grid point connected to the first grid point before adjustment.

6. The data display method for irregularly shaped display media as described in any one of claims 1-5, characterized in that, The step of displaying the first interface in response to a user's first operation on the first control includes: Display the second output grid; In response to the user's operation on the first control on the second output grid, the position of the fourth grid point of the initial grid is adjusted until the adjusted second output grid matches the first output grid in the real scene image, and the first interface is obtained and displayed.

7. The data display method for irregularly shaped display media as described in any one of claims 1-5, characterized in that, The real-scene image is taken at the observation position of the irregularly shaped display medium, and the shooting method and / or shooting angle of the real-scene image are related to the positional relationship between the observation position and the irregularly shaped display medium.

8. A data display device for irregularly shaped display media, characterized in that, include: An image display unit is used to display a real-scene image, the real-scene image including a first output grid that matches the irregularly shaped display medium; The interface display unit is used to display a first interface in response to a user's first operation on the first control; the first interface is used to indicate that a second output grid matches the first output grid, and the second output grid is the grid corresponding to the output channel for displaying data; The data display unit is used to display the display data on the irregular display medium according to the position of the second output grid in response to the second operation of the user.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the data display method for irregularly shaped display media as described in any one of claims 1 to 7.

10. A display system, characterized in that, include: Irregularly shaped display media; The electronic device as described in claim 9; A projection device or a display control device; wherein the projection device is connected to the electronic device and is used to project the display data onto the irregularly shaped display medium according to the position of the second output grid; the display control device is connected to the electronic device and is used to control the irregularly shaped display medium to display the display data according to the position of the second output grid.

Images