A method and device for displaying an image on a curved surface

By adjusting the curved and mapping relationship of the plane image in VR devices, the surface display effect is achieved, solving the problem of poor display of the UI interface of VR application in the prior art, and improving the visual experience and vision.

CN114327329BActive Publication Date: 2024-11-26HISENSE VISUAL TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202111511889.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-07
Publication Date
2024-11-26
Estimated Expiration
2041-12-07

AI Technical Summary

Technical Problem

Existing VR applications lack curved display effect in UI interface display, resulting in poor visual presentation on integrated wide display screen, and cannot be effectively optimized by rotating flat display screens, and need to be split into multiple sub-display screens, which is complex. And the effect is not good.

Method used

By applying a custom algorithm in VR device to bend the plane image, establish the mapping relationship between the curved display screen to be drawn and the plane image, adjust the field of view of the UI camera, so that the curved display screen fills the entire camera field of view, and displays it on the curved surface Render flat images on the screen to achieve surface display effect.

Benefits of technology

The curved display effect of the UI interface in VR devices is realized, which enhances the visual experience, provides a wider field of view, and avoids the complexity of display splitting, which improves the visual characteristics of the display effect close to the human eye.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114327329B_ABST
    Figure CN114327329B_ABST
Patent Text Reader

Abstract

The present application relates to the field of VR technology, and provides a method and device for displaying a curved surface of an image. Based on a preset UI interface resolution, the aspect ratio of the curved display screen to be drawn, the resolution of the plane image, and the field of view of the UI camera in the orthogonal mode are respectively configured, so as to establish a mapping relationship between the curved display screen to be drawn and the plane image, and by configuring the field of view of the UI camera, the curved screen to be drawn can fill the entire camera field of view, ensuring that the user will not see the image outside the curved display screen; then, based on the plane display screen, multiple triangular facets are generated by vertex interpolation, and for two adjacent vertices on the same edge of each triangular facet, the two-dimensional coordinates of each vertex on the curved display screen to be drawn are determined by using the trigonometric function relationship, and the curved display screen is drawn based on the two-dimensional coordinates of each vertex, so as to achieve a curved display effect of the UI interface in the VR device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of display technology, in particular to the field of virtual reality (VR) technology, and provides a method and device for displaying a curved surface of an image. Background Art

[0002] The Unity engine is mainly used for VR application development, and the user interface (UI) of VR applications is mainly developed using the graphics processor (UGUI) in the Unity engine. However, UGUI provides flat display effects for mobile applications and does not provide special curved display effects for VT applications.

[0003] At present, most VR applications use ordinary flat screens to display UI interfaces. In order to fit the visual habits of the human eye, the visual effect is optimized by rotating the angle of the flat screen. However, this method has some limitations on the size of the screen; and for the display of the UI interface on an integrated wide screen, the visual presentation cannot be well achieved by rotating the angle, and it needs to be split into multiple sub-screens, which is more complicated and has poor display effects. Summary of the invention

[0004] The embodiments of the present application provide a method and device for displaying a curved image, which are used to achieve a curved display effect of a UI interface in a VR device.

[0005] On the one hand, an embodiment of the present application provides a method for displaying a curved surface of an image, which is applied to a VR device, wherein the VR device includes a UI camera, including:

[0006] According to a preset UI interface resolution, the aspect ratio of the curved display screen to be drawn and the resolution of the plane image displayed by the VR device are determined to obtain a mapping relationship between the curved display screen to be drawn and the plane image;

[0007] According to the UI interface resolution, adjust the field of view of the UI camera in the orthogonal mode so that the curved screen to be drawn can fill the entire camera field of view;

[0008] Drawing a curved display screen according to the flat display screen of the planar image;

[0009] According to the mapping relationship, the plane image is rendered and displayed on the drawn curved display screen.

[0010] On the other hand, an embodiment of the present application provides a virtual reality VR device, including a processor, a memory and a UI camera, wherein the memory and the UI camera are connected to the processor via a bus;

[0011] The UI camera is used to collect a planar image displayed by the VR device; the memory stores a computer program, and the processor performs the following operations according to the computer program:

[0012] According to a preset UI interface resolution, the aspect ratio of the curved display screen to be drawn and the resolution of the plane image are determined to obtain a mapping relationship between the curved display screen to be drawn and the plane image;

[0013] According to the UI interface resolution, adjust the field of view of the UI camera in the orthogonal mode so that the curved screen to be drawn can fill the entire camera field of view;

[0014] Drawing a curved display screen according to the flat display screen of the planar image;

[0015] According to the mapping relationship, the planar image is rendered and displayed on the drawn curved display screen.

[0016] On the other hand, an embodiment of the present application provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are used to enable a computer to execute the curved surface display method of an image provided by an embodiment of the present application.

[0017] In the above-mentioned embodiments of the present application, the aspect ratio of the curved display screen to be drawn, the resolution of the plane image, and the field of view of the UI camera in the orthogonal mode are determined respectively according to the preset UI interface resolution. In this way, based on the UI interface, a mapping relationship is established between the curved display screen to be drawn and the plane image, and the curved screen to be drawn can fill the entire camera field of view, ensuring that the user will not see the image outside the curved display screen; further, based on the plane display screen of the plane image, the curved display screen is drawn, and according to the established mapping relationship, the plane image is rendered and displayed on the drawn curved display screen, thereby realizing the curved display effect of the UI interface in the VR device. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0019] Figure 1 An overall framework diagram for displaying a curved surface image provided in an embodiment of the present application;

[0020] Figure 2 A flow chart of a method for displaying a curved surface of an image provided in an embodiment of the present application;

[0021] Figure 3 A flow chart of a method for drawing a curved display screen provided in an embodiment of the present application;

[0022] Figure 4A A schematic diagram of a planar display effect of an image provided in an embodiment of the present application;

[0023] Figure 4B A schematic diagram of vertex distribution of a flat-panel display screen provided in an embodiment of the present application;

[0024] Figure 5 A schematic diagram of an updated vertex distribution of a flat-panel display screen provided in an embodiment of the present application;

[0025] Figure 6 A schematic diagram of a vertex interpolation process provided in an embodiment of the present application;

[0026] Figure 7 A schematic diagram of multiple triangular facets generated by each vertex provided in an embodiment of the present application;

[0027] Figure 8 A flow chart of a method for determining the coordinates of each vertex on a curved display screen to be drawn provided in an embodiment of the present application;

[0028] Fig. 9 A schematic diagram of a method for calculating the coordinates of each vertex on a curved display screen to be drawn provided in an embodiment of the present application;

[0029] Fig.10 A top view of the curved display screen provided in the embodiment of the present application;

[0030] Fig.11 A schematic diagram of the curved surface display effect of a plane image provided in an embodiment of the present application;

[0031] Fig.12 A flowchart of a method for implementing the UI interface interaction function in a curved display screen provided in an embodiment of the present application;

[0032] Fig.13 A structural diagram of a VR device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] The embodiment of the present application provides a method and device for displaying an image on a curved surface. Without splitting the display panel, the plane is bent by a custom algorithm to obtain a curved display screen, so as to display videos and images on the curved display screen. Since the human eyeball is in a curved convex state, the curvature of the curved display screen can ensure that the distance between the human eye and each pixel on the display screen is equal, so as to bring a better visual sensory experience; and since the edge of the curved display screen is slightly curved toward the user, it can be closer to the human eye, so that the user at the edge and the user at the center of the curved display screen can achieve the same viewing angle, which brings the user a wider field of view.

[0034] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the technical solution of the present application, rather than all of the embodiments. Based on the embodiments recorded in the application documents, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the technical solution of the present application.

[0035] like Figure 1 , which is an overall framework diagram of displaying a curved image provided by an embodiment of the present application, includes a configuration module 100 , an image association module 200 , a curved display screen drawing module 300 , and an image display module 400 .

[0036] Configuration module 100 is used to configure the UI camera in the VR device, the RenderTexture in the Unity engine, and the aspect ratio of the curved display screen to be drawn based on the preset UI interface. Specifically, when configuring the UI camera, the projection mode of the UI camera is adjusted to the orthogonal mode (Orthographic). In this mode, the field of view space is a cube, which can ensure that the captured plane image does not have the problem of being larger near and smaller far away, and the size parameter that controls the field of view size of the UI camera is set so that the curved screen to be drawn can fill the entire camera field of view to ensure that the user will not see the image outside the curved display screen; RenderTexture is used to receive the plane image captured by the UI camera. When configuring RenderTexture, the size parameter is set to the resolution of the UI interface, and basic parameters such as ColorFormat are configured; when configuring the aspect ratio of the curved display screen to be drawn, it is set to be equal to the horizontal and vertical ratio of the resolution of the UI interface.

[0037] Optionally, in some embodiments, when configuring RenderTexture, MipMaps can also be enabled to prevent the high-definition image flickering problem caused by the original resolution of the plane image captured by the UI camera being inconsistent with the resolution of the UI interface.

[0038] Through the above configuration, the image association module 200 can establish a mapping relationship between the curved display screen to be drawn and the flat image, and the mapping relationship is specifically: the aspect ratio of the curved display screen to be drawn is equal to the aspect ratio of the flat image.

[0039] The curved display screen drawing module 300 is used to draw Mesh vertices based on the flat display screen and generate a curved display screen through a custom curved display screen drawing method.

[0040] The image display module 400 is used to render and display the planar image on the curved display screen to be drawn according to the mapping relationship between the curved display screen to be drawn and the planar image.

[0041] based on Figure 1 The overall block diagram shown in FIG. 1 is a flow chart of a method for displaying a curved surface of an image provided by the present application. Figure 2 ,like Figure 2 As shown in the figure, the process is executed by the VR device and mainly includes the following steps:

[0042] S201: According to a preset UI interface resolution, determine the aspect ratio of the curved display screen to be drawn and the resolution of the flat image displayed by the VR device, and obtain a mapping relationship between the curved display screen to be drawn and the flat image.

[0043] For example, assuming that the resolution of the UI interface is 3500*1200 (pixels), the aspect ratio of the curved display screen to be drawn is determined to be 3.5:1.2, and the size parameter in RenderTexture is set to 3500*1200, so that RenderTexture adjusts the resolution of the flat image captured by the UI camera to 3500*1200 (pixels), thereby ensuring that the display screen ratio is not distorted when the curved display screen is subsequently rendered according to the flat image.

[0044] In S201, the aspect ratio of the curved display screen to be drawn and the horizontal and vertical resolution ratio of the flat image are made to correspond one to one through the preset UI interface resolution, thereby obtaining a mapping relationship between the curved display screen to be drawn and the flat image.

[0045] It should be noted that the above-mentioned plane image can be an image of the VR device itself (such as a boot interface), or it can be an image displayed in an application (Application) installed on the VR device.

[0046] S202: According to the UI interface resolution, adjust the field of view of the UI camera in the orthogonal mode so that the curved screen to be drawn can fill the entire camera field of view.

[0047] In an embodiment of the present application, when executing S202, first, the projection mode of the UI camera is adjusted to the orthogonal mode. In this mode, the field of view space is a cube, which can ensure that the plane image captured by the UI camera does not have the problem of being larger near and smaller far away; then, the size parameter of the UI camera is set so that the curved screen to be drawn can fill the entire camera field of view, ensuring that the user will not see the image outside the curved display screen.

[0048] For example, the aspect ratio of the curved display screen to be drawn is 3.5:1.2, and the size parameter of the UI camera is set to 1.2.

[0049] S203: Drawing a curved display screen according to the flat display screen of the flat image.

[0050] The Unity engine draws a flat display screen for the flat image obtained by RenderTexture, which can achieve the effect of flat display, such as Figure 4A In order to achieve the display effect of the curved image, in the embodiment of the present application, based on the four vertices on the flat display screen, a plurality of vertices are drawn through the custom curved display screen drawing method in the Mesh class to generate a curved display screen. For the specific drawing process, see Figure 3 :

[0051] S2031: Adjust the indexes of four vertices on the flat display screen so that the adjusted vertex arrangement pattern meets the drawing conditions of the curved display screen.

[0052] Generally, a flat display screen drawn by the Unity engine contains four vertices, which are composed of two triangles, such as Figure 4B In order to draw a curved display screen, it is necessary to obtain more vertices based on the four vertices to form more triangles, thereby creating a curved surface effect.

[0053] The default arrangement of the four vertices in the flat display drawn by the Unity engine is not suitable for drawing the vertices of the curved display. Figure 4B As shown, the index of the upper left vertex is 3, the index of the lower left vertex is 0, the index of the lower right vertex is 2, and the index of the upper right vertex is 1. That is, the default vertex distribution regularity is not obvious, and it is difficult to determine the coordinates of the custom vertex. Therefore, in S2031, the arrangement of the four vertices on the flat display screen is adjusted so that the adjusted vertex arrangement regularity meets the drawing conditions of the curved display screen.

[0054] In an optional implementation, when executing S2031, the vertex with index 0 is moved to the upper left corner, the vertex with index 1 is moved to the lower left corner, the vertex with index 2 is moved to the upper right corner, and the vertex with index 3 is moved to the lower right corner, that is, the index numbers of the four vertices are increased in a counterclockwise direction. The adjusted vertex distribution is as follows: Figure 5 shown.

[0055] S2032: interpolating between two vertices on the upper edge and the lower edge of the flat display screen respectively to obtain a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn.

[0056] In an embodiment of the present application, the four vertices of the flat display screen can be used as basic vertices for drawing a curved display screen. After determining the positions (coordinates) of the basic vertices, interpolation is performed between the two vertices at the upper edge and the lower edge of the flat display screen, that is, interpolation is performed between the two basic vertices at the upper edge and the lower edge, respectively, to obtain multiple vertices on the upper edge and the lower edge of the curved display screen to be drawn, and the two-dimensional coordinates of each vertex after interpolation are recorded.

[0057] The vertex interpolation process is as follows Figure 6 As shown, by interpolating between vertex 0 and vertex 2, all vertices on the upper edge of the curved display screen to be drawn can be obtained, and by interpolating between vertex 1 and vertex 3, all vertices on the lower edge of the curved display screen to be drawn can be obtained. The more vertices interpolated, the smoother the curvature of the drawn curved display screen, but the corresponding rendering pressure will also increase. Optionally, the embodiment of the present application uses 130 vertices (including vertices 0, 1, 2, and 3) to complete the drawing of the surface.

[0058] S2033: Generate triangular facets according to a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn.

[0059] After obtaining the vertices on the upper and lower edges of the surface to be drawn through interpolation, the vertices need to be used to complete the drawing of the triangular patch to finally present the drawing effect. According to the triangular patch drawing algorithm, three vertices are required to draw a triangular patch, and adjacent triangular patches share two vertices.

[0060] The schematic diagram of the triangular facets generated by each vertex provided in the embodiment of the present application is as follows Figure 7 As shown, 130 vertices can eventually draw 65 triangle patches.

[0061] It should be noted that the drawing of triangular patches does not directly depend on the coordinates of each vertex, but is directly drawn according to the custom vertex index.

[0062] S2034: For two adjacent vertices on the same edge of each triangular face, determine the two-dimensional coordinates of the two adjacent vertices using a trigonometric function relationship.

[0063] After the triangle patch is drawn, the entire display panel is still a flat type. If you want to achieve a curved surface effect, you need to adjust the plane coordinates of each vertex on the curved display screen to be drawn, that is, offset each vertex by a certain arc according to a custom algorithm. For the specific process, see Figure 8 :

[0064] S2034_1: Determine a center angle between two adjacent vertices according to a preset curvature of the curved surface and the number of vertices of the curved display screen to be drawn.

[0065] In an embodiment of the present application, the central angle between two adjacent vertices is equal to the number of vertices included in the preset surface curvature / upper edge, or the central angle between two adjacent vertices is equal to the number of vertices included in the preset surface curvature / lower edge.

[0066] For example, assuming that the curvature of the surface is 130°, the curved display screen to be drawn contains 130 vertices after interpolation, namely 65 vertices on the upper edge and 65 vertices on the lower edge. Then the central angle between two adjacent vertices on the upper and lower edges is: 130° / 65=2°.

[0067] S2034_2: Taking the maximum distance between two vertices on the same edge as the arc length of the curved display screen to be drawn, and determining the sector radius corresponding to the two adjacent vertices according to the arc length of the curved display screen to be drawn and the central angle between the two adjacent vertices.

[0068] In an embodiment of the present application, the same edge is the upper edge and the lower edge of the curved display screen to be drawn, wherein the maximum distance between two vertices in the upper edge is the distance between the two outermost vertices of the upper edge, that is, the distance between vertex 0 and vertex 128 (base vertex 3), and the maximum distance between two vertices in the lower edge is the distance between the two outermost vertices of the lower edge, that is, the distance between vertex 1 and vertex 129 (base vertex 2).

[0069] In S2034_2, after the arc length of the curved display screen to be drawn is obtained, the sector radius corresponding to two adjacent vertices can be determined according to the relationship between the arc length, the center angle and the radius: l=n*π*R / 180°.

[0070] Wherein, l is the arc length between two adjacent vertices, n is the central angle between two adjacent vertices, and R is the radius of the sector corresponding to the two adjacent vertices, wherein l is equal to the arc length of the curved display screen to be drawn / the number of vertices included in the upper edge, or l is equal to the arc length of the curved display screen to be drawn / the number of vertices included in the lower edge.

[0071] In some embodiments, since the multiple vertices on the upper and lower edges of the curved display screen to be drawn are obtained by uniformly interpolating the four basic vertices of the flat display screen, the radius of the fan formed by every two adjacent vertices is the same, and the formula L=α*r can be directly used, where L is the arc length of the curved display screen to be drawn, α is the preset curvature of the curved display screen to be drawn, and r is the radius of the fan formed by two adjacent vertices.

[0072] S2034_3: Determine the two-dimensional coordinates of two adjacent vertices according to the central angle and sector radius corresponding to the two adjacent vertices using the trigonometric function relationship.

[0073] Taking any first vertex of two adjacent vertices as an example, according to the central angle and the sector radius corresponding to the two adjacent vertices, the longitudinal movement distance of the first vertex and the target horizontal coordinate of the first vertex are determined by using the trigonometric function relationship, and the difference between the original longitudinal coordinate of the first vertex and the longitudinal movement distance is used as the target longitudinal coordinate of the first vertex to obtain the two-dimensional coordinate of the first vertex. Among them, the original longitudinal coordinate of the first vertex is obtained by interpolating the four vertices on the flat display screen.

[0074] Take the upper edge as an example, Fig. 9 A schematic diagram of the relationship between two adjacent vertices provided in the embodiment of the present application, in Fig. 9 In , assuming that vertices A and B are the upper edges of the flat display screen, DCE is the upper edge of the curved display screen to be drawn, O is the center point of the sector of DCE, G is the first vertex after interpolation, the center angle between two adjacent vertices is 20°, and the sector radius is R. Using the cosine trigonometric function, the length of OH can be obtained as R*cos20°, then the longitudinal movement distance of the first vertex G is GF=CH=R-OH, that is, GF=RR*cos20°, and the point after the movement is point F on the curved display screen to be drawn, so the target vertical coordinate of point F on the curved display screen to be drawn is Gz-CH, and the target horizontal coordinate is R*sin20°. Among them, Gz represents the original vertical coordinate of the first vertex G.

[0075] It should be noted that in real scenarios, Fig. 9 Points B and D, points A and E are not on the same vertical line. Fig. 9 This is only to explain the coordinate calculation process of each vertex on the curved display screen to be drawn. In actual scenes, point D and point E on the curved display screen to be drawn will be close to the middle.

[0076] In some embodiments, when the center of the sector corresponding to two adjacent vertices is the origin (0, 0) of the coordinate system, the target vertical coordinate of point F on the curved display screen to be drawn is R*cos20°.

[0077] In the embodiment of the present application, the coordinates of other vertices on the curved display screen to be drawn are determined in the same manner. Fig. 9 , which will not be repeated here.

[0078] S2035: Drawing the curved display screen according to the two-dimensional coordinates of a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn. Drawing the curved display screen.

[0079] In S2035, after obtaining the two-dimensional coordinates of each vertex on the upper edge and the lower edge of the curved display screen to be drawn, curve fitting is performed to obtain the drawn curved display screen. The drawing effect is as follows: Fig.10 shown.

[0080] S204: Rendering and displaying the planar image on the drawn curved display screen according to the mapping relationship.

[0081] Since the aspect ratio of the curved display screen to be drawn is equal to the ratio of the horizontal and vertical resolutions of the flat image, the flat image can be rendered on the curved display screen without distortion. The rendered result is as follows: Fig.11 shown.

[0082] The embodiment of the present application determines the aspect ratio of the curved display screen to be drawn, the resolution of the plane image, and the field of view of the UI camera in the orthogonal mode based on the preset UI interface resolution, thereby establishing a mapping relationship between the aspect ratio of the curved display screen to be drawn and the horizontal and vertical resolutions of the plane image, and by adjusting the field of view of the UI camera, the curved screen to be drawn can fill the entire camera field of view, ensuring that the user will not see the image outside the curved display screen; then, based on the four vertices of the plane display screen, interpolation is performed between the two vertices of the upper edge and the lower edge, and triangular facets are generated between the interpolated vertices, and for each adjacent vertices on the same edge of each triangular facet, the two-dimensional coordinates of each vertex on the upper edge and the lower edge of the curved display screen to be drawn are determined using the trigonometric function relationship, and the curved display screen is drawn based on the two-dimensional coordinates of each vertex, thereby achieving a curved display effect of the UI interface in the VR device, and because the curved display screen is more in line with the visual characteristics of the human eye, the user's viewing field can be expanded.

[0083] After displaying a flat image through a curved display, the customized curved display only obtains image data. The control buttons that display the image on the touch (including clicking, sliding, etc.) UI interface will not generate any interactive logic, that is, the touch operation will not get the correct response from the VR device.

[0084] In the embodiment of the present application, in order to meet the interactive function of the UI interface, the interactive function of the UI interface in the curved display screen is realized by rewriting the event trigger system PointerInputModule in UGUI. For details, see Fig.12 :

[0085] S2051: Acquire touch coordinates on the curved display screen.

[0086] In an optional implementation, the vertex at the lower left corner of the curved display screen is used as the coordinate origin, and the coordinates of the vertex at the upper right corner of the curved display screen are the maximum coordinates of the curved display screen. The touch coordinates on the curved display screen are obtained through the user's touch operation and the function interface of the touch event.

[0087] S2052: Convert the touch coordinates into plane coordinates relative to the plane image according to the mapping relationship.

[0088] When drawing a curved display screen, the resolution of the plane image corresponds one-to-one to the resolution of the UI interface, and the aspect ratio of the curved display screen corresponds one-to-one to the ratio of the horizontal and vertical resolutions of the plane display image. According to the mapping relationship between the plane image, the UI interface, and the curved display screen, the touch coordinates on the curved display screen are converted into plane coordinates relative to the plane image.

[0089] S2053: Controlling the plane image in response to the touch operation according to the plane coordinates.

[0090] In S2053, by rewriting the PointerInputModule of UGUI, the touch coordinate acquisition interface of the PointerInputModule is truncated and replaced with the coordinate acquisition interface customized in the embodiment of this application, which converts the touch coordinates into plane coordinates, thereby responding to the control of the plane image by the touch operation according to the plane coordinates.

[0091] Based on the same technical concept, the present application embodiment provides a VR device, which can be Figure 2 and Fig.12 The method in , and can achieve the same technical effect.

[0092] See also Fig.13 , the VR device includes a processor 1301, a memory 1302 and a UI camera 1303, and the processor 1301, the memory 1302 and the UI camera 1303 are all connected via a bus 1304;

[0093] The memory 1302 stores a computer program, and when the processor 1301 executes the computer program, the following operations are implemented:

[0094] The UI camera 1303 is used to collect the plane image displayed by the VR device; the memory 1302 stores a computer program, and the processor 1301 performs the following operations according to the computer program:

[0095] According to the preset UI interface resolution, the aspect ratio of the curved display screen to be drawn and the resolution of the plane image are determined to obtain a mapping relationship between the curved display screen to be drawn and the plane image;

[0096] According to the UI interface resolution, adjust the field of view of the UI camera in orthogonal mode so that the curved screen to be drawn can fill the entire camera field of view;

[0097] Draw a curved display screen based on a flat display screen of a flat image;

[0098] According to the mapping relationship, a flat image is rendered and displayed on the drawn curved display screen.

[0099] Optionally, after displaying the planar image on the curved display screen, the processor 1301 further executes:

[0100] Get the touch coordinates on the curved display screen;

[0101] According to the mapping relationship, the touch coordinates are converted into plane coordinates relative to the plane image;

[0102] According to the plane coordinates, the plane image is controlled in response to the touch operation.

[0103] Optionally, the processor 1301 draws a curved display screen according to the flat display screen of the flat image, and the specific operations are:

[0104] Adjust the indexes of the four vertices on the flat display screen so that the adjusted vertex arrangement pattern meets the drawing conditions of the curved display screen;

[0105] Interpolating between two vertices on the upper edge and the lower edge of the flat display screen respectively to obtain a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn;

[0106] Generate triangular facets according to a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn;

[0107] For two adjacent vertices on the same edge of each triangular face, the two-dimensional coordinates of the two adjacent vertices are determined using the trigonometric function relationship;

[0108] The curved display screen is drawn according to the two-dimensional coordinates of a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn.

[0109] Optionally, the processor 1301 determines the two-dimensional coordinates of two adjacent vertices on the same edge of each triangular facet by using a trigonometric function relationship. The specific operation is:

[0110] Determine the center angle between two adjacent vertices according to the preset curvature of the curved surface and the number of vertices of the curved display screen to be drawn;

[0111] The maximum distance between two vertices on the same edge is used as the arc length of the curved display screen to be drawn, and the sector radius corresponding to two adjacent vertices is determined according to the arc length and the center angle of the circle;

[0112] According to the central angle and sector radius corresponding to two adjacent vertices, the two-dimensional coordinates of two adjacent vertices are determined using the trigonometric function relationship.

[0113] Optionally, the processor 1301 determines the two-dimensional coordinates of two adjacent vertices according to the central angle and the sector radius corresponding to the two adjacent vertices by using a trigonometric function relationship. The specific operation is:

[0114] According to the central angle and the sector radius, using the trigonometric function relationship, determine the longitudinal moving distance of the first vertex and the target horizontal coordinate of the first vertex, where the first vertex is any one of the two adjacent vertices;

[0115] The difference between the original longitudinal coordinate of the first vertex and the longitudinal moving distance is used as the target longitudinal coordinate of the first vertex to obtain the two-dimensional coordinate of the first vertex.

[0116] Optionally, the aspect ratio of the curved display screen to be drawn is equal to the aspect ratio of the horizontal and vertical resolutions of the plane image.

[0117] As an embodiment, the processor 1301 can be a central processing unit (CPU) or a graphics processing unit (GPU). The number of processors 1301 can be one or more. The processor 1301 and the memory 1302 can be coupled or relatively independent.

[0118] Those skilled in the art can understand that: all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, and the aforementioned computer program can be stored in a computer-readable storage medium. When the computer program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), disks or optical disks, etc. Various media that can store program codes.

[0119] Based on the same technical concept, an embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the above computer instructions are executed on a computer, the computer executes the curved surface display method of the image discussed above.

[0120] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0121] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0122] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0123] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0124] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A method for displaying a curved surface of an image, It is characterized in that Applied to a virtual reality VR device, wherein the VR device includes a UI camera, including: According to the preset UI interface resolution, the aspect ratio of the curved display screen to be drawn and the resolution of the plane image displayed by the VR device are determined to obtain a mapping relationship between the curved display screen to be drawn and the plane image, wherein the aspect ratio of the curved display screen to be drawn is equal to the ratio of the horizontal and vertical resolutions of the plane image; According to the UI interface resolution, adjust the field of view of the UI camera in the orthogonal mode so that the curved display screen to be drawn can fill the entire camera field of view; Move the vertex with index 0 on the flat display screen of the plane image to the upper left corner, the vertex with index 1 to the lower left corner, the vertex with index 2 to the upper right corner, and the vertex with index 3 to the lower right corner, so that the adjusted vertex arrangement rule meets the drawing conditions of the curved display screen, wherein the vertex with index 0 is located at the lower left corner of the flat display screen before adjustment, the vertex with index 1 is located at the upper right corner of the flat display screen before adjustment, the vertex with index 2 is located at the lower right corner of the flat display screen before adjustment, and the vertex with index 3 is located at the upper left corner of the flat display screen before adjustment; Interpolating between two vertices on the upper edge and the lower edge of the flat display screen respectively to obtain a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn; Generate triangular facets according to a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn; For two adjacent vertices on the same edge of each triangular facet, determine the two-dimensional coordinates of the two adjacent vertices by using a trigonometric function relationship; Drawing the curved display screen according to the two-dimensional coordinates of a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn; According to the mapping relationship, the plane image is rendered and displayed on the drawn curved display screen.

2. The method according to claim 1, It is characterized in that After displaying the planar image on the curved display screen, the method further includes: Acquire touch coordinates on the curved display screen; According to the mapping relationship, the touch coordinates are converted into plane coordinates relative to the plane image; According to the plane coordinates, the plane image is controlled in response to a touch operation.

3. The method according to claim 2, It is characterized in that The vertex at the lower left corner of the curved display screen is used as the coordinate origin, and the coordinates of the vertex at the upper right corner of the curved display screen are the maximum coordinates of the curved display screen; The acquiring of touch coordinates on the curved display screen includes: Through the user's touch operation and the function interface of the touch event, the touch coordinates on the curved display screen are obtained.

4. The method according to claim 1, It is characterized in that The step of determining the two-dimensional coordinates of two adjacent vertices on the same edge of each triangular facet by using a trigonometric function relationship comprises: Determine the center angle between the two adjacent vertices according to a preset curved surface curvature and the number of vertices of the curved display screen to be drawn; The maximum distance between two vertices on the same edge is used as the arc length of the curved display screen to be drawn, and the fan radius corresponding to the two adjacent vertices is determined according to the arc length and the center angle; The two-dimensional coordinates of the two adjacent vertices are determined according to the central angle and the sector radius corresponding to the two adjacent vertices using a trigonometric function relationship.

5. The method according to claim 4, It is characterized in that Determining the two-dimensional coordinates of the two adjacent vertices by using a trigonometric function relationship according to the central angle and the sector radius corresponding to the two adjacent vertices includes: According to the central angle and the sector radius, using a trigonometric function relationship, determine a longitudinal moving distance of a first vertex and a target horizontal coordinate of the first vertex, where the first vertex is any one of the two adjacent vertices; The difference between the original longitudinal coordinate of the first vertex and the longitudinal moving distance is used as the target longitudinal coordinate of the first vertex to obtain the two-dimensional coordinate of the first vertex.

6. The method according to claim 1, It is characterized in that The step of determining the aspect ratio of the curved display screen to be drawn and the resolution of the plane image displayed by the VR device according to the preset UI interface resolution, and obtaining a mapping relationship between the curved display screen to be drawn and the plane image, includes: Determine the aspect ratio of the curved display screen to be drawn by the UI interface resolution; The aspect ratio of the curved display screen to be drawn and the horizontal and vertical resolution ratio of the plane image are set to correspond one to one, so as to obtain a mapping relationship between the curved display screen to be drawn and the plane image.

7. The method according to claim 1, It is characterized in that Drawing the curved display screen according to the two-dimensional coordinates of a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn comprises: The two-dimensional coordinates of each vertex on the upper edge and the lower edge of the curved display screen to be drawn are subjected to curve fitting to obtain the drawn curved display screen.

8. A virtual reality VR device, It is characterized in that It includes a processor, a memory and a UI camera, wherein the memory and the UI camera are connected to the processor via a bus; The UI camera is used to collect a planar image displayed by the VR device; the memory stores a computer program, and the processor performs the following operations according to the computer program: According to the preset UI interface resolution, the aspect ratio of the curved display screen to be drawn and the resolution of the plane image are determined to obtain a mapping relationship between the curved display screen to be drawn and the plane image, wherein the aspect ratio of the curved display screen to be drawn is equal to the ratio of the horizontal and vertical resolutions of the plane image; According to the UI interface resolution, adjust the field of view of the UI camera in the orthogonal mode so that the curved display screen to be drawn can fill the entire camera field of view; Move the vertex with index 0 on the flat display screen of the plane image to the upper left corner, the vertex with index 1 to the lower left corner, the vertex with index 2 to the upper right corner, and the vertex with index 3 to the lower right corner, so that the adjusted vertex arrangement rule meets the drawing conditions of the curved display screen, wherein the vertex with index 0 is located at the lower left corner of the flat display screen before adjustment, the vertex with index 1 is located at the upper right corner of the flat display screen before adjustment, the vertex with index 2 is located at the lower right corner of the flat display screen before adjustment, and the vertex with index 3 is located at the upper left corner of the flat display screen before adjustment; Interpolating between two vertices on the upper edge and the lower edge of the flat display screen respectively to obtain a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn; Generate triangular facets according to a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn; For two adjacent vertices on the same edge of each triangular facet, determine the two-dimensional coordinates of the two adjacent vertices by using a trigonometric function relationship; Drawing the curved display screen according to the two-dimensional coordinates of a plurality of vertices on the upper edge and the lower edge of the curved display screen to be drawn; According to the mapping relationship, the planar image is rendered and displayed on the drawn curved display screen.

9. The VR device according to claim 8, It is characterized in that After the processor displays the planar image on the curved display screen, the processor further executes: Acquire touch coordinates on the curved display screen; According to the mapping relationship, the touch coordinates are converted into plane coordinates relative to the plane image; According to the plane coordinates, the plane image is controlled in response to a touch operation.

10. The VR device according to claim 8, It is characterized in that The processor determines the two-dimensional coordinates of the two adjacent vertices on the same edge of each triangular facet by using a trigonometric function relationship. The specific operation is: Determine the center angle between the two adjacent vertices according to a preset curved surface curvature and the number of vertices of the curved display screen to be drawn; The maximum distance between two vertices on the same edge is used as the arc length of the curved display screen to be drawn, and the fan radius corresponding to the two adjacent vertices is determined according to the arc length and the center angle; The two-dimensional coordinates of the two adjacent vertices are determined according to the central angle and the sector radius corresponding to the two adjacent vertices using a trigonometric function relationship.