Data display method, device, equipment and medium

By transforming the multihedral model into a surface model and pre-calculate the texture coordinates, the problem of high computing overhead in three-dimensional model rendering is solved, and the rendering efficiency of 3D stereoscopic video is improved.

CN118691765BActive Publication Date: 2024-11-22TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411187391.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2024-11-22
Estimated Expiration
2044-08-28

AI Technical Summary

Technical Problem

Existing three-dimensional models need to calculate texture coordinates in real time in 3D stereo video rendering, resulting in increased computational overhead and reduced rendering efficiency.

Method used

By transforming the multihedral model into a surface body model, and pre-calculating the vertex texture coordinates of the surface body model, it is stored in the three-dimensional model storage carrier, and the texture image is directly obtained and applied for rendering during loading.

Benefits of technology

Reduces the computational overhead during texture rendering, improves rendering efficiency, and reduces the computational burden of the GPU.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118691765B_ABST
    Figure CN118691765B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides a data display method, device, equipment and medium, the method comprising: obtaining a texture image in a player, loading a curved body model stored in a three-dimensional model storage carrier, and obtaining texture coordinates corresponding to each vertex of the curved body model; the curved body model is obtained by transforming a polyhedron model; sampling the texture image according to the texture coordinates corresponding to each vertex of the curved body model, and obtaining texture color information corresponding to the curved body model; drawing the curved body model according to the texture color information, and displaying the texture rendering result of the curved body model in a virtual reality environment. Through the embodiment of the present application, the texture rendering efficiency can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a data display method, device, equipment and medium. Background Art

[0002] As a form of video with a three-dimensional sense of space, 3D (3D) stereoscopic video can enhance the user's sense of presence and immersion, and is widely loved by users. In the current 3D stereoscopic video playback solution, the received video file is decoded frame by frame to obtain decoded video frames. A 3D model can be constructed, and the texture coordinates of each vertex of the 3D model can be calculated in real time. According to the texture coordinates of each vertex of the 3D model, the decoded video frame is sampled, and the decoded video frame is applied to the surface of the 3D model as a texture image, and displayed in a virtual reality environment to achieve the playback of 3D stereoscopic video.

[0003] However, currently, the texture coordinates of each vertex of the 3D model need to be calculated in real time during the rendering of 3D stereoscopic video, that is, the rendering of each video frame requires the real-time calculation of the texture coordinates of the 3D model. If the accuracy of the 3D model needs to be improved, the number of vertices of the 3D model needs to be increased to make the 3D model smoother; this will increase the computational overhead during the video frame rendering process and reduce the texture rendering efficiency of the 3D stereoscopic video. Summary of the invention

[0004] The embodiments of the present application provide a data display method, apparatus, device and medium, which can improve texture rendering efficiency.

[0005] On the one hand, an embodiment of the present application provides a data display method, including:

[0006] Acquire the texture image in the player, load the curved body model stored in the three-dimensional model storage carrier, and obtain the texture coordinates corresponding to each vertex of the curved body model; the curved body model is obtained by transforming the polyhedron model;

[0007] According to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled to obtain the texture color information corresponding to the curved body model;

[0008] The surface model is drawn according to the texture color information, and the texture rendering result of the surface model is displayed in a virtual reality environment.

[0009] On the one hand, an embodiment of the present application provides a data display device, including:

[0010] A loading module is used to obtain a texture image in the player, load a curved body model stored in a three-dimensional model storage carrier, and obtain texture coordinates corresponding to each vertex of the curved body model; the curved body model is obtained by transforming the polyhedron model;

[0011] A sampling module is used to sample the texture image according to the texture coordinates corresponding to each vertex of the curved body model to obtain the texture color information corresponding to the curved body model;

[0012] The drawing module is used to draw the curved surface model according to the texture color information and display the texture rendering result of the curved surface model in the virtual reality environment.

[0013] Wherein, the data display device also includes:

[0014] A model creation module is used to obtain a polyhedron model, decompose each face of the polyhedron model into multiple polygons, determine the mapping points of the vertices of the multiple polygons in each face on the curved surface, and determine the curved surface carrying the multiple mapping points as an initial three-dimensional model;

[0015] The model creation model is also used to obtain the texture coordinates corresponding to each mapping point of the initial three-dimensional model, determine the initial three-dimensional model with the texture coordinates as a surface model, and store the surface model in a three-dimensional model storage carrier; each mapping point of the initial three-dimensional model is each vertex of the surface model.

[0016] The model creation module decomposes each face of the polyhedron model into multiple polygons, determines the mapping points of the vertices of the multiple polygons in each face on the curved surface, and is used to perform the following steps:

[0017] Decompose the i-th face of the polyhedron model into multiple polygons, and obtain vertex coordinate information of multiple polygons in the i-th face; i is a positive integer less than or equal to M, and M represents the number of faces of the polyhedron model;

[0018] The vertex coordinate information is normalized to obtain normalized coordinate information, and the space point corresponding to the normalized coordinate information is determined as the mapping point of the vertices of the multiple polygons in the i-th face on the curved surface.

[0019] The model creation module normalizes the vertex coordinate information to obtain normalized coordinate information for executing the following steps:

[0020] According to the vertex coordinate information, determine the length between the vertex a of the plurality of polygons in the i-th face and the origin of the coordinate system;

[0021] The vertex coordinate information corresponding to vertex a is divided by the length to obtain the normalized coordinate information corresponding to vertex a.

[0022] The model creation module decomposes each face of the polyhedron model into multiple polygons, determines the mapping points of the vertices of the multiple polygons in each face on the curved surface, and is used to perform the following steps:

[0023] Decompose the i-th face of the polyhedron model into multiple polygons, and obtain vertex coordinate information corresponding to the multiple polygons in the i-th face; i is a positive integer less than or equal to M, and M represents the number of faces of the polyhedron model;

[0024] Obtaining the surface body mapping coefficients of the vertex coordinate information in D spatial dimensions, and determining the transformation coordinate information corresponding to the vertex coordinate information according to the surface body mapping coefficients and the D coordinate values ​​in the vertex coordinate information; one coordinate value in the vertex coordinate information corresponds to one spatial dimension, and D is a positive integer;

[0025] The space point corresponding to the transformed coordinate information is determined as the mapping point of the vertices of the multiple polygons in the i-th face on the curved surface.

[0026] The model creation module obtains the surface body mapping coefficients of the vertex coordinate information in D spatial dimensions to perform the following steps:

[0027] Obtain coordinate values ​​on D spatial dimensions from the vertex coordinate information, and determine the coordinate values ​​on the spatial dimensions other than the j-th spatial dimension among the D spatial dimensions as reference values; j is a positive integer less than or equal to D;

[0028] The surface volume mapping coefficient corresponding to the j-th spatial dimension is determined according to the square product of the reference values ​​and the square sum of the reference values.

[0029] The model creation module obtains the texture coordinates corresponding to each mapping point of the initial three-dimensional model, and is used to perform the following steps:

[0030] Obtaining vertex coordinate information corresponding to each mapping point of the initial three-dimensional model, and converting the vertex coordinate information into spherical coordinate information;

[0031] The polar angle and azimuth angle in the spherical coordinate information are mapped to the texture coordinate range to obtain the texture coordinates corresponding to each mapping point of the initial three-dimensional model.

[0032] The loading module obtains the texture image in the player and is used to perform the following steps:

[0033] Obtain the video file through the player, identify the packaging format of the video file, and obtain the video stream in the video file;

[0034] The encoding mode information corresponding to the video code stream is obtained, and the data in the video code stream is decoded according to the encoding mode information to obtain a texture image.

[0035] The sampling module samples the texture image according to the texture coordinates corresponding to each vertex of the curved body model to obtain the texture color information corresponding to the curved body model, which is used to perform the following steps:

[0036] Obtaining the centroid coordinates of the polygon b of the curved surface model, and performing interpolation processing according to the centroid coordinates and the texture coordinates corresponding to the vertices of the polygon b to obtain the interpolated texture coordinates of the polygon b;

[0037] According to the texture coordinates corresponding to each vertex of the curved body model and the interpolated texture coordinates of each polygon of the curved body model, the texture image is sampled to obtain the texture color information corresponding to the curved body model.

[0038] The sampling module obtains the centroid coordinates of the polygon b of the surface model to perform the following steps:

[0039] Determine the centroid of the polygon b of the surface model, connect the centroid and the vertices of the polygon b, and divide the polygon b into a plurality of sub-polygons;

[0040] The first area of ​​polygon b and the second area corresponding to each sub-polygon are obtained, and the ratio between the second area and the first area is determined as the centroid coordinates of polygon b.

[0041] On one hand, an embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory is connected to the processor, the memory is used to store a computer program, and the processor is used to call the computer program so that the computer device executes the method provided in the above aspect of the embodiment of the present application.

[0042] On one hand, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. The computer program is suitable for being loaded and executed by a processor, so that a computer device with a processor executes the method provided in the above aspect of the embodiment of the present application.

[0043] According to one aspect of the present application, a computer program product is provided, which may include a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the method provided in the above aspect.

[0044] In an embodiment of the present application, by transforming a polyhedron model into a curved body model and pre-calculating the texture coordinates of all vertices of the curved body model, the vertices of the curved body model and the texture coordinates of the vertices can be stored in a three-dimensional model storage carrier; by pre-calculating the curved body model (including the vertices of the polygons constituting the curved body model and the texture coordinates of each vertex), the computational overhead in the texture rendering process can be reduced. When the player provides a texture image, the curved body model stored in the three-dimensional model storage carrier can be loaded to obtain the texture coordinates corresponding to each vertex of the curved body model; according to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled, and the texture image is applied to the surface of the curved body model, and the texture rendering result of the curved body model is displayed in a virtual display environment. Since the texture coordinates of each vertex of the curved body model can be obtained by loading the pre-calculated curved body model during the texture rendering process, the texture rendering efficiency can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 It is a structural diagram of a network architecture provided by an embodiment of the present application;

[0047] Figure 2 This is a schematic diagram of a scenario of a data display method provided in an embodiment of the present application;

[0048] Figure 3a This is a schematic diagram of a three-dimensional model provided in an embodiment of the present application. Figure 1 ;

[0049] Figure 3b This is a schematic diagram of a three-dimensional model provided in an embodiment of the present application. Figure 2 ;

[0050] Figure 4 This is a flow chart of a data display method provided in an embodiment of the present application. Figure 1 ;

[0051] Figure 5 It is a flowchart of a video content rendering process provided by an embodiment of the present application;

[0052] Figure 6 This is a flow chart of a data display method provided in an embodiment of the present application. Figure 2 ;

[0053] Figure 7 This embodiment of the present application provides a schematic diagram of transforming a polyhedron model into a curved surface model. Figure 1 ;

[0054] Figure 8 This embodiment of the present application provides a schematic diagram of transforming a polyhedron model into a curved surface model. Figure 2 ;

[0055] Fig. 9 This is a schematic diagram of a data display device provided in an embodiment of the present application. Figure 1 ;

[0056] Fig.10 This is a schematic diagram of a data display device provided in an embodiment of the present application. Figure 2 ;

[0057] Fig.11 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0059] For ease of understanding, the basic technical concepts involved in the embodiments of the present application are described below:

[0060] Virtual Reality (VR): VR technology is a computer simulation system that can create and experience a virtual world. It uses computers to generate a simulated environment and immerse users in it. VR technology can be widely used in games, education, medical care, architectural design, film and television entertainment and other fields.

[0061] 3D stereoscopic video: 3D stereoscopic video is a form of video that can give users a three-dimensional visual experience.

[0062] Three-dimensional model: In a 3D stereoscopic video playback solution, the three-dimensional space can be defined as a space composed of a three-dimensional model, and the user can watch the video at the exact center of the three-dimensional model.

[0063] Immersive space: Immersive space can be a highly immersive and fully engaging visual, auditory and other sensory experience environment created by a variety of technical means; immersive space can also be called three-dimensional space, and the video content represented in the immersive space can be called immersive media, such as three-dimensional video content represented in the form of a sphere.

[0064] See also Figure 1 , Figure 1 : is a schematic diagram of a network architecture provided in an embodiment of the present application. The network architecture can be composed of VR devices and servers. The number of servers in the network architecture can be one or more, and the number of VR devices in the network architecture can also be one or more. The present application does not limit the number of servers and VR devices in the network architecture. The present application embodiment takes the network architecture including one server and one VR device as an example for description. Figure 1 As shown, the network architecture may include a VR device 10a and a server 10b; the VR device 10a may be connected to the server 10b through a network, so that the VR device 10a may exchange data with the server 10b through the network connection.

[0065] in, Figure 1 The VR device 10a shown may include but is not limited to: PC (Personal Computer) end VR device, all-in-one VR device, mobile end VR device, professional-grade VR device or other electronic devices with virtual reality content playback function, etc., and this application does not limit the type of VR device. Among them, PC end VR device can also be called external wearable device, which needs to be connected to a computer when in use; all-in-one VR device integrates a processor, screen, etc., and does not need to be connected to other devices when in use; mobile end VR device can also be called VR glasses box, by putting a mobile phone into the mobile end VR device to realize VR function; professional-grade VR device can refer to VR device used in specific industry fields.

[0066] Figure 1 The server 10b shown can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms. This application does not limit the type of server.

[0067] In one possible implementation, Figure 1 The client can be installed in the VR device shown. When the client runs in the VR device, it can communicate with Figure 1 Data is exchanged between the servers 10b shown. Among them, the client installed in the VR device can integrate a VR playback plug-in, which can be used to support the playback of virtual reality content, and the virtual reality content can be a 3D stereo video. The client in the VR device can include but is not limited to: a short video client, a live broadcast client, a video player, a game client, etc.

[0068] Optionally, when Figure 1 When the client installed in the VR device shown is a video player, Figure 1 The server 10b shown can be a background server corresponding to the video player; the server 10b can transmit video data to the video player in the VR device 10a, and after the video player receives the video data, the video player can play the video data in the video player through the VR playback plug-in integrated in the video player. Optionally, when the client in the VR device 10a is a live client, the server 10b can be a background server corresponding to the live client; the server 10b can transmit live video data to the live client in the VR device 10a, and after the live client in the VR device 10a receives the live video data, the live video data can be played in the live client through the VR playback plug-in in the live client, and so on.

[0069] See also Figure 2 , Figure 2 Schematic diagram of a data display method provided in an embodiment of the present application. Figure 2 The transmission process of immersive media (specifically VR video data) between the VR device 20a and the server 20b shown in the figure can be carried out based on various transmission protocols. The transmission protocols here may include but are not limited to: DASH (Dynamic Adaptive Streaming over HTTP, dynamic adaptive streaming media transmission) protocol, HLS (HTTP Live Streaming, dynamic bit rate adaptive transmission) protocol, SMTP (Smart Media Transport Protocaol, smart media transmission protocol), TCP (Transmission Control Protocol, transmission control protocol), etc.

[0070] like Figure 2The VR device 20a shown may be installed with a video player, which may determine the orientation and position of the user based on the positioning information of the user's head, eyes, and body, and then request the server 10b to obtain the corresponding video file based on the determined orientation and position. The video file here may include any one of video data and image data, and optionally, may also include audio data. The video file may be transmitted from the server 20b to the video player in the VR device 20a through a transmission mechanism (e.g., DASH, HLS, etc.).

[0071] like Figure 2 As shown, assuming that the VR device 20a is a VR glasses, the user can wear the VR device on the eyes and start the video player in the VR device. At this time, the user can enter the immersive space, in which a three-dimensional model is displayed within a 360-degree range with the VR device 20a as the center. In this case, it can be considered that the immersive space is represented by a three-dimensional model, and the VR device 20a (such as VR glasses) worn by the user is in the center of the three-dimensional model.

[0072] See also Figure 3a and Figure 3b , Figure 3a This is a schematic diagram of a three-dimensional model provided in an embodiment of the present application. Figure 1 ; Figure 3a The three-dimensional model shown is a cube model, that is, the immersive space (three-dimensional space) can be defined as a space composed of a cube, each face of the cube model can become a face, and the user can wear the VR device 20a to watch the video content of the video file in the center of the cube model. Figure 3a The cube model shown may include 8 vertices, which are respectively recorded as vertex A, vertex B, vertex C, vertex D, vertex E, vertex F, vertex G and vertex H; the cube model may form 6 faces through the above 8 vertices, which are respectively recorded as face ABCD, face ABGH, face HGFE, face DCFE, face BCFG and face ADEH. In the immersive space formed by the cube model, the center point of the cube model can be used as the origin of the coordinate system (such as Figure 3a A spatial coordinate system (including the X-axis, Y-axis and Z-axis) is established with the point O shown in the figure; after the user enters the immersive space, the VR device worn by the user is at the origin O of the spatial coordinate system, and the user's initial perspective can be the display content of the faces ABGH in the cube model.

[0073] Figure 3b This is a schematic diagram of a three-dimensional model provided in an embodiment of the present application. Figure 2 ; Figure 3bThe three-dimensional model shown is a spherical model, that is, the immersive space can be defined as a space composed of a sphere; the spherical model can also divide the entire screen into 6 parts (similar to the above Figure 3a The user can wear the VR device 20a to watch the video content of the video file in the center of the cube model, and the user's initial perspective can be to watch the display content of one surface of the spherical model. Figure 3a The cube model shown in the immersive space formed by the spherical models does not deform when the user moves.

[0074] like Figure 2 As shown in Figure 1, when the user enters the immersive space, the display content of the initial perspective can be as follows: Figure 2 In the second area 20d of the first area 20c, multiple selectable space types can be displayed for the user, such as but not limited to: Show Tile Space, Show FOVSpace, Show Globe Space, etc. The user can select a suitable display method from the above multiple display methods according to their own needs to watch the video content corresponding to the video file.

[0075] For example, if the user only needs to watch a specific area of ​​a scene or map, the user can choose to display the tile space (Show Tile Space) to watch the video content (or image content) in the video file. If the user's position is fixed, the user can choose to display the field of view space (Show FOV Space). If the user's position is constantly changing, the user can choose to display the sphere space (Show Globe Space) to watch the video content in the video file. This ensures that when the user turns his head to switch the perspective in the immersive space, the display screen in the video player of the VR device 20a is seamlessly connected, which can improve the video display effect of the video player.

[0076] See also Figure 4 , Figure 4 This is a flow chart of a data display method provided in an embodiment of the present application. Figure 1 It can be understood that the data display method can be executed by a computer device, for example, the computer device can be Figure 1 The VR device 10a shown in the figure is not limited in this application. Figure 4 As shown, the data display method may include the following steps S101 to S103:

[0077] Step S101, obtain the texture image in the player, load the curved body model stored in the three-dimensional model storage carrier, and obtain the texture coordinates corresponding to each vertex of the curved body model; the curved body model is obtained by transforming the polyhedron model.

[0078] Among them, the player may refer to software or equipment used to play various multimedia files; the player may include an audio player, a video player, etc. Among them, the audio player can be used to play audio files, such as MP3 (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Compression Standard Audio Layer 3), WAV (WaveFom, a waveform audio file format), etc. The video player can be used to play video files, such as MP4 (Moving Picture Experts Group 4, Moving Picture Experts Group), AVI (Audio Video Interleave, Audio Video Interleave Format), MKV (Matroska Video, Matroska Multimedia Container), etc. For example, the video player can be used to watch various video content such as movies, TV series, short videos, etc.; the video player can also be used to play audio files. It should be understood that the different platforms on which the player runs indicate different types of players. For example, the player can be divided into video player software on a computer, player applications on mobile devices such as mobile phones and tablets, and dedicated hardware players. The embodiment of the present application is described by taking the player running in a VR device as an example.

[0079] A texture image refers to an image containing various details and patterns; for example, the texture image in the embodiment of the present application may be a video frame decoded by a player. A three-dimensional model storage carrier may refer to a carrier used to store a three-dimensional model and related information thereof (for example, the geometric structure, material, texture coordinates, etc. of the three-dimensional model); for example, the three-dimensional model storage carrier may include but is not limited to: a network server, a database, a cloud storage, a computer hard disk, a solid-state hard disk, a three-dimensional model file, etc.; wherein the three-dimensional model file may be a usdz (a specific compressed and encrypted file format of USD (Universal Scene Description)) file; optionally, the storage format of the three-dimensional model in the three-dimensional model storage carrier may be an obj (three-dimensional model file format) format.

[0080] A curved surface model may refer to a three-dimensional model whose surface is not composed of planar polygons; a curved surface model may include, but is not limited to, a spherical model, a cylindrical model, a torus model, a rugby ball model, etc. A polyhedral model may refer to a three-dimensional model whose surface is composed of planar polygons; a polyhedral model may include, but is not limited to, a cube model, a tetrahedral model, a prism model, a pyramid model, etc. For ease of understanding, the present application embodiment is described by taking the polyhedral model as a cube model and the curved surface model as a spherical model as an example.

[0081] Texture coordinates are coordinates used to locate specific locations on a texture image; texture coordinates can usually be expressed in the form of (u, v), where u represents the horizontal coordinate and v represents the vertical coordinate. Texture coordinates can be used to accurately map a texture image to the surface of a 3D model to achieve texture rendering effects.

[0082] Specifically, a video file is obtained through a player running in a VR device; the video file may be a video file provided by a server (for example, Figure 1 The server 10b) shown in the figure transmits the video to the player through a transmission mechanism, or may be transmitted to the player by an external capture device (for example, a camera device, a sensor device, etc.), or may be a video file stored locally on the VR device. This application does not limit the method for obtaining the video file.

[0083] The encapsulation format of the video file can be identified, and the encapsulation format can be any one of the video formats such as MP4, MKV, AVI, etc. By identifying the encapsulation format of the video file, the audio code stream and the video code stream in the video file are separated to obtain the video code stream contained in the video file. The encoding mode information corresponding to the video code stream is obtained, and the data in the video code stream is decoded according to the encoding mode information to obtain a texture image. Among them, the encoding mode information is a description and indication of the video encoding method, such as details of the video encoding method, parameter settings, data structure, etc.; the encoding mode information may include the encoding mode of each video frame in the video file, such as H.264 (Advanced Video Coding), H.265 (HEVC High Efficiency Video Coding), etc. The video code stream in the video file is decoded frame by frame according to the encoding mode information to obtain decoded video frames, and these decoded video frames can be used as texture images.

[0084] When the player provides a texture image, a pre-stored curved body model can be obtained from a three-dimensional model storage carrier, and the curved body model can be loaded to obtain the model data corresponding to the curved body model; the model data may include the vertices of all polygons constituting the curved body model, and the texture coordinates corresponding to each vertex. Among them, each vertex of the curved body model can be represented by spatial coordinates (such as three-dimensional spatial coordinates), and the spatial coordinates of each vertex can be called vertex coordinate information. In other words, the model data may include vertex coordinate information corresponding to each vertex of the curved body model, and texture coordinates corresponding to each vertex. Among them, the polygons constituting the curved body model may be any one of triangles, quadrilaterals, pentagons, etc., and this application does not limit this.

[0085] It should be noted that the curved body model involved in the embodiment of the present application is obtained by transforming a polyhedron model. Since the generation of a cube model is very simple, only 8 vertices are needed to form 6 faces to generate a cube model; then the texture image can be sampled and the texture image can be attached to the 6 faces of the cube model. By transforming the cube model, a curved body model is obtained, and the texture coordinates corresponding to the vertices of all polygons constituting the curved body model are pre-calculated. This ensures that the texture coordinates corresponding to the vertices of each polygon of the curved body model are on the same face of the cube model, thereby avoiding distortion in texture rendering and improving texture rendering effects. Among them, the process of transforming a polyhedron model into a curved body model will be described in detail in subsequent steps.

[0086] Step S102: sampling the texture image according to the texture coordinates corresponding to each vertex of the curved surface model to obtain texture color information corresponding to the curved surface model.

[0087] The texture color information may refer to the color information of each pixel in the texture image; in the embodiment of the present application, the texture color information may refer to the texture color value sampled from the texture image for each vertex on the surface of the curved body model. The corresponding positions of each vertex of the curved body model in the texture image may be determined based on the texture coordinates corresponding to the vertices of all polygons constituting the curved body model, and the texture color value of the corresponding position in the texture image may be obtained. The texture color value at this time may be referred to as the texture color information corresponding to the curved body model.

[0088] Specifically, in the texture rendering process, the texture color information can be sampled from the texture image according to the texture coordinates corresponding to each vertex of the curved body model; wherein the process of acquiring the texture color information can be understood as the process of performing texture mapping on each polygon of the curved body model. It can be understood that the texture mapping process of each polygon of the curved body model is the same. For ease of understanding, the following description is made by taking a polygon of the curved body model as an example.

[0089] In the texture rendering process, by loading the pre-calculated curved body model, the spatial coordinates (usually three-dimensional spatial coordinates) and texture coordinates of the vertices of all polygons constituting the curved body model can be obtained, and the texture coordinates of any point in the polygon usually need to be interpolated. In a feasible implementation, when performing the interpolation process, the centroid coordinates of the polygon b of the curved body model can be obtained, and the interpolation process is performed according to the centroid coordinates and the texture coordinates corresponding to the vertices of the polygon b to obtain the interpolated texture coordinates of the polygon b; according to the texture coordinates corresponding to each vertex of the curved body model and the interpolated texture coordinates of each polygon of the curved body model, the texture image is sampled to obtain the texture color information corresponding to the curved body model.

[0090] The above interpolation processing may be any one of bilinear interpolation, nearest neighbor interpolation, bicubic interpolation, and Lanczos interpolation (a scaling interpolation method), and the present application does not limit this. Polygon b may be any polygon of the surface model, and the centroid coordinates of the polygon here may be the spatial coordinates of the centroid of polygon b in three-dimensional space. For example, the three-dimensional spatial coordinates corresponding to the centroid of polygon b, i.e., the centroid coordinates of polygon b, may be calculated based on the vertex coordinate information (three-dimensional spatial coordinates) corresponding to each vertex of polygon b. The centroid coordinates of polygon b may be recorded as .

[0091] It can be understood that any point in the plane where the polygon b is located can be represented by a linear combination of the coordinates of any three vertices of the polygon b, such as = ,in ,and The values ​​of are all greater than 0. , , It can be expressed as the texture coordinates of any three vertices of polygon b. Can be used to limit the calculated points belongs to the plane where polygon b lies, The values ​​of are all greater than 0 and can be used to limit the calculated points Belongs to polygon b. In this embodiment of the present application, the points obtained by the above calculation can be Determined as the interpolated texture coordinates for polygon b.

[0092] Among them, the calculation method of the centroid coordinates of polygon b may include but is limited to: determining the centroid of polygon b of the surface model, connecting the centroid and the vertices of polygon b, and dividing polygon b into multiple sub-polygons; obtaining the first area of ​​polygon b and the second area corresponding to each sub-polygon, and determining the ratio between the second area and the first area as the centroid coordinates of polygon b.

[0093] For example, if polygon b is triangle ACD, then the centroid of triangle ACD and the vertices of the triangle (i.e., vertex A, vertex C, and vertex D) can be connected in sequence, so that triangle ACD can be divided into three sub-triangles, which are the sub-triangles corresponding to the three sides of triangle ACD, such as the sub-triangle corresponding to side AC, the sub-triangle corresponding to side AD, and the sub-triangle corresponding to side CD. Furthermore, the area of ​​each sub-triangle can be calculated by cross multiplication, such as the area of ​​the sub-triangle corresponding to side AC can be recorded as , the area of ​​the sub-triangle corresponding to side AD can be recorded as , the area of ​​the sub-triangle corresponding to side CD can be recorded as , the above , as well as The area of ​​triangle ACD is equal to the sum of the areas of the three sub-triangles mentioned above, that is, the first area can be expressed as: Assumptions , , , then we can Determine the coordinates of the center of gravity of triangle ACD.

[0094] Step S103: rendering the curved surface model according to the texture color information, and displaying the texture rendering result of the curved surface model in the virtual reality environment.

[0095] Specifically, the curved body model can be drawn according to the texture color information corresponding to the curved body model to obtain the texture rendering result of the curved body model, and the texture rendering result of the curved body model can be displayed in the player of the VR device. Optionally, in the texture rendering process of the curved body model, the texture color information corresponding to the curved body model can be drawn in combination with the material of the curved body model and the lighting information of each vertex to obtain the texture rendering result corresponding to the curved body model. For each video frame in the video file, texture rendering can be performed in the above manner, and then the entire video content in the video file can be displayed in the virtual reality environment (player of the VR device).

[0096] See also Figure 5 , Figure 5 is a flow chart of a video content rendering process provided by an embodiment of the present application; Figure 5 As shown, the video content rendering process may involve a player in a VR device, and the player may integrate internal plug-ins such as a VR playback plug-in and a 3D model generator. The video content rendering process may also involve an application. Among them:

[0097] The player in the VR device can integrate a three-dimensional model generator, which can pre-calculate a curved body model. The curved body model can be transformed from a polyhedron model. The process of transforming a polyhedron model into a curved body model will be described in the subsequent content. Optionally, the curved body model can also be passed into the player by an application, and the generation method of the curved body model passed by the application is the same as the generation method of the curved body model pre-calculated by the three-dimensional model generator. After the curved body model is pre-calculated by the application or the three-dimensional model generator integrated in the three-dimensional player, the pre-calculated curved body model can be loaded to obtain the model data of the curved body model. Among them, the loaded curved body model can be a curved body model pre-calculated by the three-dimensional model generator integrated in the player, or it can be a curved body model passed in by the application, and this application does not limit this. The model data may include the vertices of all polygons constituting the curved body model, and the texture coordinates corresponding to each vertex.

[0098] When the player provides a texture image (the texture image is two-dimensional), the curved body model can be mapped through the VR playback plug-in integrated in the player; mapping here can refer to the process of attaching the texture image to the surface of the curved body model and displaying it. According to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled, and the texture image is attached to the surface of the curved body model to obtain the texture rendering result of the curved body model, and the texture rendering result of the curved body model is displayed using the VR playback plug-in integrated in the player; the process of determining the texture rendering result can refer to the relevant description in step S102 and step S103, which will not be repeated here.

[0099] Optionally, in the video content display scheme involved in the embodiment of the present application, the texture rendering efficiency can be improved by pre-calculating the curved surface model. Optionally, in the texture rendering process, the curved surface model can be created in real time by directly transforming the polyhedron model, which can reduce the computational overhead of the GPU (Graphic Processing Unit) compared to the traditional curved surface model creation method.

[0100] In an embodiment of the present application, by transforming a polyhedron model into a curved body model and pre-calculating the texture coordinates of all vertices of the curved body model, the vertices of the curved body model and the texture coordinates of the vertices can be stored in a three-dimensional model storage carrier; by pre-calculating the curved body model (including the vertices of the polygons constituting the curved body model and the texture coordinates of each vertex), the computational overhead in the texture rendering process can be reduced. When the player provides a texture image, the curved body model stored in the three-dimensional model storage carrier can be loaded to obtain the texture coordinates corresponding to each vertex of the curved body model; according to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled, and the texture image is applied to the surface of the curved body model, and the texture rendering result of the curved body model is displayed in a virtual display environment. Since the texture coordinates of each vertex of the curved body model can be obtained by loading the pre-calculated curved body model during the texture rendering process, the texture rendering efficiency can be improved.

[0101] See also Figure 6 , Figure 6 This is a flow chart of a data display method provided in an embodiment of the present application. Figure 2 It can be understood that the data display method can be executed by a computer device, for example, the computer device can be Figure 1 The VR device 10a shown in the figure is not limited in this application. Figure 6 As shown, the method may include the following steps S201 to S205:

[0102] Step S201, obtain a polyhedron model, decompose each face of the polyhedron model into multiple polygons, determine the mapping points of the vertices of the multiple polygons in each face on the curved surface, and determine the curved surface carrying the multiple mapping points as an initial three-dimensional model.

[0103] Specifically, a polyhedron model can be obtained; wherein, a polyhedron model can generate multiple faces through multiple vertices, and the multiple faces can constitute a polyhedron model; for example, a cube model can generate 6 faces through 8 vertices, and these 6 faces can constitute a cube model. Each face of the polyhedron model is decomposed into multiple polygons, and then each vertex of the multiple polygons in each face of the polyhedron model can be mapped to the curved body, that is, the mapping points of the vertices of each polygon in each face of the curved body model are determined on the curved body, and the curved body carrying multiple mapping points can be called an initial three-dimensional model.

[0104] It can be understood that multiple polygons in each face of a polyhedron model can be mapped in the same way. For ease of understanding, the embodiment of the present application is described by taking any face in a polyhedron model (for example, the i-th face of the polyhedron model, where i is a positive integer) as an example.

[0105] In a feasible implementation, the i-th face of the polyhedron model can be decomposed into multiple polygons, and the vertex coordinate information of the multiple polygons in the i-th face can be obtained. The vertex coordinate information can refer to the three-dimensional space coordinates of the vertices of the multiple polygons in the i-th face, such as the vertex coordinate information corresponding to the vertex of each polygon can include the x-axis coordinate, the y-axis coordinate and the z-coordinate; i can be a positive integer less than or equal to M, and M can be expressed as the number of faces of the polyhedron model; for example, when the polyhedron model is a cube model, M can be 6.

[0106] Normalize the vertex coordinate information to obtain normalized coordinate information, and determine the spatial point corresponding to the normalized coordinate information as the mapping point of the vertices of multiple polygons in the i-th face on the curved surface. The normalization of the vertex coordinate information may include but is not limited to: determining the length between the vertex a of multiple polygons in the i-th face and the origin of the coordinate system based on the vertex coordinate information; dividing the vertex coordinate information corresponding to the vertex a by the length to obtain the normalized coordinate information corresponding to the vertex a. The length between the vertex a of multiple polygons in the i-th face and the origin of the coordinate system may refer to the length of the vector from the origin of the coordinate system to the vertex a.

[0107] It is understandable that the goal of the normalization process is to find a mapping so that the points in the i-th face of the polyhedron model can be more evenly distributed on the sphere. For ease of understanding, the present embodiment of the application takes the decomposition of each face of the polyhedron model into triangles (the triangles in this case are the polygons of each face of the polyhedron model) as an example for explanation. Figure 7 , Figure 7 This embodiment of the present application provides a schematic diagram of transforming a polyhedron model into a curved surface model. Figure 1 .like Figure 7 As shown, assuming that the polyhedron model is a cube model and the curved surface model is a sphere model, the exact center of the polyhedron model can be used as the origin of the spatial coordinate system. Starting from the origin of the spatial coordinate system, any ray can be emitted; when this ray passes through the vertex a1 in the i-th face of the polyhedron model (for example, the cube model) and the point a2 on the surface of the curved surface (for example, the sphere), the point a2 can be determined as the mapping point of the vertex a1 on the sphere. At this time, the three-dimensional spatial coordinates of point a2 can be the above-mentioned normalized coordinate information. By dividing the three-dimensional spatial coordinates of the vertex a1 in the curved surface model by the length between the vertex a1 and the origin of the coordinate system, the three-dimensional spatial coordinates of the point b1 can be obtained.

[0108] For any vertex in the ith face of the polyhedron model, the above method can be used to map all vertices in the ith face. After completing the mapping of the vertices in the ith face, the vertices in the next face of the polyhedron model (for example, the i+1th face) can be mapped until the vertices in all faces of the polyhedron model (for example, the 6 faces of the cube model) are mapped. The mapping points obtained after the mapping is completed can form a sphere, and this sphere formed by the mapping points can be called the initial three-dimensional model 20a.

[0109] Optionally, in a feasible implementation, the i-th face of the polyhedron model is decomposed into multiple polygons, and vertex coordinate information corresponding to multiple polygons in the i-th face is obtained; i is a positive integer less than or equal to M, and M represents the number of faces of the polyhedron model; the surface body mapping coefficients of the vertex coordinate information in D spatial dimensions are obtained, and the transformation coordinate information corresponding to the vertex coordinate information is determined according to the surface body mapping coefficients and the D coordinate values ​​in the vertex coordinate information; one coordinate value in the vertex coordinate information corresponds to one spatial dimension, and D is a positive integer; the spatial point corresponding to the transformation coordinate information is determined as the mapping point of the vertices of the multiple polygons in the i-th face on the curved body. Among them, the curved body mapping coefficient represents the mapping coefficient of the vertices of the multiple polygons in each face of the polyhedron model to the curved body, or can be understood as the transformation weight; the curved body mapping coefficient may include the mapping coefficients of the vertices in each face of the polyhedron model in D spatial dimensions. The transformed coordinate information may include the three-dimensional spatial coordinates of the mapping points of the vertices of the multiple polygons in the i-th face on the curved surface. In this case, D may be 3, and the D spatial dimensions are the x-axis, the y-axis, and the z-axis.

[0110] Among them, the method for determining the surface body mapping coefficient may include but is not limited to: obtaining the coordinate values ​​on D spatial dimensions in the vertex coordinate information, and determining the coordinate values ​​on the spatial dimensions other than the j-th spatial dimension among the D spatial dimensions as reference values; j is a positive integer less than or equal to D; determining the surface body mapping coefficient corresponding to the j-th spatial dimension based on the square product of the reference values ​​and the sum of the squares of the reference values.

[0111] For example, when D takes a value of 3, the vertex coordinate information of each vertex in the polyhedron model can be considered as a three-dimensional space coordinate, which includes coordinate values ​​on the x-axis, y-axis, and z-axis, that is, coordinate values ​​on three spatial dimensions. At this time, the surface mapping coefficients may include mapping coefficients of vertices on the polyhedron model in three spatial dimensions, such as the mapping coefficient corresponding to the x-coordinate value of the vertex, the mapping coefficient corresponding to the y-coordinate value, and the mapping coefficient corresponding to the z-coordinate value. When calculating the mapping coefficient corresponding to the x-coordinate value, the y-coordinate value and the z-coordinate value of the vertex can be determined as reference values; similarly, when calculating the mapping coefficient corresponding to the y-coordinate value, the x-coordinate value and the z-coordinate value of the vertex can be determined as reference values; when calculating the mapping coefficient corresponding to the z-coordinate value, the x-coordinate value and the z-coordinate value can be determined as reference values.

[0112] See also Figure 8 , Figure 8 This embodiment of the present application provides a schematic diagram of transforming a polyhedron model into a curved surface model. Figure 2 .like Figure 8 As shown in the figure, it is assumed that the polyhedron model is a cube model and the curved surface model is a sphere model. Figure 8The vertex b1 in the i-th face of the polyhedron model shown can obtain the surface body mapping coefficient corresponding to the vertex b1. By multiplying the surface body mapping coefficient with the three-dimensional space coordinates of the vertex b1, the three-dimensional space coordinates of the mapping point can be calculated. If the three-dimensional space coordinates at this time are the coordinates of point b2, then point b2 can be determined as the mapping point of vertex b1 on the sphere.

[0113] like Figure 8 As shown, assume that the three-dimensional coordinates of vertex b1 in the i-th face of the polyhedron model are , then the three-dimensional space coordinates of point b2 can be expressed as the following formula (1):

[0114] (1)

[0115] Among them, in formula (1) It can be expressed as the three-dimensional space coordinates of the mapping point b2 of vertex b1, represents the surface body mapping coefficient of vertex b1 on the x-axis, Represents the surface body mapping coefficient of vertex b1 on the y-axis, Represents the surface volume mapping coefficient of vertex b1 on the z-axis.

[0116] For any vertex in the i-th face of the polyhedron model, the mapping method shown in the above formula (1) can be used to map all the vertices in the i-th face. After completing the mapping of the vertices in the i-th face, the vertices in the next face of the polyhedron model (for example, the i+1-th face) can be mapped until the vertices in all faces of the polyhedron model (for example, the 6 faces of the cube model) are mapped. The mapping points obtained after the mapping is completed can form a sphere, and this sphere formed by the mapping points can be called the initial three-dimensional model 20b.

[0117] Step S202, obtaining texture coordinates corresponding to each mapping point of the initial three-dimensional model, determining the initial three-dimensional model with the texture coordinates as a curved surface model, and storing the curved surface model in a three-dimensional model storage carrier.

[0118] Specifically, the vertex coordinate information corresponding to each mapping point of the initial three-dimensional model can be obtained, and the three-dimensional vertex coordinate information can be directly converted into two-dimensional texture coordinates. After the texture coordinates corresponding to each mapping point of the initial three-dimensional model are obtained, the initial three-dimensional model with the texture coordinates can be determined as a curved body model; the curved body model at this time can be stored in a three-dimensional model storage carrier; that is, the curved body model stored in the three-dimensional model storage carrier can include the vertices of all polygons constituting the curved body model (for example, they can be represented by three-dimensional space coordinates), and the texture coordinates corresponding to each vertex.

[0119] In a feasible implementation, the vertex coordinate information corresponding to each mapping point of the initial three-dimensional model can be converted into spherical coordinate information, and then the texture coordinates of each mapping point can be calculated based on the spherical coordinates. Specifically, the polar angle and azimuth angle in the spherical coordinate information can be mapped to the texture coordinate range to obtain the texture coordinates corresponding to each mapping point of the initial three-dimensional model; and then the initial three-dimensional model with texture coordinates can be determined as a curved surface model.

[0120] The spherical coordinate information may refer to the spherical coordinates of each mapping point of the initial three-dimensional model in the spherical coordinate system, and the spherical coordinates may include the radius, polar angle, and azimuth of the sphere; wherein the polar angle represents the angle between the mapping point and the positive direction of the z-axis, and the azimuth represents the angle between the projection of the mapping point on the xy plane (the plane where the x-axis and the y-axis are located) and the positive direction of the z-axis. The texture coordinate range may refer to a range from -1 to 1, such as the texture coordinate may be a range where both the polar angle and the azimuth in the spherical coordinate information are mapped to a range from -1 to 1.

[0121] For example, the polar angle in the spherical coordinate information can be directly divided by 180 and added with 0.5 to obtain the texture coordinate value of the mapping point in the vertical direction, that is, the v value in the texture coordinate; the azimuth angle in the spherical coordinate information can be divided by 360 to obtain the texture coordinate value of the mapping point in the horizontal direction, that is, the u value in the texture coordinate; it can be understood that the above-mentioned method of calculating the texture coordinates is only an example of an embodiment of the present application, and the present application does not limit the method of calculating the texture coordinates.

[0122] Step S203, obtain the texture image in the player, load the curved body model stored in the three-dimensional model storage carrier, and obtain the texture coordinates corresponding to each vertex of the curved body model; the curved body model is obtained by transforming the polyhedron model.

[0123] Step S204: sampling the texture image according to the texture coordinates corresponding to each vertex of the curved surface model to obtain texture color information corresponding to the curved surface model.

[0124] Step S205: rendering the curved surface model according to the texture color information, and displaying the texture rendering result of the curved surface model in the virtual reality environment.

[0125] The specific implementation process of step S203 to step S205 can be found in Figure 4 The relevant descriptions of steps S101 to S103 in the corresponding embodiment will not be repeated here.

[0126] In the embodiment of the present application, by transforming the polyhedron model into a curved body model and pre-calculating the texture coordinates of all vertices of the curved body model, the vertices of the curved body model and the texture coordinates of the vertices can be stored in the three-dimensional model storage carrier. By transforming the polyhedron model into a curved body model, it can be ensured that the texture coordinates corresponding to the vertices of each polygon of the curved body model are all within a certain face of the polyhedron model, thereby avoiding distortion of the final texture rendering result, thereby improving the texture rendering effect; by pre-calculating the curved body model (including the vertices of the polygons constituting the curved body model, and the texture coordinates of each vertex), the computational overhead in the texture rendering process can be reduced (such as reducing the computational overhead of the GPU). When the player provides a texture image, the curved body model stored in the three-dimensional model storage carrier can be loaded to obtain the texture coordinates corresponding to each vertex of the curved body model; according to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled, the texture image is applied to the surface of the curved body model, and the texture rendering result of the curved body model is displayed in the virtual display environment. Since the texture coordinates of each vertex of the surface body model can be obtained by loading the pre-calculated surface body model during the texture rendering process, the texture rendering efficiency can be improved. In addition, since the pre-calculated surface body model is used in the texture rendering process, there is no need to use customized shaders in the texture rendering process, which can reduce operating costs.

[0127] It is understandable that in the specific implementation of this application, related information such as the user's video playback records, game records, personal account passwords, etc. may be involved. When the above embodiments of this application are applied to specific products or technologies, it is necessary to obtain the permission or consent of the relevant institutions or departments, or the users themselves, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of the relevant regions.

[0128] See also Fig. 9 , Fig. 9 This is a schematic diagram of a data display device provided in an embodiment of the present application. Figure 1 .like Fig. 9 As shown, the data display device 1 may include: a loading module 101, a sampling module 102, and a drawing module 103;

[0129] The loading module 101 is used to obtain the texture image in the player, load the curved surface model stored in the three-dimensional model storage carrier, and obtain the texture coordinates corresponding to each vertex of the curved surface model; the curved surface model is obtained by transforming the polyhedron model;

[0130] The sampling module 102 is used to sample the texture image according to the texture coordinates corresponding to each vertex of the curved surface model to obtain the texture color information corresponding to the curved surface model;

[0131] The rendering module 103 is used to render the curved surface model according to the texture color information, and display the texture rendering result of the curved surface model in the virtual reality environment.

[0132] According to an embodiment of the present application, the above Figure 4 The data display method shown involves the relevant steps that can be Fig. 9 The data display device 1 shown is executed by each module. For example, Figure 4 Step S101 shown can be performed by Fig. 9 The loading module 101 shown is executed, Figure 4 Step S102 shown can be performed by Fig. 9 The sampling module 102 shown is used to execute, Figure 4 Step S103 shown can be performed by Fig. 9 The drawing module 103 shown is used to perform the above operations.

[0133] According to one embodiment of the present application, Fig. 9 The various modules in the data display device 1 shown can be separately or completely combined into one or several modules to form, or one (some) of the modules can be further divided into at least two smaller units in terms of function, so as to achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above modules are divided based on logical functions. In practical applications, the functions of one module can also be realized by at least two units, or the functions of at least two modules can be realized by one module. In other embodiments of the present application, the data display device 1 can also include other modules or units. In practical applications, these functions can also be realized with the assistance of other modules, and can be realized by the collaboration of at least two modules.

[0134] In an embodiment of the present application, by transforming a polyhedron model into a curved body model and pre-calculating the texture coordinates of all vertices of the curved body model, the vertices of the curved body model and the texture coordinates of the vertices can be stored in a three-dimensional model storage carrier; by pre-calculating the curved body model (including the vertices of the polygons constituting the curved body model and the texture coordinates of each vertex), the computational overhead in the texture rendering process can be reduced. When the player provides a texture image, the curved body model stored in the three-dimensional model storage carrier can be loaded to obtain the texture coordinates corresponding to each vertex of the curved body model; according to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled, and the texture image is applied to the surface of the curved body model, and the texture rendering result of the curved body model is displayed in a virtual display environment. Since the texture coordinates of each vertex of the curved body model can be obtained by loading the pre-calculated curved body model during the texture rendering process, the texture rendering efficiency can be improved.

[0135] See also Fig.10 , Fig.10This is a schematic diagram of a data display device provided in an embodiment of the present application. Figure 2 .like Fig.10 As shown, the data display device 2 may include: a loading module 201, a sampling module 202, and a drawing module 203;

[0136] The loading module 201 is used to obtain the texture image in the player, load the curved surface model stored in the three-dimensional model storage carrier, and obtain the texture coordinates corresponding to each vertex of the curved surface model; the curved surface model is obtained by transforming the polyhedron model;

[0137] The sampling module 202 is used to sample the texture image according to the texture coordinates corresponding to each vertex of the curved surface model to obtain the texture color information corresponding to the curved surface model;

[0138] The rendering module 203 is used to render the curved surface model according to the texture color information, and display the texture rendering result of the curved surface model in the virtual reality environment.

[0139] In one or more embodiments, the data display device 1 may further include: a model creation module 204;

[0140] The model creation module 204 is used to obtain a polyhedral model, decompose each face of the polyhedral model into multiple polygons, determine the mapping points of the vertices of the multiple polygons in each face on the curved surface, and determine the curved surface carrying the multiple mapping points as an initial three-dimensional model;

[0141] The model creation model 204 is also used to obtain the texture coordinates corresponding to each mapping point of the initial three-dimensional model, determine the initial three-dimensional model with the texture coordinates as a curved surface model, and store the curved surface model in a three-dimensional model storage carrier; each mapping point of the initial three-dimensional model is each vertex of the curved surface model.

[0142] In one or more embodiments, the model creation module 204 decomposes each face of the polyhedral model into multiple polygons, and determines the mapping points of the vertices of the multiple polygons in each face on the curved body, so as to perform the following steps:

[0143] Decompose the i-th face of the polyhedron model into multiple polygons, and obtain vertex coordinate information of multiple polygons in the i-th face; i is a positive integer less than or equal to M, and M represents the number of faces of the polyhedron model;

[0144] The vertex coordinate information is normalized to obtain normalized coordinate information, and the space point corresponding to the normalized coordinate information is determined as the mapping point of the vertices of the multiple polygons in the i-th face on the curved surface.

[0145] In one or more embodiments, the model creation module 204 normalizes the vertex coordinate information to obtain normalized coordinate information for performing the following steps:

[0146] According to the vertex coordinate information, determine the length between the vertex a of the plurality of polygons in the i-th face and the origin of the coordinate system;

[0147] The vertex coordinate information corresponding to vertex a is divided by the length to obtain the normalized coordinate information corresponding to vertex a.

[0148] In one or more embodiments, the model creation module 204 decomposes each face of the polyhedral model into multiple polygons, and determines the mapping points of the vertices of the multiple polygons in each face on the curved body, so as to perform the following steps:

[0149] Decompose the i-th face of the polyhedron model into multiple polygons, and obtain vertex coordinate information corresponding to the multiple polygons in the i-th face; i is a positive integer less than or equal to M, and M represents the number of faces of the polyhedron model;

[0150] Obtaining the surface body mapping coefficients of the vertex coordinate information in D spatial dimensions, and determining the transformation coordinate information corresponding to the vertex coordinate information according to the surface body mapping coefficients and the D coordinate values ​​in the vertex coordinate information; one coordinate value in the vertex coordinate information corresponds to one spatial dimension, and D is a positive integer;

[0151] The space point corresponding to the transformed coordinate information is determined as the mapping point of the vertices of the multiple polygons in the i-th face on the curved surface.

[0152] In one or more embodiments, the model creation module 204 obtains the surface body mapping coefficients of the vertex coordinate information in D spatial dimensions to perform the following steps:

[0153] Obtain coordinate values ​​on D spatial dimensions from the vertex coordinate information, and determine the coordinate values ​​on the spatial dimensions other than the j-th spatial dimension among the D spatial dimensions as reference values; j is a positive integer less than or equal to D;

[0154] The surface volume mapping coefficient corresponding to the j-th spatial dimension is determined according to the square product of the reference values ​​and the square sum of the reference values.

[0155] In one or more embodiments, the model creation module 204 obtains texture coordinates corresponding to each mapping point of the initial three-dimensional model to perform the following steps:

[0156] Obtaining vertex coordinate information corresponding to each mapping point of the initial three-dimensional model, and converting the vertex coordinate information into spherical coordinate information;

[0157] The polar angle and azimuth angle in the spherical coordinate information are mapped to the texture coordinate range to obtain the texture coordinates corresponding to each mapping point of the initial three-dimensional model.

[0158] In one or more embodiments, the loading module 201 obtains a texture image in the player to perform the following steps:

[0159] Obtain the video file through the player, identify the packaging format of the video file, and obtain the video stream in the video file;

[0160] The encoding mode information corresponding to the video code stream is obtained, and the data in the video code stream is decoded according to the encoding mode information to obtain a texture image.

[0161] In one or more embodiments, the sampling module 202 samples the texture image according to the texture coordinates corresponding to each vertex of the curved body model to obtain texture color information corresponding to the curved body model, which is used to perform the following steps:

[0162] Obtaining the centroid coordinates of the polygon b of the curved surface model, and performing interpolation processing according to the centroid coordinates and the texture coordinates corresponding to the vertices of the polygon b to obtain the interpolated texture coordinates of the polygon b;

[0163] According to the texture coordinates corresponding to each vertex of the curved body model and the interpolated texture coordinates of each polygon of the curved body model, the texture image is sampled to obtain the texture color information corresponding to the curved body model.

[0164] In one or more embodiments, the sampling module 202 obtains the centroid coordinates of the polygon b of the surface model to perform the following steps:

[0165] Determine the centroid of the polygon b of the surface model, connect the centroid and the vertices of the polygon b, and divide the polygon b into a plurality of sub-polygons;

[0166] The first area of ​​polygon b and the second area corresponding to each sub-polygon are obtained, and the ratio between the second area and the first area is determined as the centroid coordinates of polygon b.

[0167] According to an embodiment of the present application, the above Figure 4 and Figure 6 The data display method shown involves the relevant steps that can be Fig.10 The data display device 2 shown in the figure is executed by each module. For example, Figure 6 Step S201 and step S202 shown in FIG. Fig.10 The model creation module 204 shown is used to perform the following.

[0168] According to one embodiment of the present application, Fig.10The various modules in the data display device 2 shown can be combined into one or several modules separately or in whole, or one (some) of the modules can be further divided into at least two smaller units in function, so as to achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above modules are divided based on logical functions. In practical applications, the functions of one module can also be realized by at least two units, or the functions of at least two modules can be realized by one module. In other embodiments of the present application, the data display device 2 can also include other modules or units. In practical applications, these functions can also be realized with the assistance of other modules, and can be realized by the collaboration of at least two modules.

[0169] In the embodiment of the present application, by transforming the polyhedron model into a curved body model and pre-calculating the texture coordinates of all vertices of the curved body model, the vertices of the curved body model and the texture coordinates of the vertices can be stored in the three-dimensional model storage carrier. By transforming the polyhedron model into a curved body model, it can be ensured that the texture coordinates corresponding to the vertices of each polygon of the curved body model are all within a certain face of the polyhedron model, thereby avoiding distortion of the final texture rendering result, thereby improving the texture rendering effect; by pre-calculating the curved body model (including the vertices of the polygons constituting the curved body model, and the texture coordinates of each vertex), the computational overhead in the texture rendering process can be reduced (such as reducing the computational overhead of the GPU). When the player provides a texture image, the curved body model stored in the three-dimensional model storage carrier can be loaded to obtain the texture coordinates corresponding to each vertex of the curved body model; according to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled, the texture image is applied to the surface of the curved body model, and the texture rendering result of the curved body model is displayed in the virtual display environment. Since the texture coordinates of each vertex of the surface body model can be obtained by loading the pre-calculated surface body model during the texture rendering process, the texture rendering efficiency can be improved. In addition, since the pre-calculated surface body model is used in the texture rendering process, there is no need to use customized shaders in the texture rendering process, which can reduce operating costs.

[0170] See also Fig.11 , Fig.11 Schematic diagram of the structure of a computer device provided in an embodiment of the present application. Fig.11 As shown, the computer device 1000 may be a terminal device, for example, Figure 1The VR device 10a in the corresponding embodiment. The computer device 1000 may include: a processor 1001, a network interface 1004 and a memory 1005. In addition, the computer device 1000 may also include: a user interface 1003, and at least one communication bus 1002. The communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk storage. The memory 1005 may optionally be at least one storage device located away from the aforementioned processor 1001. Fig.11 As shown, the memory 1005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application program.

[0171] The network interface 1004 in the computer device 1000 can also provide a network communication function, and the optional user interface 1003 can also include a display screen (Display) and a keyboard (Keyboard). Fig.11 In the computer device 1000 shown, the network interface 1004 can provide a network communication function; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call the device control application stored in the memory 1005 to achieve:

[0172] Acquire the texture image in the player, load the curved body model stored in the three-dimensional model storage carrier, and obtain the texture coordinates corresponding to each vertex of the curved body model; the curved body model is obtained by transforming the polyhedron model;

[0173] According to the texture coordinates corresponding to each vertex of the curved body model, the texture image is sampled to obtain the texture color information corresponding to the curved body model;

[0174] The surface model is drawn according to the texture color information, and the texture rendering result of the surface model is displayed in a virtual reality environment.

[0175] It should be understood that the computer device 1000 described in the embodiment of the present application can execute the above Figure 4 , Figure 6 The description of the data display method in any of the embodiments may also be performed as described above. Fig. 9 The description of the data display device 1 in the corresponding embodiment, or Fig.10The description of the data display device 2 in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of the same method will not be repeated here either.

[0176] In addition, it should be pointed out here that: the embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores a computer program executed by the data display device 1 or the data display device 2 mentioned above, and the computer program includes computer instructions. When the processor executes the computer instructions, it can execute the above-mentioned Figure 4 , Figure 6 The description of the data display method in any of the embodiments will not be repeated here. In addition, the description of the beneficial effects of the same method will not be repeated. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, program instructions can be deployed on a computer device for execution, or on multiple computer devices located at one location, or on multiple computer devices distributed at multiple locations and interconnected by a communication network. Multiple computer devices distributed at multiple locations and interconnected by a communication network can constitute a blockchain system.

[0177] In addition, it should be noted that: the embodiment of the present application also provides a computer program product, which may include a computer program, and the computer program may be stored in a computer-readable storage medium. The processor of the computer device reads the computer program from the computer-readable storage medium, and the processor may execute the computer program, so that the computer device performs the above Figure 4 , Figure 6 The description of the data display method in any of the embodiments is omitted here. In addition, the description of the beneficial effects of the same method is omitted here. For technical details not disclosed in the computer program product or computer program embodiment involved in the present application, please refer to the description of the method embodiment of the present application.

[0178] The terms "first", "second", etc. in the description, claims, and drawings of the embodiments of the present application are used to distinguish different media contents, rather than to describe a specific order. In addition, the term "comprising" and any variation thereof are intended to cover non-exclusive inclusions. For example, a process, method, device, product, or equipment comprising a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules that are not listed, or may optionally include other step units inherent to these processes, methods, devices, products, or equipment.

[0179] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0180] The method and related apparatus provided by the embodiment of the present application are described with reference to the method flow chart and / or structural diagram provided by the embodiment of the present application. Specifically, each process and / or box in the method flow chart and / or structural diagram, as well as the combination of the processes and / or boxes in the flow chart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data display device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data display device generate instructions for implementing the process in the process. Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data display device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in the process. Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions can also be loaded onto a computer or other programmable data display device, so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide for implementing the process. Figure 1 A flow or multiple flows and / or structures illustrate the steps of the functions specified in one block or multiple blocks.

[0181] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0182] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A data display method, characterized in that: include: Acquire a texture image in the player, load a curved surface model stored in a three-dimensional model storage carrier, and obtain texture coordinates corresponding to each vertex of the curved surface model; the curved surface model is obtained by transforming a polyhedron model; Sampling the texture image according to the texture coordinates corresponding to each vertex of the curved surface model to obtain texture color information corresponding to the curved surface model; Rendering the curved surface model according to the texture color information, and displaying the texture rendering result of the curved surface model in a virtual reality environment; Wherein, the method further comprises: Acquire the polyhedron model, decompose each face of the polyhedron model into multiple polygons, determine mapping points of vertices of the multiple polygons in each face on the curved surface, and determine the curved surface carrying the multiple mapping points as an initial three-dimensional model; The texture coordinates corresponding to each mapping point of the initial three-dimensional model are obtained, the initial three-dimensional model with the texture coordinates is determined as the curved body model, and the curved body model is stored in the three-dimensional model storage carrier; each mapping point of the initial three-dimensional model is each vertex of the curved body model.

2. The method according to claim 1, characterized in that Decomposing each face of the polyhedral model into a plurality of polygons and determining mapping points of vertices of the plurality of polygons in each face on the curved surface includes: Decomposing the i-th face of the polyhedron model into multiple polygons, and obtaining vertex coordinate information of the multiple polygons in the i-th face; i is a positive integer less than or equal to M, and M represents the number of faces of the polyhedron model; The vertex coordinate information is normalized to obtain normalized coordinate information, and the spatial point corresponding to the normalized coordinate information is determined as the mapping point of the vertices of the multiple polygons in the i-th face on the curved surface.

3. The method according to claim 2, characterized in that The step of normalizing the vertex coordinate information to obtain normalized coordinate information includes: Determine the length between the vertices a of the plurality of polygons in the i-th face and the origin of the coordinate system according to the vertex coordinate information; The vertex coordinate information corresponding to the vertex a is divided by the length to obtain normalized coordinate information corresponding to the vertex a.

4. The method according to claim 1, characterized in that: Decomposing each face of the polyhedral model into a plurality of polygons and determining mapping points of vertices of the plurality of polygons in each face on the curved surface includes: Decomposing the i-th face of the polyhedron model into multiple polygons, and obtaining vertex coordinate information corresponding to the multiple polygons in the i-th face; i is a positive integer less than or equal to M, and M represents the number of faces of the polyhedron model; Obtaining the curved surface body mapping coefficients of the vertex coordinate information in D spatial dimensions, and determining the transformed coordinate information corresponding to the vertex coordinate information according to the curved surface body mapping coefficients and the D coordinate values ​​in the vertex coordinate information; one coordinate value in the vertex coordinate information corresponds to one spatial dimension, and D is a positive integer; The spatial point corresponding to the transformed coordinate information is determined as a mapping point of the vertices of the multiple polygons in the i-th face on the curved surface.

5. The method according to claim 4, characterized in that The obtaining of the surface body mapping coefficients of the vertex coordinate information in D spatial dimensions includes: Obtain coordinate values ​​on D spatial dimensions from the vertex coordinate information, and determine coordinate values ​​on spatial dimensions other than the j-th spatial dimension among the D spatial dimensions as reference values; j is a positive integer less than or equal to D; The curved surface volume mapping coefficient corresponding to the j-th spatial dimension is determined according to the square product of the reference values ​​and the square sum of the reference values.

6. The method according to claim 1, characterized in that The obtaining of texture coordinates corresponding to each mapping point of the initial three-dimensional model includes: Acquire vertex coordinate information corresponding to each mapping point of the initial three-dimensional model, and convert the vertex coordinate information into spherical coordinate information; The polar angle and azimuth angle in the spherical coordinate information are mapped to a texture coordinate range to obtain texture coordinates corresponding to each mapping point of the initial three-dimensional model.

7. The method according to claim 1, characterized in that The step of obtaining a texture image in a player includes: Obtain a video file through a player, identify the encapsulation format of the video file, and obtain a video stream from the video file; The encoding mode information corresponding to the video code stream is obtained, and the data in the video code stream is decoded according to the encoding mode information to obtain a texture image.

8. The method according to claim 1, characterized in that The step of sampling the texture image according to the texture coordinates corresponding to each vertex of the curved surface model to obtain texture color information corresponding to the curved surface model includes: Obtaining the centroid coordinates of the polygon b of the curved surface model, and performing interpolation processing according to the centroid coordinates and the texture coordinates corresponding to the vertices of the polygon b to obtain the interpolated texture coordinates of the polygon b; The texture image is sampled according to the texture coordinates corresponding to each vertex of the curved surface model and the interpolated texture coordinates of each polygon of the curved surface model to obtain texture color information corresponding to the curved surface model.

9. The method according to claim 8, characterized in that The obtaining of the centroid coordinates of the polygon b of the curved surface model comprises: Determine the centroid of the polygon b of the curved surface model, connect the centroid and the vertices of the polygon b, and divide the polygon b into a plurality of sub-polygons; The first area of ​​the polygon b and the second area corresponding to each sub-polygon are obtained, and the ratio between the second area and the first area is determined as the centroid coordinates of the polygon b.

10. A data display device, characterized in that: include: A loading module, used to obtain a texture image in the player, load a curved surface model stored in a three-dimensional model storage carrier, and obtain texture coordinates corresponding to each vertex of the curved surface model; the curved surface model is obtained by transforming a polyhedron model; A sampling module, used to sample the texture image according to the texture coordinates corresponding to each vertex of the curved surface model, to obtain texture color information corresponding to the curved surface model; A rendering module, used for rendering the curved surface model according to the texture color information, and displaying the texture rendering result of the curved surface model in a virtual reality environment; The data display device further comprises: A model creation module, used to obtain the polyhedral model, decompose each face of the polyhedral model into multiple polygons, determine the mapping points of the vertices of the multiple polygons in each face on the curved surface, and determine the curved surface carrying the multiple mapping points as an initial three-dimensional model; The model creation model is also used to obtain the texture coordinates corresponding to each mapping point of the initial three-dimensional model, determine the initial three-dimensional model with the texture coordinates as the curved body model, and store the curved body model in the three-dimensional model storage carrier; each mapping point of the initial three-dimensional model is each vertex of the curved body model.

11. A computer device, characterized in that: including memory and processor; The memory is connected to the processor, the memory is used to store a computer program, and the processor is used to call the computer program so that the computer device executes the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 9.

13. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 9 when being executed by a processor.