Image Rendering Method, Device, Electronic Device, and Storage Medium

Abstract

The present disclosure provides an image rendering method, apparatus, electronic device, and storage medium, relating to the field of artificial intelligence technology, and particularly to the fields of computer vision and deep learning technology. The method includes: determining resolution information related to a target patch region and field of view information, obtaining a target tile map that matches the resolution information, and rendering the target tile map to the target patch region according to the target texture features of the target tile map to obtain a rendered image. Thus, it is possible to flexibly and adaptively render target tile maps with different resolution information. Since it is possible to dynamically render target tile maps with different resolution information, it is possible to dynamically adjust the memory occupancy required for image rendering, effectively reduce the memory occupied by image rendering, effectively improve the rendering efficiency of the image, enhance the rendering effect of the image, and effectively expand the application scenarios of image rendering.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, specifically to the fields of computer vision and deep learning technology, and particularly to an image rendering method, apparatus, electronic device, and storage medium. Background Art

[0002] Artificial intelligence is a discipline that studies how to make a computer simulate certain human thinking processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), including both hardware-level technologies and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include several major directions such as computer vision technology, speech recognition technology, natural language processing technology, and machine learning / deep learning, big data processing technology, and knowledge graph technology.

[0003] In related technologies, the rendering efficiency of panoramic images is not high, the rendering effect is poor, and the rendering method is not flexible enough. Summary of the Invention

[0004] The present disclosure provides an image rendering method, apparatus, electronic device, storage medium, and computer program product.

[0005] According to a first aspect of the present disclosure, there is provided an image rendering method, including: determining resolution information related to a target patch area and field of view information, obtaining a target tile map that matches the resolution information, and rendering the target tile map to the target patch area according to a target texture feature of the target tile map to obtain a rendered image.

[0006] According to a second aspect of the present disclosure, there is provided an image rendering apparatus, including: a first determination module configured to determine resolution information related to a target patch area and field of view information; a first acquisition module configured to obtain a target tile map that matches the resolution information; and a rendering module configured to render the target tile map to the target patch area according to a target texture feature of the target tile map to obtain a rendered image.

[0007] According to a third aspect of the present disclosure, there is provided an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the image rendering method as in the first aspect of the present disclosure.

[0008] According to a fourth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the image rendering method as in the first aspect of the present disclosure.

[0009] According to a fifth aspect of the present disclosure, there is provided a computer program product including a computer program which, when executed by a processor, implements the steps of the image rendering method according to the first aspect of the present disclosure.

[0010] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. Description of the Drawings

[0011] The drawings are used to better understand the solution and do not constitute a limitation to the present disclosure. Among them:

[0012] Figure 1 is a schematic diagram according to the first embodiment of the present disclosure;

[0013] Figure 2 is a schematic diagram according to the second embodiment of the present disclosure;

[0014] Figure 3 is a schematic diagram for confirming the actual resolution according to the embodiment of the present disclosure;

[0015] Figure 4 is a schematic diagram of hierarchical division according to the embodiment of the present disclosure;

[0016] Figure 5 is a schematic diagram according to the third embodiment of the present disclosure;

[0017] Figure 6 is a schematic diagram of a tree structure according to the embodiment of the present disclosure;

[0018] Figure 7 is a schematic diagram of the process of image rendering according to the embodiment of the present disclosure;

[0019] Figure 8 is a schematic diagram of an image rendering device according to the embodiment of the present disclosure;

[0020] Figure 9 is a schematic diagram according to the fourth embodiment of the present disclosure;

[0021] Figure 10 is a schematic diagram according to the fifth embodiment of the present disclosure;

[0022] Figure 11 shows a schematic block diagram of an exemplary electronic device used to implement the image rendering method according to the embodiment of the present disclosure. Detailed Embodiments

[0023] The following describes exemplary embodiments of the present disclosure with reference to the accompanying drawings. Various details of the embodiments of the present disclosure are included to facilitate understanding, and they should be considered merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, descriptions of well-known functions and structures are omitted in the following description for clarity and conciseness.

[0024] Figure 1 It is a schematic diagram according to the first embodiment of the present disclosure.

[0025] It should be noted that, in this embodiment, the execution subject of the image rendering method is an image rendering device, which can be implemented in software and / or hardware, and this device can be configured in an electronic device, and the electronic device can include but is not limited to a terminal, a server, etc.

[0026] The embodiments of the present disclosure relate to the field of artificial intelligence technology, and specifically relate to technical fields such as computer vision and deep learning.

[0027] Among them, artificial intelligence (AI) is an abbreviation in English. It is a new technical science that studies, develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence.

[0028] Deep learning is to learn the internal laws and representation levels of sample data, and the information obtained in these learning processes is very helpful for the interpretation of data such as text, images and sounds. The ultimate goal of deep learning is to enable machines to have the ability of analysis and learning like humans, and to be able to recognize data such as text, images and sounds.

[0029] Computer vision refers to using cameras and computers to replace human eyes to perform machine vision such as target recognition, tracking and measurement on targets, and further performing graphic processing to make the computer process into an image that is more suitable for human eyes to observe or transmitted to an instrument for detection.

[0030] In the embodiments of the present disclosure, image rendering can be to render local images or global images in virtual reality technology (VR) or augmented reality technology (AR), or to render scene images in a navigation scene, or can also be to render images in any other possible scene, and there is no limitation on this.

[0031] It should be noted that, in the embodiments of the present disclosure, the processing methods such as the field of view information, data collection, storage, use, processing, transmission, provision and disclosure all comply with the regulations of relevant laws and regulations and do not violate public order and good customs.

[0032] As Figure 1 shown, the image rendering method includes:

[0033] S101: Determine the resolution information related to the target patch area and the field of view information.

[0034] Among them, the medium area to be rendered can be referred to as the target patch area. The target patch area can be the entire area of the device display screen, or it can be an area selected from the entire area, or it can also be any medium area that can display the local area image in the panoramic view. The target patch area can be two-dimensional or three-dimensional, and can also be a spherical or solid geometric figure surface. The local area image displayed by the target patch area can change with the change of the resolution information to effectively meet the observation needs of personalized resolution information, and there is no limitation on this.

[0035] In the application scenario of the embodiments of the present disclosure, the rendered image in the medium area to be rendered can respond to operations such as zooming in, zooming out, and view angle switching of the user to perform corresponding image zooming in, image zooming out, and image view angle switching, etc., and there is no limitation on this.

[0036] Among them, in the image rendering scenario, the data information used to represent the observation field of view (the observation field of view can be the preview field of view in the image acquisition device, and an image can be previewed based on this preview field of view, or the observation field of view can also be the user's observation field of view, and there is no limitation on this) can be referred to as the field of view information. The field of view information can be, for example, the field of view angle (Field of view, Fov), the viewing distance, the field of view angle change information, the maximum field of view angle, the minimum field of view angle, etc., and there is no limitation on this.

[0037] In the embodiments of the present disclosure, the observation field of view for observing the image to be rendered can be determined, and the corresponding field of view angle and viewing distance can be determined according to the observation field of view to obtain the field of view information. Or, the viewing distance and field of view angle of the image acquisition device when acquiring the image can also be recorded to obtain the field of view information. Or, it can also be obtained by any other possible method, and there is no limitation on this.

[0038] In the embodiments of the present disclosure, when obtaining the field of view information, the medium area that can be observed by the field of view information can be determined, and the medium area that can be observed based on the field of view information can be used as the target patch area, and there is no limitation on this.

[0039] Among them, the information related to the resolution that enables the rendered image to be presented based on the field of view information can be referred to as resolution information. When the rendered image is obtained by rendering based on this resolution information, the rendered image can meet the observation requirements under this field of view information. It can be understood that as the field of view information changes dynamically, the resolution information can also change accordingly in response to the field of view information, and no restrictions are imposed on this.

[0040] In the implementation of the present disclosure, corresponding parsing processing can be performed on the field of view information to determine the resolution information related to the field of view information. Alternatively, the field of view information can also be input into a resolution parsing model to determine the resolution information related to the field of view information. Or, any other possible method can also be used to determine the resolution information related to the field of view information, and no restrictions are imposed on this.

[0041] For example, the resolution information can be determined by the field of view angle in the field of view information, that is, determining the resolution corresponding to the field of view angle. Or, the corresponding resolution information can also be determined according to the change situation of the field of view angle, and no restrictions are imposed on this.

[0042] For example, the resolution information can be a resolution of 512×512, that is, within the area corresponding to the resolution information, there are 512 pixel points in the horizontal direction and 512 pixel points in the vertical direction. Thus, it can also be multiple resolution information such as 1024×1024, 2048×2048, etc., and no restrictions are imposed on this.

[0043] In the embodiments of the present disclosure, the resolution corresponding to the field of view information can also be preset as the resolution information. Or, data processing can be performed on the field of view angle, viewing distance, etc. to obtain the corresponding resolution information and set it as the resolution information corresponding to the corresponding field of view information. Or, pre-annotation processing can also be performed on the field of view information to annotate and obtain the corresponding resolution information. Thus, when determining the resolution information related to the field of view information, the pre-set or pre-annotated resolution information related to the field of view information can be directly obtained, and no restrictions are imposed on this.

[0044] S102: Obtain a target tile map that matches the resolution information.

[0045] Among them, the rendered image can be understood as an image obtained by rendering a local area in a panoramic view, and this panoramic view can be pre-loaded. In the embodiments of the present disclosure, the panoramic view can be hierarchically sliced in advance to obtain multiple tile maps at the corresponding levels, and this corresponding level can be used to represent the resolution information. That is to say, after the rendered image is obtained by rendering with the target tile map that matches the resolution information, the rendered image meets the observation and display requirements of this resolution information.

[0046] Among them, multiple candidate resolution information can be determined in advance, and the panoramic image can be correspondingly segmented based on different resolution information to obtain candidate tile images corresponding to each candidate resolution information. Then, when obtaining the target tile image that matches the resolution information, the candidate resolution information that matches the resolution information can be determined, and the tile image pre-segmented and configured for the matching candidate resolution information is used as the target tile image. In the embodiments of the present disclosure, the obtained tile image that matches the resolution information can be referred to as the target tile image, and the number of target tile images can be one or more, which is not limited thereto.

[0047] In the embodiments of the present disclosure, a hierarchical classification rule can also be preset according to the resolution information to obtain tile images of each resolution information corresponding to the field of view information as the target tile images. Alternatively, according to the resolution information, the panoramic image obtained from a third-party platform can be dynamically segmented hierarchically to obtain the target tile images, which is not limited thereto.

[0048] S103: Render the target tile image to the target patch area according to the target texture feature of the target tile image to obtain a rendered image.

[0049] Among them, the feature describing the pixel texture in the target tile image can be referred to as the target texture feature. The target texture feature can be specifically, for example, features such as image texture, pixel color feature, feature of the image visual dimension, and gray distribution.

[0050] Among them, the target texture feature can be used to render a rendered image to form a local area image corresponding to the resolution information requirement in the panoramic image.

[0051] In some embodiments, the target texture feature corresponding to the target tile image can be loaded from device memory, hard disk, or network. The target texture feature can be pre-generated and saved, which is not limited thereto.

[0052] In other embodiments, a target texture feature recognition model can also be built based on structural methods using methods such as gray-level co-occurrence matrix, autoregressive texture model, and wavelet transform to process the target tile image and obtain the target texture feature of the target tile image, which is not limited thereto.

[0053] In the embodiments of the present disclosure, the target tile image can be pasted onto the target patch area, and then the target texture feature of the target tile image is used to describe the pasted target tile image until the rendering is completed. The image rendered in the target patch area is used as the rendered image, which is not limited thereto.

[0054] In some embodiments, the rendering method may be to use a tree structure. Starting from the target tile map corresponding to the main node of the tree structure (which can be used to store various resolution information and the target tile maps corresponding to the respective resolution information) to the target tile maps corresponding to the child nodes, layer-by-layer rendering is performed until the target tile map corresponding to the target texture feature is rendered to the target patch area, obtaining a rendered image.

[0055] In other embodiments, the target texture feature may also be marked, the target patch area corresponding to the marked target texture feature may be determined, and according to the resolution information, one or more target tile maps corresponding to the target patch area may be determined, and the one or more target tile maps are rendered to obtain a rendered image, and there is no limitation thereto.

[0056] In this embodiment, by determining the resolution information related to the target patch area and the field of view information, obtaining the target tile map that matches the resolution information, and rendering the target tile map to the target patch area according to the target texture feature of the target tile map to obtain a rendered image, it is possible to flexibly and adaptively render the target tile maps of different resolution information. Since it is possible to dynamically render the target tile maps of different resolution information, it is possible to dynamically adjust the memory occupancy required for image rendering, effectively reduce the memory occupied by image rendering, effectively improve the rendering efficiency of the image, improve the rendering effect of the image, and effectively expand the application scenarios of image rendering.

[0057] Figure 2 It is a schematic diagram according to the second embodiment of the present disclosure.

[0058] As Figure 2 shown, the image rendering method includes:

[0059] S201: Determine the resolution information related to the target patch area and the field of view information.

[0060] For the description of S201, specific reference may be made to the above embodiments, and details will not be repeated here.

[0061] S202: Determine the visible range information according to the field of view information.

[0062] Among them, the information used to describe the characteristics of the visible range area may be referred to as the visible range information. The visible range information may be the size of the visible range area, the resolution information corresponding to the visible range area, etc. It can be understood that the visible range information usually changes with the change of the field of view information, and there is no limitation thereto.

[0063] For example, in a VR device, the display area of the device is used as the visible range area, and the resolution information corresponding to the display area is used as the visible area information, and there is no limitation thereto.

[0064] In the embodiments of the present disclosure, the field of view information may include the field of view angle and the viewing distance, and the change of the field of view angle and the viewing distance may cause the change of the visible range.

[0065] Optionally, in the embodiments of the present disclosure, determining the visible range information according to the field of view information may be to perform a matching operation on the field of view angle and the viewing distance to determine the visible range information. Since the visible range information is calculated by the field of view angle and the viewing distance, the accuracy of determining the visible range information can be effectively improved, and the matching of the visible range information and the field of view information can be ensured.

[0066] In the embodiments of the present disclosure, the corresponding visible range information may be adaptively adjusted according to the change of the field of view angle and the viewing distance. A machine learning model may be used to input the field of view information such as the field of view angle and the viewing distance into the machine learning model to generate the visible range area and the visible range information corresponding to the visible range area. Alternatively, a field of view analysis method may also be used to obtain the visible range area corresponding to the field of view information such as the field of view angle and the viewing distance, and obtain the visible range information corresponding to the visible range area. Alternatively, it may also be any other possible implementation manner to implement determining the visible range information according to the field of view information such as the field of view angle and the viewing distance, and no limitation is made thereto.

[0067] S203: Determine the actual resolution of the target patch area according to the visible range information.

[0068] After determining the visible range information according to the field of view information in the embodiments of the present disclosure, the actual resolution of the target patch area may be determined according to the visible range information. The resolution that can actually be presented when the target patch area displays the corresponding rendered image may be referred to as the actual resolution, and the actual resolution may be used for subsequent image rendering to ensure that the resolution of the rendered image matches the actual resolution of the target patch area.

[0069] In the embodiments of the present disclosure, determining the actual resolution of the target patch area according to the field of view information may be to obtain the resolution of the image rendered by the target patch area historically according to the field of view information to obtain the actual resolution of the target patch area, or it may also be to determine the actual resolution corresponding to the target patch area according to the change of the field of view angle in the field of view information, and no limitation is made thereto.

[0070] In the embodiments of the present disclosure, after determining the visible range information, the actual resolution of the target patch area may be determined according to the visible range information and the field of view angle. An actual resolution confirmation rule may be preset, and the resolution information of the target patch area may be determined as the actual resolution according to the combination of the field of view angle, the visible range information, and the confirmation rule. Alternatively, a data processing model may also be set, and the field of view angle and the visible range information may be input into the data processing model for processing to obtain the actual resolution of the target patch area, and no limitation is made thereto.

[0071] In the embodiments of the present disclosure, as Figure 3 shown, Figure 3 is a schematic diagram for confirming the actual resolution according to the embodiments of the present disclosure. The change of the field of view angle and the change of the visible range area have a non-linear corresponding relationship. When the field of view angle is fixed, in order to ensure the display clarity of the visible range area, the image resolution can be greater than the actual resolution. The calculation formula for the actual resolution is as follows:

[0072]

[0073] In the formula, the actual resolution is d, the resolution corresponding to the visible range area is h, and the angle corresponding to the field of view angle is Fov. Thus, the corresponding actual resolution d is calculated.

[0074] S204: Select the relevant hierarchical resolution of the actual resolution from multiple hierarchical resolutions as the resolution information, where the multiple hierarchical resolutions respectively correspond to describing multiple candidate tile maps, and the relevant hierarchical resolution is the hierarchical resolution with the smallest median value among the partial hierarchical resolutions greater than the actual resolution.

[0075] Among them, the resolution information is pre-divided into multiple levels, and the resolution information corresponding to each level can be called the hierarchical resolution. The division of the hierarchical resolution can be based on the actual scene requirements, or it can also be divided according to the initial resolution size of the image, and no limitation is imposed thereon.

[0076] Among them, the local image tiles corresponding to the multiple hierarchical resolutions can be called candidate tile maps, that is to say, the panoramic image can be pre-divided into candidate tile maps corresponding to the corresponding hierarchical resolutions according to different hierarchical resolutions, and no limitation is imposed thereon.

[0077] For example, if the image is an image with a resolution of 8192×8192, the image can be divided into multiple different levels such as 8192×8192, 4096×4096, 2048×2048, etc. The multiple different levels correspond to different hierarchical resolutions, that is, the hierarchical resolution 8192×8192, the hierarchical resolution 4096×4096, the hierarchical resolution 2048×2048, and no limitation is imposed thereon.

[0078] In the embodiments of the present disclosure, different hierarchical resolutions can describe different candidate tile maps. The hierarchical resolution and the number of candidate tile maps can be adaptively adjusted according to the corresponding resolution level. Thus, the embodiments of the present disclosure can support directly selecting the hierarchical resolution related to the actual resolution from multiple hierarchical resolutions as the resolution information, or selecting the hierarchical resolution close to the actual resolution as the resolution information, and no limitation is imposed thereon.

[0079] For example, assume that an image with an actual resolution of 7680×4320 needs to be rendered to the target patch area of a hexahedron. The compression and segmentation method of the panoramic image is as Figure 4 shown, Figure 4 which is a schematic diagram of hierarchical division according to an embodiment of the present disclosure. The actual resolution size of the thumbnail corresponding to each face of the image is 512, and the actual resolution size of the candidate tile map is also 512. The image can be divided into four levels, and the resolutions of the four levels are: 1024, 2048, 4096, 8192. The corresponding relationship between the level Level(i) and the resolution d of this level is:

[0080] Min(Level(i))≥d;

[0081] The formula indicates that when the actual resolution of the rendered image obtained by rendering the candidate tile map corresponding to the level Level(i) is greater than the resolution d of the level, it is as small as possible to ensure that less memory is occupied.

[0082] From the thumbnail to the resolution of level 4, the resolution gradually increases and the image gradually becomes clearer. As Figure 4 shown, level 1 consists of 4 candidate tile maps with a size of 512, and the resolution of the level is 1024×1024. Level 2 consists of 16 candidate tile maps with a size of 512, and the resolution of the level is 2048×2048. In level 2, the patch area where the candidate tile map is located can be regarded as the candidate tile map on the same area of level 1 multiplied by 2 in side length and replaced by 4 clearer candidate tile maps. Thus, multiple levels of resolutions respectively correspond to describing multiple candidate tile maps, and the relevant level of resolution of the actual resolution can be selected from multiple levels of resolutions and used as the resolution information.

[0083] S205: Determine the change information of the field of view angle.

[0084] In the embodiment of the present disclosure, the change of the field of view angle can be generated by the operation of the user, or it can also be generated with the change of the display requirement of the target patch area in the device display screen, and this is not limited.

[0085] Therefore, the operation of the user can be detected to determine the change information of the field of view angle, or the pre-set rule of the change of the field of view angle can be determined to determine the change information of the field of view angle, or any other possible implementation manner can also be used to determine the change information of the field of view angle, and this is not limited.

[0086] S206: Update the resolution information according to the change information.

[0087] In the embodiments of the present disclosure, a hierarchical resolution may be set to update the corresponding resolution information in response to change information, or alternatively, the change information may be parsed to determine the corresponding resolution information from the change information, and there is no limitation thereto.

[0088] Optionally, in some embodiments, if the change information indicates that the field of view angle becomes larger, the first hierarchical resolution lower than the relevant hierarchical resolution is obtained from multiple hierarchical resolutions, and the resolution information is updated according to the first hierarchical resolution. Since the corresponding hierarchical resolution is adaptively selected according to the change of the field of view angle, the corresponding hierarchical resolution can be effectively and adaptively updated when the change information indicates that the field of view angle becomes larger, so as to realize the flexible adjustment and update of the hierarchical resolution when the view angle field becomes larger, and timely and effectively ensure the rendering clarity of the image within the visible range area.

[0089] Among them, the hierarchical resolution lower than the relevant hierarchical resolution may be referred to as the first hierarchical resolution, and the first hierarchical resolution may be used to match the corresponding candidate tile map, and there is no limitation thereto.

[0090] For example, if the relevant hierarchical resolution is 1024×1024, the first hierarchical resolution may be 512×512, or it may also be other resolution information corresponding to lower than the relevant hierarchical resolution, and there is no limitation thereto.

[0091] In the embodiments of the present disclosure, when the change information indicates that the field of view angle becomes larger, that is, the rendering image of the visible range area can be triggered to be reduced. At this time, the hierarchical resolution lower than the relevant hierarchical resolution can be selected as the resolution information. Thus, within the visible range area, the rendering image can be correspondingly reduced while ensuring the rendering clarity of the image within the visible range area.

[0092] Optionally, in other embodiments, if the change information indicates that the field of view angle becomes smaller, the second hierarchical resolution higher than the relevant hierarchical resolution is obtained from multiple hierarchical resolutions, and the resolution information is updated according to the second hierarchical resolution. Since the corresponding hierarchical resolution is adaptively selected according to the change of the field of view angle, the corresponding hierarchical resolution can be effectively and adaptively updated when the change information indicates that the field of view angle becomes smaller, so as to realize the flexible adjustment and update of the hierarchical resolution when the view angle field becomes smaller, and timely and effectively ensure the rendering clarity of the image within the visible range area.

[0093] Among them, the hierarchical resolution higher than the relevant hierarchical resolution may be referred to as the second hierarchical resolution, and the second hierarchical resolution may be used to match the corresponding candidate tile map, and there is no limitation thereto.

[0094] For example, if the resolution of the relevant level is 1024×1024, the resolution of the second level can be 2048×2048, or it can also be other resolution information higher than the resolution of the relevant level, and there is no limitation on this.

[0095] In the embodiments of the present disclosure, when the change information indicates that the field of view angle becomes smaller, that is, the rendering image within the enlarged visible range area can be triggered. At this time, the level resolution higher than the relevant level resolution can be selected as the resolution information. Thus, it is possible to enlarge the rendering image within the visible range area while ensuring the rendering clarity of the image within the visible range area.

[0096] S207: Render the target tile map to the target patch area according to the target texture feature of the target tile map to obtain a rendering image.

[0097] For the description of S207, reference can be specifically made to the above embodiments, and details are not described herein again.

[0098] In this embodiment, it is possible to flexibly and adaptively render target tile maps with different resolution information. Since the target tile maps with different resolution information can be dynamically rendered, the memory occupancy required for image rendering can be dynamically adjusted, effectively reducing the memory occupied by image rendering, effectively improving the rendering efficiency of the image, improving the rendering effect of the image, and effectively expanding the application scenarios of image rendering. By determining the resolution information related to the target patch area and the field of view information, obtaining the target tile map matching the resolution information, and rendering the target tile map to the target patch area according to the target texture feature of the target tile map to obtain a rendering image, it is ensured that the resolution of the rendering image matches the actual resolution of the target patch area. Moreover, since the target tile map is rendered to the target patch area according to the target texture feature, the rendering integrity of the rendering image can be effectively improved, and the rendering effect of the image can be effectively guaranteed. Since the visible range information is determined according to the field of view information, and the actual resolution of the target patch area is obtained according to the visible range information, the actual resolution of the target patch area can be accurately determined, effectively improving the confirmation effect of the actual resolution of the target patch area, and thus effectively improving the rendering effect of the image within the visible range area. Since the relevant level resolution of the actual resolution is selected from multiple level resolutions and used as the resolution information, the resolution information suitable for the actual resolution of the target patch area can be accurately selected, effectively improving the accuracy of the resolution information determined for the visible range area, and also effectively improving the rendering clarity of the target texture feature within the visible range area, effectively improving the rendering effect of the rendering image. Since the resolution information is updated according to the change information of the field of view angle, the resolution information can be accurately and timely updated, effectively improving the update efficiency of the resolution information, and thus effectively improving the rendering effect of the image within the visible range area.

[0099] Figure 5 is a schematic diagram according to a third embodiment of the present disclosure.

[0100] like Figure 5 As shown, the image rendering method includes:

[0101] S501: Acquire a panoramic image, wherein the panoramic image corresponds to an initial resolution.

[0102] Among them, images that present as much of the global scene as possible through wide-angle photography, painting, three-dimensional models and other means of expression can be called panoramas, and the actual resolution corresponding to the panorama can be called initial resolution.

[0103] In the embodiments of the present disclosure, a corresponding image rendering model can be pre-built, and various elements in the global scene can be photographed by a camera device (such as a camera or a video camera with a panoramic shooting function), and the various elements in the global scene can be imported into the image rendering model to obtain a panoramic image. Alternatively, the panoramic image can be searched and obtained from the network, or any other possible implementation method can be used to obtain the panoramic image, and there is no limitation to this.

[0104] For example, a panoramic image may be captured by a camera device and imported into a resolution analysis model. The resolution analysis model analyzes the data information contained in the acquired panoramic image to obtain an initial resolution corresponding to the panoramic image.

[0105] S502: Determine multiple levels of resolution according to the initial resolution, wherein the multiple levels of resolution correspond to multiple tile segmentation methods respectively.

[0106] In the disclosed embodiment, the panoramic image can be matched and divided into multiple candidate tile images of different levels of resolution according to the size of the initial resolution. The division method of the candidate tile images of different levels of resolution can be determined by the size of the initial resolution and the number and level of the candidate tile images to be divided, and there is no restriction on this.

[0107] S503: Using a plurality of tile segmentation methods to segment the panoramic image into tiles respectively, so as to obtain a plurality of corresponding candidate tile images.

[0108] In the disclosed embodiment, after determining multiple levels of resolution based on the initial resolution, where the multiple levels of resolution correspond to multiple tile segmentation methods respectively, the panoramic image can be tiled according to the corresponding tile segmentation methods to obtain candidate tile images corresponding to each level of resolution.

[0109] For example, the initial resolution of the obtained panoramic image is 4096×4096. According to the scene requirements, the panoramic image is sliced into candidate tile images corresponding to three different hierarchical resolutions. Then, the panoramic image can be sliced into candidate tile images corresponding to the hierarchical resolutions of 4096×4096, 2048×2048, and 1024×1024 respectively, and there is no limitation on this.

[0110] S504: Describe the corresponding multiple candidate tile images using multiple hierarchical resolutions respectively.

[0111] In the embodiments of the present disclosure, the hierarchical level corresponding to the hierarchical resolution includes multiple candidate tile images. Multiple different hierarchical resolutions can be used to describe the multiple candidate tile images of the corresponding level respectively, and there is no limitation on this.

[0112] When the embodiments of the present disclosure describe the corresponding multiple candidate tile images using multiple hierarchical resolutions respectively, the candidate tile images corresponding to multiple different hierarchical resolutions can also be stored based on a tree - like storage method. This tree - like structure can be called a rendering tree. The rendering tree can include a main node and sub - nodes, that is, the candidate tile images corresponding to multiple different hierarchical resolutions are stored in the nodes of the corresponding level. Or, according to the scene requirements, any other possible storage structure can be used to store the corresponding multiple candidate tile images, and there is no limitation on this.

[0113] Optionally, in the embodiments of the present disclosure, a tree - like structure can be used to store the candidate tile images corresponding to each hierarchical resolution. According to multiple hierarchical resolutions and the corresponding multiple candidate tile images, a rendering tree is generated. Among them, the rendering tree includes: a root node and multiple leaf nodes. The tree levels where different leaf nodes are located can be the same or different. The depth of the rendering tree is the number of levels of multiple hierarchical resolutions. The root node stores the thumbnail corresponding to the panoramic image. The leaf nodes at the same tree level store the candidate tile images described by the same hierarchical resolution, and the leaf nodes at different tree levels store the candidate tile images described by different hierarchical resolutions. Since a tree - like structure is used to store the candidate tile images corresponding to multiple different hierarchical resolutions, it is convenient to search and retrieve the candidate tile images at the corresponding hierarchical resolution, effectively improving the search and retrieval efficiency of the candidate tile images, thereby effectively improving the rendering efficiency of the candidate tile images, simplifying the rendering process, and effectively improving the image rendering effect.

[0114] In the embodiments of the present disclosure, as Figure 6 shown, Figure 6 is a schematic diagram of the tree - like structure according to the embodiments of the present disclosure. The root node is the thumbnail corresponding to the panoramic image, and the sub - nodes correspond to the candidate tile images of multiple different hierarchical resolutions. From the root node to the sub - nodes, the field of view of the panoramic image within the visible range area decreases layer by layer.

[0115] For example, when the initial resolution of the panorama is 4096×4096, the thumbnail of the panorama can be a hierarchical resolution of 512×512. As the root node of the rendering tree, the panorama is sliced into three different hierarchical candidate tile maps. Level 1 has 4 candidate tile maps, and the hierarchical resolution corresponding to the level 1 candidate tile maps is 1024×1024. Level 2 has 16 candidate tile maps, and the hierarchical resolution of the level 2 candidate tile maps is 2048×2048. Level 3 has 64 candidate tile maps, and the hierarchical resolution of the level 3 candidate tile maps is 4096×4096. Thus, level 3 is consistent with the initial resolution of the panorama. Level 3 is the level where the panorama is enlarged to the clearest, with the smallest field of view angle, and multiple hierarchical resolutions are used to describe the corresponding multiple candidate tile maps respectively.

[0116] S505: Determine the resolution information related to the target patch area and the field of view information.

[0117] For the description of S505, reference can be specifically made to the above embodiments, and details will not be elaborated here.

[0118] S506: Determine the target tree level corresponding to the resolution information from the rendering tree, where the target tree level belongs to multiple tree levels.

[0119] Among them, the level corresponding to the hierarchical resolution in the rendering tree can be called the tree level. For example, level 1, level 2, level 3... The tree level corresponding to the resolution information of the candidate tile map to be rendered to the target patch area can be called the target tree level.

[0120] In the embodiments of the present disclosure, the corresponding relationship between the hierarchical resolution and the tree level can be preset, the resolution information can be detected, and the corresponding target tree level can be matched. Alternatively, the corresponding relationship between the field of view angle and the tree level can also be set, and the corresponding target tree level can be determined according to the size and change of the recognized field of view angle, which is not limited herein.

[0121] S507: Use the candidate tile map stored in the leaf node of the target tree level as the target tile map that matches the resolution information.

[0122] In the embodiments of the present disclosure, different nodes of the rendering tree store the corresponding candidate tile maps. After confirming the target tree level corresponding to the resolution information, the candidate tile map stored in the leaf node of the target tree level can be obtained. It can be the tile map with the hierarchical resolution corresponding to the target tree level as the candidate tile map. Alternatively, a retrieval model can also be built, and based on this retrieval model, the rendering tree can be traversed to find the candidate tile map corresponding to the target tree level, and the determined candidate tile map can be used as the target tile map, which is not limited herein.

[0123] S508: Render the target tile map to the target patch area according to the target texture feature of the target tile map to obtain a rendered image.

[0124] For the description of S508, please refer to the above embodiments for details and will not be elaborated here.

[0125] In this embodiment, it is possible to flexibly and adaptively render target tile maps with different resolution information. Since it can dynamically render target tile maps with different resolution information, it can dynamically adjust the memory occupancy required for image rendering, effectively reduce the memory occupied by image rendering, effectively improve the rendering efficiency of images, enhance the rendering effect of images, and effectively expand the application scenarios of image rendering. Since multiple hierarchical resolutions are determined according to the initial resolution, the adaptation effect between the hierarchical resolution and the initial resolution can be improved. Furthermore, the tile splitting method of the panoramic view can be flexibly configured adaptively, and the panoramic view can be split accordingly based on this tile splitting method to obtain candidate tile maps, which can effectively enhance the adaptability between the candidate tile maps and the panoramic view. Since a tree structure is used to store candidate tile maps corresponding to multiple different hierarchical resolutions, it is convenient to search and retrieve candidate tile maps at the corresponding hierarchical resolution, effectively improving the search and retrieval efficiency of candidate tile maps, thus effectively improving the rendering efficiency of candidate tile maps, simplifying the rendering process, and effectively improving the image rendering effect. Since the target tree level corresponding to the resolution information is determined from the rendering tree, and the candidate tile map stored in the leaf node corresponding to the target tree level is used as the candidate tile map described by the resolution information, the candidate tile map corresponding to the resolution information can be accurately and quickly determined, improving the processing efficiency of relevant candidate tile maps in the rendering tree, and further effectively improving the rendering efficiency of the panoramic view.

[0126] In summary, as Figure 7 shown, Figure 7 is a schematic flowchart of an image rendering method according to an embodiment of the present disclosure. First, obtain the field of view angle, viewing distance, and panoramic view information, generate a rendering tree corresponding to multiple hierarchical resolutions according to data information such as the field of view angle, viewing distance, and panoramic view information. The rendering tree includes corresponding root nodes and child nodes, and multiple candidate tile maps are stored in the child nodes. Mark the nodes corresponding to the candidate tile maps to be rendered, and load the marked candidate tile maps from the panoramic view, generate target texture features, render the candidate tile maps to the target patch area according to the target texture features, and repeatedly query the marked nodes to implement image rendering.

[0127] In summary, as Figure 8 shown, Figure 8 is a schematic diagram of an image rendering device according to an embodiment of the present disclosure. The image rendering device includes: an acquisition module, a generation module, a confirmation module, a loading module, and a rendering module.

[0128] Among them, the acquisition module is used to acquire data information such as the current field of view angle, viewing distance, thumbnail of the loaded panoramic image, and resolution information.

[0129] The generation module is used to calculate candidate tile maps with different hierarchical resolutions corresponding to different field of view angles at the current viewing distance according to preset rules and the initial resolution of the panoramic image, and generate a rendering tree with the thumbnail as the root node and the sub-tile maps that can be sliced from the candidate tile maps of the current node as the sub-nodes. The depth of the rendering tree can be the number of levels corresponding to different hierarchical resolutions after the panoramic image is compressed.

[0130] The confirmation module is used to confirm the target tree level where the required rendering node is located at the current field of view angle, and confirm the candidate tile maps within the visible range area of the target tree level, and mark the candidate tile maps or the corresponding rendering tree nodes.

[0131] The loading module is used to load the panoramic image thumbnail and candidate tile maps from memory, hard disk, or network, generate target texture features, and associate them with the nodes of the tree corresponding to the candidate tile maps. It can preferentially load the candidate tile maps within the visible range and dynamically recycle the target texture features outside the visible range to always ensure low memory occupancy. At the same time, the loading module can also have a caching function for candidate tile maps and target texture features, and can directly retrieve the cached target texture features to improve the loading efficiency of the target texture features.

[0132] The rendering module is used to start searching from the root node of the rendering tree, traverse depth-first or breadth-first, find the marked candidate tile maps, and render the marked candidate tile maps. When rendering the thumbnail, the rendering module can only render the root node. When rendering the target tile map with the highest resolution, the rendering module can only render the leaf node. The rendering method can be adaptively changed according to the scene requirements, and no restrictions are imposed on this.

[0133] Figure 9 It is a schematic diagram according to the fourth embodiment of the present disclosure.

[0134] As Figure 9 shown, the image rendering device 90 includes:

[0135] The first determination module 901 is used to determine the resolution information related to the target patch area and field of view information;

[0136] The first acquisition module 902 is used to acquire the target tile map that matches the resolution information; and

[0137] The rendering module 903 is used to render the target tile map to the target patch area according to the target texture features of the target tile map to obtain a rendered image.

[0138] In some embodiments of the present disclosure, as Figure 10 shown,Figure 10 It is a schematic diagram according to the fifth embodiment of the present disclosure. The image rendering device 100 includes: a first determination module 1001, a first acquisition module 1002, and a rendering module 1003. Among them, the first determination module 1001 includes:

[0139] A determination sub-module 10011, configured to determine visible range information according to the field of view information;

[0140] An acquisition sub-module 10012, configured to acquire the actual resolution of the target patch area according to the visible range information; and

[0141] A selection sub-module 10013, configured to select the relevant hierarchical resolution of the actual resolution from multiple hierarchical resolutions as the resolution information, where the multiple hierarchical resolutions respectively correspond to describing multiple candidate tile maps, and the relevant hierarchical resolution is the hierarchical resolution with the smallest value among the partial hierarchical resolutions greater than the actual resolution.

[0142] In some embodiments of the present disclosure, the field of view information includes: field of view angle and viewing distance;

[0143] Among them, the determination sub-module 10011 is specifically configured to:

[0144] Perform a matching operation on the field of view angle and the viewing distance to determine the visible range information.

[0145] In some embodiments of the present disclosure, it further includes:

[0146] A second determination module 1004, configured to determine the change information of the field of view angle after selecting the relevant hierarchical resolution of the actual resolution from multiple hierarchical resolutions as the resolution information;

[0147] An update module 1005, configured to update the resolution information according to the change information.

[0148] In some embodiments of the present disclosure, among them, the update module 1005 is specifically configured to:

[0149] When the change information indicates that the field of view angle becomes larger, obtain a first hierarchical resolution lower than the relevant hierarchical resolution from multiple hierarchical resolutions;

[0150] Update the resolution information according to the first hierarchical resolution.

[0151] In some embodiments of the present disclosure, among them, the update module 1005 is specifically configured to:

[0152] When the change information indicates that the field of view angle becomes smaller, obtain a second hierarchical resolution higher than the relevant hierarchical resolution from multiple hierarchical resolutions;

[0153] Update the resolution information according to the second-level resolution.

[0154] In some embodiments of the present disclosure, it further includes:

[0155] A second acquisition module 1006, configured to acquire a panoramic image before determining the target patch region, where the panoramic image corresponds to an initial resolution;

[0156] A third determination module 1007, configured to determine a plurality of hierarchical resolutions according to the initial resolution, where the plurality of hierarchical resolutions respectively correspond to multiple tile segmentation methods;

[0157] A segmentation module 1008, configured to perform tile segmentation on the panoramic image respectively by using multiple tile segmentation methods to obtain corresponding multiple candidate tile images; and

[0158] A description module 1009, configured to describe the corresponding multiple candidate tile images respectively by using multiple hierarchical resolutions.

[0159] In some embodiments of the present disclosure, the description module 1009 is specifically configured to:

[0160] Generate a rendering tree according to the multiple hierarchical resolutions and the corresponding multiple candidate tile images;

[0161] Wherein, the rendering tree includes: a root node and multiple leaf nodes. The tree levels where different leaf nodes are located are the same or different. The depth of the rendering tree is the number of levels of the multiple hierarchical resolutions. The root node stores a thumbnail corresponding to the panoramic image. The leaf nodes at the same tree level store the candidate tile images described by the same level of resolution, and the leaf nodes at different tree levels store the candidate tile images described by different levels of resolution.

[0162] In some embodiments of the present disclosure, the first acquisition module 1002 is specifically configured to:

[0163] Determine a target tree level corresponding to the resolution information from the rendering tree, where the target tree level belongs to the multiple tree levels;

[0164] Use the candidate tile image stored in the leaf node of the target tree level as the target tile image matching the resolution information.

[0165] It can be understood that the image rendering device 100 in this embodiment Figure 10 and the image rendering device 90 in the above embodiment, the first determination module 1001 and the first determination module 901 in the above embodiment, the first acquisition module 1002 and the first acquisition module 902 in the above embodiment, and the rendering module 1003 and the rendering module 903 in the above embodiment may have the same functions and structures.

[0166] It should be noted that the foregoing explanation of the image rendering method also applies to the image rendering apparatus of this embodiment, and will not be elaborated herein.

[0167] In this embodiment, by determining the resolution information related to the target patch area and the field of view information, obtaining the target tile map that matches the resolution information, and rendering the target tile map to the target patch area according to the target texture feature of the target tile map to obtain a rendered image, it is possible to flexibly and adaptively render the target tile map with different resolution information. Since the target tile map with different resolution information can be dynamically rendered, the memory occupancy required for image rendering can be dynamically adjusted, effectively reducing the memory occupied by image rendering, effectively improving the rendering efficiency of the image, enhancing the rendering effect of the image, and effectively expanding the application scenarios of image rendering.

[0168] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0169] Figure 11 A schematic block diagram of an example electronic device for implementing the image rendering method according to an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as, a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, a personal digital processor, a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0170] As Figure 11 shown, the electronic device 1100 includes a computing unit 1101, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1102 or a computer program loaded from a storage unit 1108 into a random access memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the device 1100 can also be stored. The computing unit 1101, the ROM 1102, and the RAM 1103 are connected to each other through a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0171] Multiple components in the electronic device 1100 are connected to the I / O interface 1105, including: an input unit 1106, such as a keyboard, a mouse, etc.; an output unit 1107, such as various types of displays, speakers, etc.; a storage unit 1108, such as a disk, an optical disc, etc.; and a communication unit 1109, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1109 allows the device 1100 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0172] The computing unit 1101 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 1101 include but are not limited to a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 1101 executes the various methods and processes described above, such as the image rendering method. For example, in some embodiments, the image rendering method can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as the storage unit 1108. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 1100 via the ROM 1102 and / or the communication unit 1109. When the computer program is loaded into the RAM 1103 and executed by the computing unit 1101, one or more steps of the image rendering method described above can be executed. Alternatively, in other embodiments, the computing unit 1101 can be configured to execute the image rendering method in any other suitable way (e.g., by means of firmware).

[0173] The various embodiments of the systems and technologies described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: implemented in one or more computer programs, the one or more computer programs can be executed and / or interpreted on a programmable system including at least one programmable processor, the programmable processor can be a special or general-purpose programmable processor, can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0174] The program code for implementing the methods of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing devices, such that when the program codes are executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program codes can be executed entirely on the machine, partially on the machine, executed partially on the machine as an independent software package and partially on a remote machine, or executed entirely on a remote machine or server.

[0175] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0176] In order to provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which the user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and the input received from the user can be in any form (including acoustic input, voice input, or tactile input).

[0177] The systems and techniques described herein can be implemented in a computing system including backend components (e.g., as a data server), or a computing system including middleware components (e.g., an application server), or a computing system including frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system including any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected to each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), the Internet, and blockchain network.

[0178] A computer system can include a client and a server. The client and the server are generally far from each other and usually interact through a communication network. The client-server relationship is created by computer programs running on respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, and solves the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services ("Virtual Private Server", or simply "VPS" for short). The server can also be a server of a distributed system, or a server combined with blockchain.

[0179] It should be understood that various forms of the processes shown above can be used, steps can be reordered, added, or deleted. For example, the steps recited in this disclosure can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this is not limited herein.

[0180] The above specific embodiments do not constitute a limitation on the protection scope of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the protection scope of this disclosure.

Claims

1. An image rendering method, comprising: Determining resolution information related to a target patch area and field of view information; Obtaining a target tile map that matches the resolution information; And Rendering the target tile map to the target patch area according to the target texture feature of the target tile map to obtain a rendered image; Wherein, determining the resolution information related to the field of view information includes: Determining visible range information according to the field of view information; Obtaining the actual resolution of the target patch area according to the visible range information; and Selecting the relevant hierarchical resolution of the actual resolution from multiple hierarchical resolutions as the resolution information, wherein the multiple hierarchical resolutions respectively correspond to describing multiple candidate tile maps, and the relevant hierarchical resolution is the hierarchical resolution with the smallest value among the hierarchical resolutions greater than the actual resolution.

2. According to the method described in claim 1, the field of view information includes: Field of view angle and viewing distance; Wherein, determining the visible range information according to the field of view information includes: Performing a matching operation on the field of view angle and the viewing distance to determine the visible range information.

3. According to the method described in claim 2, after selecting the relevant hierarchical resolution of the actual resolution from multiple hierarchical resolutions and using it as the resolution information, it further includes: Determining the change information of the field of view angle; Updating the resolution information according to the change information.

4. The method according to claim 3, wherein, The updating the resolution information according to the change information includes: If the change information indicates that the field of view angle becomes larger, obtaining a first hierarchical resolution lower than the relevant hierarchical resolution from the multiple hierarchical resolutions; Updating the resolution information according to the first hierarchical resolution.

5. The method according to claim 3, wherein The updating the resolution information according to the change information includes: If the change information indicates that the field of view angle becomes smaller, obtaining a second hierarchical resolution higher than the relevant hierarchical resolution from the multiple hierarchical resolutions; Updating the resolution information according to the second hierarchical resolution.

6. According to the method described in claim 1, before determining the target patch area, it further includes: Obtaining a panoramic view, where the panoramic view corresponds to an initial resolution; Determining multiple hierarchical resolutions according to the initial resolution, where the multiple hierarchical resolutions respectively correspond to multiple tile segmentation methods; Performing tile segmentation on the panoramic view respectively by using the multiple tile segmentation methods to obtain corresponding multiple candidate tile maps; and Describing the corresponding multiple candidate tile maps respectively by using the multiple hierarchical resolutions.

7. The method according to claim 6, wherein, The describing the corresponding multiple candidate tile maps respectively by using the multiple hierarchical resolutions includes: Generating a rendering tree according to the multiple hierarchical resolutions and the corresponding multiple candidate tile maps; Among them, the rendering tree includes: a root node and multiple leaf nodes. The tree levels where different leaf nodes are located are the same or different. The depth of the rendering tree is the number of levels of the multiple hierarchical resolutions. The root node stores the thumbnail corresponding to the panoramic image. The leaf nodes at the same tree level store the candidate tile maps described by the same hierarchical resolution, and the leaf nodes at different tree levels store the candidate tile maps described by different hierarchical resolutions.

8. The method according to claim 7, wherein The obtaining of the target tile map matching the resolution information includes: Determining a target tree level corresponding to the resolution information from the rendering tree, where the target tree level belongs to the multiple tree levels; Taking the candidate tile map stored in the leaf nodes in the target tree level as the target tile map matching the resolution information.

9. An image rendering device, including: A first determination module, configured to determine resolution information related to a target patch area and field of view information; A first obtaining module, configured to obtain a target tile map matching the resolution information; And A rendering module, configured to render the target tile map to the target patch area according to the target texture feature of the target tile map to obtain a rendered image; Among them, the first determination module includes: A determination sub-module, configured to determine visible range information according to the field of view information; An obtaining sub-module, configured to obtain the actual resolution of the target patch area according to the visible range information; and A selection sub-module, configured to select, from multiple hierarchical resolutions, the relevant hierarchical resolution of the actual resolution and use it as the resolution information, where the multiple hierarchical resolutions respectively correspond to the description of multiple candidate tile maps, and the relevant hierarchical resolution is the hierarchical resolution with the smallest value among some of the hierarchical resolutions greater than the actual resolution.

10. The device according to claim 9, wherein the field of view information includes: Field of view angle and viewing distance; Among them, the determination sub-module is specifically configured to: Perform a matching operation on the field of view angle and the viewing distance to determine the visible range information.

11. The device according to claim 10, further including: A second determination module, configured to determine the change information of the field of view angle after selecting, from the multiple hierarchical resolutions, the relevant hierarchical resolution of the actual resolution and using it as the resolution information; An update module, configured to update the resolution information according to the change information.

12. The device according to claim 11, wherein, The update module is specifically configured to: When the change information indicates that the field of view angle becomes larger, obtain a first hierarchical resolution lower than the relevant hierarchical resolution from the multiple hierarchical resolutions; Update the resolution information according to the first hierarchical resolution.

13. The apparatus according to claim 11, wherein, The update module is specifically configured to: When the change information indicates that the field of view angle becomes smaller, obtain a second hierarchical resolution higher than the relevant hierarchical resolution from the multiple hierarchical resolutions; Update the resolution information according to the second hierarchical resolution.

14. The device according to claim 9, further including: A second obtaining module, configured to obtain a panoramic image before determining the target patch area, where the panoramic image corresponds to an initial resolution; A third determination module, configured to determine a plurality of hierarchical resolutions according to the initial resolution, where the plurality of hierarchical resolutions respectively correspond to multiple tile splitting methods; A splitting module, configured to respectively perform tile splitting on the panoramic image by using the multiple tile splitting methods to obtain a plurality of corresponding candidate tile images; and A description module, configured to respectively describe the plurality of candidate tile images by using the plurality of hierarchical resolutions.

15. The device according to claim 14, wherein, The description module is specifically configured to: Generate a rendering tree according to the plurality of hierarchical resolutions and the plurality of corresponding candidate tile images; Wherein, the rendering tree includes: a root node and a plurality of leaf nodes. The tree levels where different leaf nodes are located are the same or different. The depth of the rendering tree is the number of levels of the plurality of hierarchical resolutions. The root node stores a thumbnail corresponding to the panoramic image. The leaf nodes at the same tree level store the candidate tile images described by the same hierarchical resolution, and the leaf nodes at different tree levels store the candidate tile images described by different hierarchical resolutions.

16. The apparatus according to claim 15, wherein The first obtaining module is specifically configured to: Determine a target tree level corresponding to the resolution information from the rendering tree, where the target tree level belongs to the plurality of tree levels; Use the candidate tile images stored in the leaf nodes in the target tree level as target tile images matching the resolution information.

17. An electronic device, comprising: At least one processor; And A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method according to any one of claims 1-8.

18. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to execute the method according to any one of claims 1-8.

19. A computer program product, comprising a computer program, where the computer program implements the steps of the method according to any one of claims 1-8 when executed by a processor.

Images