Image processing method, device, equipment and storage medium
By storing image information at different zoom levels in the display device and only rendering and stitching of non-overlapping areas, the inefficiency problem caused by region changes in image rendering is solved, and faster rendering time and higher efficiency are achieved.
Patent Information
- Application Number
- CN202310133322.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-09
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2043-02-09
AI Technical Summary
During the image rendering process, changes in part of the area of the object to be rendered cause the rendering device to reacquire the image information of the unchanged area and re-render, resulting in increased rendering steps, extended time, and reduced efficiency.
By storing image information at different zoom levels of the target area in the display device, overlapping areas and non-overlapping areas are determined, and only non-overlapping areas are rendered and stitched, an updated image is generated, and displayed in turn.
Reduces the amount of information processed, shortens rendering time, improves rendering efficiency, and improves user experience.
Smart Images

Figure CN116193050B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of image processing technology, and in particular to an image processing method, apparatus, device and storage medium. Background Art
[0002] In recent years, with the development of image processing technology, the use of image rendering technology has become more and more widespread. For example, a rendering device (such as a server, a terminal, etc.) renders an object to be rendered (such as a building, an animal, or a plant, etc.) in a map.
[0003] At present, when a rendering device renders an object to be rendered in a map, the rendering device needs to obtain image information (such as texture information, depth information, spatial coordinate points, etc.) of the object to be rendered in the map. Afterwards, the rendering device can render the object to be rendered in the map based on the acquired image information. However, in the above technical solution, when a part of the area in the object to be rendered changes, the rendering device needs to re-acquire the image information of the part of the area that has not changed in the object to be rendered, and re-render the part of the area that has been rendered in the object to be rendered (that is, the part that has not changed), which increases the rendering steps, prolongs the rendering time, and reduces the rendering efficiency. Summary of the invention
[0004] The present application provides an image processing method, apparatus, device and storage medium for solving the problem of low image rendering efficiency.
[0005] In order to achieve the above objectives, this application adopts the following technical solutions:
[0006] In a first aspect, the present application provides an image processing method, which is applied to a display device, wherein the display device stores a plurality of first image information, wherein the first image information is image information of a target area, and the zoom level of each first image information is different. The method comprises: the display device displays a first image corresponding to a first area in the target area, wherein the first image is an image corresponding to the image information of the first area in the second image information, and the second image information is first image information of a first zoom level. The display device receives a target instruction, wherein the target instruction is used to instruct to display an image corresponding to a second area in the target area. If the first area partially overlaps with the second area, the display device determines a first sub-area and a second sub-area, wherein the first sub-area is an area in the second area that overlaps with the first area, and the second sub-area is an area in the second area that does not overlap with the first area. The display device obtains a second image corresponding to the first sub-area from the first image. The display device obtains a third image information corresponding to the second sub-area from each first image information according to a preset zoom threshold, so as to obtain a plurality of third image information, wherein the zoom level of the third image information is less than or equal to the preset zoom threshold. The display device renders the image corresponding to the second sub-area according to each third image information, respectively, to generate a plurality of third images, wherein the plurality of third images correspond to the zoom levels of the plurality of third image information one by one. The display device splices the second image with each of the third images to generate a plurality of fourth images, where the plurality of fourth images are all images corresponding to the second area. The display device sequentially displays the plurality of fourth images in a preset order based on the zoom level corresponding to each of the third images.
[0007] Optionally, the method of "the display device obtains the third image information corresponding to the second sub-area from each first image information according to a preset zoom threshold" includes: the display device obtains the fourth image information corresponding to the second sub-area from each first image information to obtain multiple fourth image information. The display device obtains multiple third image information from the multiple fourth image information according to the preset zoom threshold.
[0008] Optionally, the image information includes: depth information, and the display device includes: a display screen. The image processing method also includes: the display device obtains the state information of the display screen, the first difference, and the second difference, the first difference is used to indicate the degree of difference between the image information of the second sub-area displayed by the pixel point in the display screen and the image information of the second sub-area collected, and the second difference is used to indicate the degree of difference between the image information of the second sub-area collected and the real image information of the second sub-area. The display device determines the third difference corresponding to each fourth image information according to the state information of the display screen, the first difference, and the depth information in each fourth image information, so as to determine a plurality of third differences, and the third difference is used to indicate the degree of difference allowed by the pixel point in the display screen. The display device calculates the difference between each third difference and the second difference respectively, determines a plurality of fourth differences, and the zoom levels of the plurality of fourth image information correspond to the plurality of fourth differences one by one. The display device uses the zoom level of the fourth image information corresponding to the smallest difference among the plurality of fourth differences as a preset zoom threshold.
[0009] Optionally, the above-mentioned method of "the display device obtains multiple third image information from multiple fourth image information according to a preset zoom threshold" includes: the display device obtains multiple third image information from multiple fourth image information according to a preset zoom threshold and a preset set, the preset set includes: multiple second zoom levels, the zoom level of the third image information is less than or equal to the preset zoom threshold: the zoom level of the third image information is less than or equal to the preset zoom threshold, and the zoom level of the third image information is equal to the second zoom level.
[0010] Optionally, the second sub-region includes: a plurality of first objects, the third image information includes: a plurality of first sub-image information, and one first object corresponds to one first sub-image information. The image processing method further includes: the display device obtains the second sub-image information and the third sub-image information in each third image information, the second sub-image information is the first sub-image information corresponding to the second object, the third sub-image information is the first sub-object information corresponding to the third object, and the second object and the third object are any object among the plurality of first objects. If the second object partially overlaps with the third object, the depth information in the second sub-image information is less than the depth information in the third sub-image information, and the zoom level of the second sub-image information is equal to the zoom level of the third sub-image information, then the display device determines the third region and the fourth region, the third region is the region corresponding to the second object in the second sub-region, and the fourth region is the region corresponding to the third object in the second sub-region that does not overlap with the region corresponding to the second object. The above-mentioned method of "the display device renders the image corresponding to the second sub-region according to the third image information to generate the third image" includes: the display device renders the image corresponding to the third region according to the second sub-image information to generate the first sub-image corresponding to the third region. The display device renders the image corresponding to the fourth area according to the image information corresponding to the fourth area in the third sub-image information to generate a second sub-image corresponding to the fourth area. The display device splices the first sub-image with the second sub-image to generate a third image, which includes: the first sub-image and the second sub-image.
[0011] In the second aspect, the present application provides an image processing device, which is applied to a display device. The display device stores multiple first image information, the first image information is the image information of the target area, and the zoom level of each first image information is different. The device includes: a display module, a receiving module and a processing module.
[0012] The display module is used to display the first image corresponding to the first area in the target area, the first image is the image corresponding to the image information of the first area in the second image information, and the second image information is the first image information of the first zoom level. The receiving module is used to receive the target instruction, and the target instruction is used to instruct to display the image corresponding to the second area in the target area. The processing module is used to determine the first sub-area and the second sub-area if the first area partially overlaps with the second area, the first sub-area is the area in the second area that overlaps with the first area, and the second sub-area is the area in the second area that does not overlap with the first area. The processing module is also used to obtain the second image corresponding to the first sub-area from the first image. The processing module is also used to obtain the third image information corresponding to the second sub-area from each first image information according to a preset zoom threshold, so as to obtain multiple third image information, and the zoom level of the third image information is less than or equal to the preset zoom threshold. The processing module is also used to render the image corresponding to the second sub-area according to each third image information, and generate multiple third images, and the multiple third images correspond to the zoom levels of the multiple third image information one by one. The processing module is also used to splice the second image with each third image respectively to generate multiple fourth images, and the multiple fourth images are all images corresponding to the second area. The display module is further used to display multiple fourth images in sequence according to a preset order based on the zoom level corresponding to each third image.
[0013] Optionally, the processing module is used to obtain fourth image information corresponding to the second sub-region from each first image information to obtain multiple fourth image information. The processing module is used to obtain multiple third image information from the multiple fourth image information according to a preset zoom threshold.
[0014] Optionally, the image information includes: depth information, and the display device includes: a display screen. The receiving module is further used to obtain the state information of the display screen, the first difference and the second difference, the first difference is used to indicate the degree of difference between the image information of the second sub-area displayed by the pixel point in the display screen and the image information of the collected second sub-area, and the second difference is used to indicate the degree of difference between the image information of the collected second sub-area and the real image information of the second sub-area. The processing module is used to determine the third difference corresponding to each fourth image information according to the state information of the display screen, the first difference and the depth information in each fourth image information, so as to determine multiple third differences, and the third difference is used to indicate the degree of difference allowed by the pixel point in the display screen. The processing module is used to calculate the difference between each third difference and the second difference respectively, determine multiple fourth differences, and the zoom levels of the multiple fourth image information correspond to the multiple fourth differences one by one. The processing module is used to use the zoom level of the fourth image information corresponding to the smallest difference among the multiple fourth differences as the preset zoom threshold.
[0015] Optionally, a processing module is used to obtain multiple third image information from multiple fourth image information according to a preset zoom threshold and a preset set, the preset set including: multiple second zoom levels, the zoom level of the third image information is less than or equal to the preset zoom threshold: the zoom level of the third image information is less than or equal to the preset zoom threshold, and the zoom level of the third image information is equal to the second zoom level.
[0016] Optionally, the second sub-region includes: a plurality of first objects, and the third image information includes: a plurality of first sub-image information, and one first object corresponds to one first sub-image information. The processing module is further used to obtain the second sub-image information and the third sub-image information in each third image information, the second sub-image information is the first sub-image information corresponding to the second object, the third sub-image information is the first sub-object information corresponding to the third object, and the second object and the third object are any object among the plurality of first objects. The processing module is further used to determine the third region and the fourth region if the second object partially overlaps with the third object, the depth information in the second sub-image information is less than the depth information in the third sub-image information, and the zoom level of the second sub-image information is equal to the zoom level of the third sub-image information, the third region is the region corresponding to the second object in the second sub-region, and the fourth region is the region corresponding to the third object in the second sub-region that does not overlap with the region corresponding to the second object. The processing module is used to render the image corresponding to the third region according to the second sub-image information to generate the first sub-image corresponding to the third region. The processing module is used to render the image corresponding to the fourth region according to the image information corresponding to the fourth region in the third sub-image information to generate the second sub-image corresponding to the fourth region. The processing module is used to perform splicing processing on the first sub-image and the second sub-image to generate a third image, and the third image includes: the first sub-image and the second sub-image.
[0017] In a third aspect, the present application provides an image processing device, comprising: a processor and a memory, the processor and the memory being coupled, the memory being used to store one or more programs, the one or more programs comprising computer-executable instructions, and when the image processing device is running, the processor executes the computer-executable instructions stored in the memory to implement any optional image processing method described in the first aspect above.
[0018] In a fourth aspect, the present application provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on a computer, the computer executes any optional image processing method described in the first aspect.
[0019] In a fifth aspect, the present application provides a computer program product applied to a server, the computer program product comprising computer instructions. When the computer instructions are executed on the server, the server implements any optional image processing method described in the first aspect.
[0020] In the above scheme, the technical problems that can be solved and the technical effects achieved by the image processing device, equipment, computer storage medium or computer program product can refer to the technical problems and technical effects solved by the above-mentioned first aspect, and will not be repeated here.
[0021] The technical solution provided by the present application brings at least the following beneficial effects: the display device can store the first image information of the target area at different zoom levels. The display device can display the first image corresponding to the first area in the target area, the first image is the image corresponding to the image information of the first area in the second image information, and the second image information is the first image information at the first zoom level. Afterwards, the display device can receive a target instruction, and the target instruction is used to indicate the display of the image corresponding to the second area in the target area. Afterwards, the display device can determine whether the first area overlaps with the second area. If the display device determines that the first area partially overlaps with the second area, the display device determines the first sub-area and the second sub-area, the first sub-area is the area in the second area that overlaps with the first area, and the second sub-area is the area in the second area that does not overlap with the first area. Afterwards, the display device obtains the second image corresponding to the first sub-area from the first image. In other words, the display device does not need to re-acquire the image information of the repeated area and re-render the image corresponding to the repeated area. In this way, the amount of information processed by the display device can be reduced, and the rendering steps can be reduced. In addition, the display device obtains the third image information corresponding to the second sub-area from each first image information according to the preset zoom threshold to obtain multiple third image information, and the zoom level of the third image information is less than or equal to the preset zoom threshold. Afterwards, the display device renders the image corresponding to the second sub-area according to each third image information, and generates a plurality of third images, and the plurality of third images correspond to the zoom levels of the plurality of third image information one by one. In addition, the display device splices the second image with each third image, and generates a plurality of fourth images. That is, the display device can splice the image corresponding to the area overlapping with the updated image in the image before updating and the image corresponding to the area not overlapping with the image before updating in the updated image, and generate the updated image. In this way, the rendering time can be shortened and the rendering efficiency can be improved. In addition, the display device sequentially displays the plurality of fourth images in a preset order based on the zoom level corresponding to each third image. In other words, the display device can generate a plurality of images with a zoom level less than a preset zoom threshold, and sequentially display the images in a preset order, and the image information with a zoom level less than the preset zoom threshold has a small amount of information, which shortens the time for the display device to generate images, so that the display device can promptly display the image corresponding to the area not overlapping with the image before updating in the updated image. In this way, the display effect of the image is increased, the time for displaying the image is shortened, and the user experience is improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 A schematic diagram of an example of rendering an image by a rendering device provided in an embodiment of the present application;
[0023] Figure 2A schematic diagram of an example of rendering an image by another rendering device provided in an embodiment of the present application;
[0024] Figure 3 A flowchart of an image processing method provided in an embodiment of the present application;
[0025] Figure 4 An example schematic diagram of the relationship between an observation point, a screen and a display object provided in an embodiment of the present application;
[0026] Figure 5 A schematic diagram of an example of calculating an optimal data level for a rendering device provided in an embodiment of the present application;
[0027] Figure 6 A schematic diagram of an example of a rendering device computing a data request stack provided in an embodiment of the present application;
[0028] Figure 7 A schematic diagram of an example of updating an image by a rendering device provided in an embodiment of the present application;
[0029] Figure 8 A schematic diagram of another example of updating an image by a rendering device provided in an embodiment of the present application;
[0030] Fig. 9 A flowchart of another image processing method provided in an embodiment of the present application;
[0031] Fig.10 A flowchart of another image processing method provided in an embodiment of the present application;
[0032] Fig.11 A flowchart of another image processing method provided in an embodiment of the present application;
[0033] Fig.12 A flowchart of another image processing method provided in an embodiment of the present application;
[0034] Fig.13 A schematic diagram of an example of a terminal generating an image information stack provided in an embodiment of the present application;
[0035] Fig.14 A flowchart of another image processing method provided in an embodiment of the present application;
[0036] Fig.15 A schematic diagram of an example of a terminal rendering an image provided in an embodiment of the present application;
[0037] Fig.16 A schematic diagram of an example of updating an image of a terminal provided in an embodiment of the present application;
[0038] Fig.17A flowchart of another image processing method provided in an embodiment of the present application;
[0039] Fig.18 A schematic diagram of the structure of an image processing device provided in an embodiment of the present application;
[0040] Fig.19 A schematic diagram of the structure of an image processing device provided in an embodiment of the present application;
[0041] Fig. 20 A conceptual partial view of a computer program product provided for an embodiment of the present application. DETAILED DESCRIPTION
[0042] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0043] In this article, the character " / " generally indicates that the objects before and after are in an "or" relationship. For example, A / B can be understood as A or B.
[0044] The terms “first” and “second” in the description and claims of the present application are used to distinguish different objects rather than to describe a specific order of the objects.
[0045] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or modules is not limited to the listed steps or modules, but may optionally include other steps or modules that are not listed, or may optionally include other steps or modules that are inherent to these processes, methods, products or devices.
[0046] In addition, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present concepts in a specific way.
[0047] Before introducing the image processing method provided by the embodiment of the present application in detail, the implementation environment and application scenarios of the embodiment of the present application are first introduced.
[0048] First, the application scenarios of the embodiments of the present application are introduced.
[0049] The image processing method of the embodiment of the present application is applied to the scene of processing images. In the related art, when a rendering device renders an object to be rendered in a map, the rendering device needs to obtain image information (such as texture information, depth information, spatial coordinate points, etc.) of the object to be rendered in the map. Afterwards, the rendering device can render the object to be rendered in the map according to the acquired image information.
[0050] like Figure 1 As shown, in the process of rendering the object to be rendered by the rendering device, the rendering device can generate the following image based on the spatial coordinate points of the object to be rendered through the shader: Figure 1 The spatial model 101 of the object to be rendered is shown in (a). Afterwards, the rendering device can perform a fragment (i.e., pixel) processing on the spatial model 101 to generate a Figure 1 Afterwards, the rendering device may shade the fragments 102, 103, 104, and 105 through the shader based on the depth information, texture information, and illumination information of the object to be rendered, as well as the preset parameters of the shader, to generate the following: Figure 1 The fragment 106, the fragment 107, the fragment 108 and the fragment 109 shown in (c) in FIG. Thereafter, the rendering device may fit the fragment 106, the fragment 107, the fragment 108 and the fragment 109 onto the space model 101 to generate the following Figure 1 The space model 110 shown in (d) in FIG. 1 is then rasterized by the rendering device and displayed on the screen.
[0051] It should be noted that, during the process of rendering the object to be rendered by the rendering device, the rendering device may render the object to be rendered multiple times. Figure 2 As shown, during the first rendering process of the rendering device for the object to be rendered, the rendering device can obtain the following Figure 2 The image 201 and the fragment set 202 shown in (a) above are shown in FIG. 2 , wherein the fragment set 202 includes fragment X1, fragment X2, fragment X3, fragment X4, fragment X5, and fragment X6, and the depth information of the fragments X1, X2, X3, X4, X5, and X6 is 5. Afterwards, the rendering device may attach the fragments X1, X2, X3, X4, X5, and X6 to the image 201 to generate the following image: Figure 2 Then, during the second rendering of the object to be rendered by the rendering device, the rendering device can obtain the following image 203: Figure 2The fragment set 204 shown in (c) includes: fragment Y1, fragment Y2, fragment Y3, fragment Y4, fragment Y5 and fragment Y6, and the depth information of fragment Y1 is 5, the depth information of fragment Y2 is 4, the depth information of fragment Y3 is 5, the depth information of fragment Y4 is 3, the depth information of fragment Y5 is 4, and the depth information of fragment Y6 is 5. Afterwards, the rendering device can fit the fragment Y2, fragment Y4, fragment Y5 and fragment Y6 onto the image 203 according to the depth information of the fragments at the same position in the fragment set 202 and the fragment set 204, and generate the following. Figure 2 Image 205 shown in (d).
[0052] It should be noted that in the above technical solution, the format of the image information can be a three-dimensional tiles (3D Tiles) format. As shown in Table 1, it shows the image information of city A in 3D Tiles format. Among them, city A includes area B and area C, area B includes shopping mall D and community E, area C includes school F and community G, shopping mall D includes parking lot H and building I, community E includes building J and square K, school F includes playground L and building M, community G includes square N and parking lot O, building I includes window P and window Q, building J includes window R and window S, and building M includes window T and window U.
[0053] Table 1 Image information
[0054]
[0055] It should be noted that when the image displayed on the screen changes, the rendering device can update the image displayed on the screen. Figure 3 , introduces the process of updating images by the rendering device. The specific steps are as follows:
[0056] Step 1: The rendering device determines the scene change. The rendering device can determine the scene change by receiving a change instruction of the image displayed on the screen, and determine the new object in the changed image.
[0057] Step 2: The rendering device calculates the optimal data level. The rendering device can determine the distance between the new object and the observation point at each node based on the distance between the observation point and the screen, the size information of the pixel points, the geometric error value of the new object, and the depth information corresponding to each node of the new object. The rendering device can also calculate the allowable error value of the pixel points corresponding to each node of the new object based on the distance between the new object and the observation point at each node, the height of the screen, the viewing angle of the observation point relative to the screen, and the screen space error value corresponding to the pixel points, and calculate the difference between the geometric error value corresponding to each node and the allowable error value of the pixel points, and use the node with the smallest corresponding difference as the optimal data level.
[0058] It should be noted that the rendering device determines the distance between the new object under each node and the observation point based on the distance between the observation point and the screen, the size information of the pixel points, the geometric error value of the new object and the depth information corresponding to the new object at each node. The process can refer to the introduction of conventional technology for determining the distance between the observation point and the object based on the distance between the observation point and the screen, the pixel size, the geometric error value and the depth information, which will not be repeated here.
[0059] It should be noted that the allowed error value of the pixel point corresponding to each node of the new object can be expressed by formula 1.
[0060]
[0061] Among them, y i It is used to indicate the allowed error value of the pixel corresponding to the new object at the i-th node, x is used to indicate the screen space error value corresponding to the pixel, α is used to indicate the viewing angle of the observation point relative to the screen, and d i It is used to indicate the distance between the observation point and the i-th node of the new object, and h is used to indicate the height of the screen.
[0062] For example, Figure 4 As shown, observation point 401 is a preset observation position relative to screen 402, object 403 is an object to be displayed on screen 402, and the field of view angle of observation point 401 relative to screen 402 is 1.2 degrees, the height of screen 402 is 0.1 meters, the distance between screen 402 and object 403 is 15 meters, and the screen space error value corresponding to the pixel point is 2, then the allowable error value of the pixel point corresponding to object 403 is 360.
[0063] Step 3: The rendering device calculates a data request stack. The rendering device may determine the image information of all nodes that are less than or equal to the best data level, and sort the image information of all nodes that are less than or equal to the best data level according to the order of the size of the nodes to generate a data request stack.
[0064] Exemplarily, in combination with the image information shown in Table 1, Figure 5 As shown in FIG. 1 , if the node of the best data level is 4, the rendering device determines that the nodes less than or equal to the best data level include: 0, 1, 2, 3 and 4, and node 0 is the root node. Afterwards, the rendering device sorts the image information of each node in order from small to large, and generates the following: Figure 6 The data request stack 600 shown includes: information 601, information 602, information 603, information 604 and information 605. Among them, information 601 is the information of node 0, information 602 is the information of node 1, information 603 is the information of node 2, information 604 is the information of node 3, and information 605 is the information of node 4.
[0065] Step 4: The rendering device obtains new data. The rendering device obtains image information (ie, new data) from the data request stack.
[0066] Step 5: The rendering device performs rasterization processing on the new data through a Z-buffer algorithm. The rendering device can perform rasterization processing on the new data through a Z-buffer algorithm to generate an image of a new object.
[0067] Step 6: The rendering device updates the scene. The rendering device displays the image of the new object on the screen.
[0068] It should be noted that after the rendering device updates the scene, the rendering device can sequentially obtain image information of the new object at different nodes from the data request stack, and update the scene through steps five and six until all data in the data request stack is obtained.
[0069] In the related art, a rendering device can update an image in the following two ways.
[0070] Method 1: If the updated image contains a portion of the image before the update, and the extra area in the updated image is the area corresponding to the portion of the image in the image before the update, the rendering device retains the portion of the image before the update, and uses the portion of the image as the image of the extra area in the updated image, and splices the portion of the image according to the corresponding area as the updated image. Afterwards, the rendering device obtains the image information of the extra area in the updated image, and renders the extra area in the updated image based on the image information of the extra area in the updated image to generate the final updated image.
[0071] Exemplarily, in combination with the image information shown in Table 1, Figure 7 As shown, before the rendering device updates the image, the rendering device displays the image on the screen. Figure 7The image 700 shown in (a) includes: region 701, region 702, region 703 and region 704. Image 700 is an image generated by the rendering device by attaching fragment B1 to region 701, attaching fragment C1 to region 702, attaching fragment B2 to region 703, and attaching fragment C2 to region 704. Fragments B1 and B2 are both fragments of region B, and fragments C1 and C2 are both fragments of region C. In response to the user sliding the image 700 displayed on the screen to the left by one pixel, the rendering device retains the image corresponding to region 702 and the image corresponding to region 704 in image 700, and attaches fragments C1 and C2 to the extra area after sliding to the left according to their positions in image 700, thereby generating an image as shown in FIG. Figure 7 The image 705 shown in (b) includes: region 702, region 704, region 706, and region 707. Afterwards, the rendering device obtains the fragment C3 corresponding to region 706 and the fragment C4 corresponding to region 707, and fits the fragment C3 to region 706 and fits the fragment C4 to region 707 to generate the following: Figure 7 The image 708 shown in (c) is displayed on the screen.
[0072] However, in the above-mentioned method 1, when the rendering device does not obtain the image information of the extra area or does not complete the rendering of the extra area, the rendering device cannot display the real image of the extra area through the screen, which seriously affects the user experience.
[0073] In a second method, after the rendering device determines to update the image, the rendering device obtains image information of a region corresponding to the updated image, and renders the region corresponding to the updated image to generate an updated image.
[0074] Exemplarily, in combination with the image information shown in Table 1, Figure 7 As shown, before the rendering device updates the image, the rendering device will Figure 8 The fragments in the fragment set 801 shown in (a) are attached to Figure 8 In the image 802 shown in (a), the generated Figure 8 The image 803 shown in (b) is displayed on the screen. The image 802 includes: region 804, region 805, region 806 and region 807. The fragment set 801 includes: fragment B1, fragment B2, fragment C1 and fragment C2. Among them, fragment B1 and fragment B2 are both fragments of region B, fragment C1 and fragment C2 are both fragments of region C, and the depth information of fragment B1, fragment B2, fragment C1 and fragment C2 is 5. Afterwards, in response to the user sliding the image 803 displayed on the screen to the left by one pixel, the rendering device obtains the following Figure 8The fragment set 808 and image 809 shown in (c) above are shown in FIG. 8. The image 809 includes: region 806, region 807, region 810, and region 811. The fragment set 808 includes: fragment A1, fragment A2, fragment A3, and fragment A4. Among them, fragment A1, fragment A2, fragment A3, and fragment A4 are all fragments of city A, and the depth information of fragment A1, fragment A2, fragment A3, and fragment A4 is 4. Afterwards, the rendering device fits the fragments in the fragment set 808 into the image 809 to generate the following image: Figure 8 Image 812 shown in (d).
[0075] However, in the above-mentioned method 2, when a partial area in the object to be rendered changes, the rendering device needs to re-acquire the image information of the partial area in the object to be rendered that has not changed, and re-render the partial area in the object to be rendered (i.e., the partial area that has not changed), which increases the rendering steps, prolongs the rendering time, and reduces the rendering efficiency.
[0076] In order to solve the above problems, an embodiment of the present application provides an image processing method. After receiving an instruction to update an image, the display device can determine whether there is an overlapping area between the updated image and the image before the update. If the display device determines that there is a partial overlapping area between the updated image and the image before the update, the display device obtains the image corresponding to the overlapping area from the image before the update. After that, the display device obtains the image information of the area outside the overlapping area in the updated image at different zoom levels, and renders the area outside the overlapping area to generate images corresponding to the area outside the overlapping area at different zoom levels. After that, the display device splices the image corresponding to the overlapping area with the image corresponding to the area outside the overlapping area in order from small to large zoom levels to generate an updated image, and displays the updated image in sequence. That is, the display device can splice the image corresponding to the area overlapping with the updated image in the image before the update and the image corresponding to the area not overlapping with the image before the update in the updated image to generate an updated image. In this way, the rendering time can be shortened and the rendering efficiency can be improved.
[0077] The display device may be a terminal or a server.
[0078] The terminal may be a mobile phone, tablet computer, desktop, laptop, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, etc., which has transceiver functions and can render images. The present application does not impose any special restrictions on the specific form of the terminal. It can interact with the user through one or more methods such as keyboard, touch pad, touch screen, remote control, voice interaction or handwriting device.
[0079] The server may be a single physical server, or a server cluster consisting of multiple servers. Alternatively, the server cluster may be a distributed cluster. Alternatively, the server may be a cloud server. The embodiments of the present application do not limit the specific implementation of the server.
[0080] After introducing the application scenario and implementation environment of the embodiment of the present application, the method for generating early warning information provided by the embodiment of the present application is introduced in detail below in combination with the above-mentioned implementation environment.
[0081] The methods in the following embodiments can all be implemented in the above application scenarios and implementation environments. The following takes the terminal as an example of a display device and specifically describes the embodiments of the present application in conjunction with the accompanying drawings of the specification.
[0082] Fig. 9 A schematic diagram of a flow chart of an image processing method provided in an embodiment of the present application. Fig. 9 As shown, the method may include: S901-S909.
[0083] S901. The terminal displays a first image corresponding to a first area in a target area.
[0084] The target area includes: a first area.
[0085] It should be noted that the target area is not limited in the embodiments of the present application. For example, the target area may be the area where a school is located, and the first area may be the area where the playground of the school is located. For another example, the target area may be the area where a high-speed railway station is located, and the first area may be the area where the exit of the high-speed railway station is located. For another example, the target area may be the area where a shopping mall is located, and the first area may be the area where the parking lot of the shopping mall is located.
[0086] In an embodiment of the present application, the terminal stores multiple first image information, the first image information is image information of the target area, the zoom level of each first image information is different, the first image is the image corresponding to the image information of the first area in the second image information, and the second image information is the first image information at the first zoom level.
[0087] That is to say, the first image is an image generated by the terminal by rendering the image corresponding to the first area according to the image information of the first area in the second image information.
[0088] It should be noted that, for the process in which the terminal renders the image corresponding to the first area according to the image information of the first area in the second image information to generate the first image, reference may be made to the above Figure 1 The embodiments shown are not described in detail here.
[0089] It should be noted that the zoom level in the embodiment of the present application can refer to the node in the 3DTiles format in the embodiment shown in Table 1 above, which will not be described in detail here.
[0090] It should be noted that the zoom level of an image is associated with the resolution of the image. For example, an image with a small zoom level also has a small resolution. For another example, an image with a large zoom level also has a large resolution. In addition, the zoom level of an image is associated with the amount of information in the image information. For example, an image with a small zoom level also has a small amount of information in the image information. For another example, an image with a large zoom level also has a large amount of information in the image information.
[0091] In a possible design, the image information may include: depth information, texture information, position information, etc.
[0092] It should be noted that the embodiments of the present application do not limit the location information. For example, the location information may be longitude and latitude information. For another example, the location information may be a spatial coordinate point. For another example, the location information may be address information of a standard nine-level address rule.
[0093] In a possible implementation manner, the terminal may include: a display screen. The terminal may display the first image through the display screen.
[0094] S902: The terminal receives a target instruction.
[0095] The target instruction is used to instruct to display an image corresponding to the second area in the target area, and the target area also includes: the second area.
[0096] In a possible implementation manner, the terminal may receive a target instruction from another device.
[0097] In another possible implementation, the terminal may receive an operation input by the user and generate a target instruction.
[0098] Exemplarily, the screen of the mobile phone displays an image corresponding to area A (i.e., the first area) in the map, and area A includes: area B and area C. Afterwards, the terminal can receive an operation (such as a sliding operation) of the user on the map displayed on the screen, and generate a target instruction, which is used to instruct to display an image corresponding to area D (i.e., the second area) in the map, and area D includes: area C and area E.
[0099] In one possible design, the target instruction may include location information of the second area.
[0100] In some embodiments, the terminal executes S903 in response to the received target instruction.
[0101] S903: The terminal determines whether the first area and the second area partially overlap.
[0102] In a possible implementation, the terminal stores the location information of the first area, and can determine whether the first area and the second area partially overlap according to the location information of the first area and the location information of the second area.
[0103] In some embodiments, if the terminal determines that the first area and the second area do not overlap, the terminal can obtain the image information of the second area from the second image information according to the location information of the second area, and generate a fourth image according to the image information of the second area, and the fourth image is the image corresponding to the second area. In other words, if the area corresponding to the updated image does not overlap with the area corresponding to the image before the update, the updated image is the image corresponding to the other areas in the target area except the first area.
[0104] In other embodiments, if the terminal determines that the first area and the second area partially overlap, the terminal executes S904. That is, if the area corresponding to the updated image partially overlaps the area corresponding to the image before the update, the updated image contains part of the image before the update and images corresponding to other areas in the target area except the first area.
[0105] S904: The terminal determines a first sub-area and a second sub-area.
[0106] The first sub-region is a region in the second region that overlaps with the first region, and the second sub-region is a region in the second region that does not overlap with the first region.
[0107] In a possible implementation manner, the terminal may determine the first sub-area and the second sub-area according to the location information of the first area and the location information of the second area.
[0108] It should be noted that the process of the terminal determining the first sub-area and the second sub-area based on the location information of the first area and the location information of the second area can refer to the introduction of determining overlapping areas and non-overlapping areas based on the location information of different areas in conventional technology, and this application will not go into details here.
[0109] In some embodiments, after the terminal determines the first sub-area and the second sub-area, the terminal may determine the location information of the first sub-area and the second sub-area according to the location information of the first area, the location information of the second area, the first sub-area and the second sub-area. Afterwards, the terminal executes S905.
[0110] S905. The terminal obtains a second image corresponding to the first sub-region from the first image.
[0111] In a possible implementation, the terminal may perform segmentation processing on the first image according to the position information of the first sub-region to obtain a second image, wherein the second image is an image corresponding to the first sub-region in the first image.
[0112] S906: The terminal obtains third image information corresponding to the second sub-region from each first image information according to a preset zoom threshold.
[0113] The third image information is image information corresponding to the second sub-region in the first image information, and the zoom level of the third image information is less than or equal to a preset zoom threshold.
[0114] In a possible implementation manner, the terminal may obtain the third image information corresponding to the second sub-region from each first image information according to a preset zoom threshold and the position information of the second sub-region, so as to obtain multiple third image information.
[0115] Exemplarily, the multiple first image information includes: information A, information B and information C. The zoom level of information A is 1, the zoom level of information B is 2, the zoom level of information C is 3, and information A includes: information D of cell A and information E of cell B, information B includes: information F of cell A and information G of cell B, and information C includes: information H of cell A and information I of cell B. If the preset zoom threshold is 2, and the location information of the second sub-area corresponds to cell A, the multiple third image information acquired by the terminal includes: information D and information F.
[0116] It should be noted that the embodiment of the present application does not limit the order of S905 and S906. For example, the terminal may first execute S905 and then execute S906. For another example, the terminal may first execute S906 and then execute S905. For another example, the terminal may execute S905 and S906 at the same time.
[0117] S907: The terminal renders the images corresponding to the second sub-regions according to each piece of third image information to generate multiple third images.
[0118] The third image is an image corresponding to the second sub-region.
[0119] It should be noted that, for the process in which the terminal renders the image corresponding to the second sub-region according to each third image information to generate the third image, reference can be made to the above Figure 1 The embodiments shown are not described in detail here.
[0120] In some embodiments, after the terminal generates multiple third images, the terminal may establish a correspondence between the third images and the zoom levels of the third image information, and the multiple third images correspond to the zoom levels of the multiple third image information one by one.
[0121] Exemplarily, the plurality of third images include: image A, image B, and image C. Image A is an image generated by the terminal according to information A (i.e., the third image), image B is an image generated by the terminal according to information B (i.e., the third image), and image C is an image generated by the terminal according to information C (i.e., the third image). If the zoom level of information A is 1, the zoom level of information B is 2, and the zoom level of information C is 3, the terminal determines that the zoom level corresponding to image A is 1, the zoom level corresponding to image B is 2, and the zoom level corresponding to image C is 3.
[0122] It should be noted that as the zoom level decreases, the amount of image information also decreases, and the time it takes for the terminal to generate an image also decreases. In other words, the terminal can shorten the time it takes to generate the third image based on the third image information with a small zoom level.
[0123] S908: The terminal splices the second image with each third image respectively to generate a plurality of fourth images.
[0124] The fourth image includes: a second image and a third image. That is, different fourth images include the same second image, and different fourth images include third images corresponding to different zoom levels.
[0125] Exemplarily, the plurality of third images include: image A, image B and image C, image A corresponds to a zoom level of 1, image B corresponds to a zoom level of 2, and image C corresponds to a zoom level of 3. If the second image is image D, the terminal splices image D with image A to generate image E; the terminal splices image D with image B to generate image F; the terminal splices image D with image C to generate image G. Among them, image E includes: image D and image A, image F includes: image D and image B, and image G includes: image D and image C.
[0126] In the embodiment of the present application, the plurality of fourth images are all images corresponding to the second area.
[0127] S909: The terminal displays multiple fourth images in sequence according to a preset order based on the zoom level corresponding to each third image.
[0128] In a possible implementation, the preset order may be an order from small to large. The terminal may sort the plurality of fourth images in an order from small to large in zoom level based on the zoom level of each third image information, and sequentially display the sorted plurality of fourth images through the display screen. It is understandable that when the terminal displays the image corresponding to the second area, the terminal displays the second image in the first sub-area, and the terminal sequentially displays the third image in the second sub-area in an order from small to large in zoom level. In other words, the terminal only dynamically displays the third image in the second sub-area, and the displayed third image changes dynamically with a trend from blurred to clear.
[0129] Optionally, the preset order may be an order from large to small.
[0130] The technical solution provided by the above embodiment brings at least the following beneficial effects: the terminal can store the first image information of the target area at different zoom levels. The terminal can display the first image corresponding to the first area in the target area, the first image is the image corresponding to the image information of the first area in the second image information, and the second image information is the first image information at the first zoom level. Afterwards, the terminal can receive a target instruction, and the target instruction is used to instruct to display the image corresponding to the second area in the target area. Afterwards, the terminal can determine whether the first area and the second area partially overlap. If the terminal determines that the first area and the second area partially overlap, the terminal determines the first sub-area and the second sub-area, the first sub-area is the area in the second area that overlaps with the first area, and the second sub-area is the area in the second area that does not overlap with the first area. Afterwards, the terminal obtains the second image corresponding to the first sub-area from the first image. In other words, the terminal does not need to re-acquire the image information of the repeated area and re-render the image corresponding to the repeated area. In this way, the amount of information processed by the terminal can be reduced, and the rendering steps can be reduced. In addition, the terminal obtains the third image information corresponding to the second sub-area from each first image information according to the preset zoom threshold to obtain multiple third image information, and the zoom level of the third image information is less than or equal to the preset zoom threshold. Afterwards, the terminal renders the image corresponding to the second sub-area according to each third image information, and generates a plurality of third images, and the plurality of third images correspond to the zoom levels of the plurality of third image information one by one. In addition, the terminal splices the second image with each third image, and generates a plurality of fourth images. That is, the terminal can splice the image corresponding to the area overlapping with the updated image in the image before updating and the image corresponding to the area not overlapping with the image before updating in the updated image, and generate the updated image. In this way, the rendering time can be shortened and the rendering efficiency can be improved. In addition, the terminal displays the plurality of fourth images in sequence according to a preset order based on the zoom level corresponding to each third image. In other words, the terminal can generate a plurality of images with a zoom level less than a preset zoom threshold, and display the images in sequence according to a preset order, and the amount of information of the image information with a zoom level less than the preset zoom threshold is small, which shortens the time for the terminal to generate images, so that the terminal can promptly display the image corresponding to the area not overlapping with the image before updating in the updated image. In this way, the display effect of the image is increased, the time for displaying the image is shortened, and the user experience is improved.
[0131] It should be noted that when the terminal acquires the third image information, if the amount of first image information stored in the terminal is large, the amount of information processed by the terminal is large, which prolongs the rendering time and seriously affects the rendering efficiency.
[0132] In some embodiments, Fig.10 As shown, in the image processing method, S906 may include: S1001-S1002.
[0133] S1001. A terminal obtains fourth image information corresponding to a second sub-region from each first image information.
[0134] The fourth image information is image information corresponding to the second sub-region in the first image information.
[0135] In a possible implementation manner, the terminal may obtain the fourth image information corresponding to the second sub-area from each first image information according to the position information of the second sub-area, so as to obtain multiple fourth image information.
[0136] S1002: The terminal obtains multiple third image information from multiple fourth image information according to a preset zoom threshold.
[0137] In a possible implementation, the terminal may, based on a preset zoom threshold and the zoom level of each of the multiple fourth image information, take the fourth image information among the multiple fourth image information whose zoom level is less than the preset zoom threshold as the third image information to obtain multiple third image information.
[0138] It is understandable that the terminal can obtain multiple fourth image information from multiple first image information according to the location information of the second sub-area. In this way, the amount of image information obtained by the terminal can be reduced. In addition, the terminal can obtain multiple third image information from multiple fourth image information according to a preset zoom threshold. In other words, the terminal can filter the obtained image information. In this way, the amount of information processed by the terminal can be reduced, the rendering time can be shortened, and the rendering efficiency can be improved.
[0139] It should be noted that, as the area displayed on the display screen changes, the correspondence between the preset zoom threshold and the changed area may be affected, thereby reducing the accuracy of the multiple third image information determined by the terminal.
[0140] In some embodiments, Fig.11 As shown, after S904, the image processing method may further include: S1101.
[0141] S1101. The terminal obtains status information of a display screen, a first difference, and a second difference.
[0142] The second difference is used to indicate the difference between the captured image information of the second sub-region and the real image information of the second sub-region. Figure 3 Geometric error values in the illustrated embodiment.
[0143] In the embodiment of the present application, the first difference value is used to indicate the degree of difference between the image information of the second sub-area displayed by the pixel point in the display screen and the image information of the second sub-area collected. That is, the first difference value is the above Figure 3 Screen space error values corresponding to pixel points in the illustrated embodiment.
[0144] In the embodiment of the present application, the status information of the display screen may include: height information, pixel size information, preset field of view angle information and preset distance information. Among them, the height information is used to indicate the height of the display screen, the pixel size information is used to indicate the pixel size in the display screen, the preset field of view angle information is used to indicate the angle of the preset observation point relative to the display screen, and the preset distance information is used to indicate the distance between the preset observation point and the display screen. That is, the height information is the above Figure 3 In the embodiment shown, the height and pixel size information of the screen are as above Figure 3 In the embodiment shown, the pixel size information and the preset viewing angle information are as follows: Figure 3 In the embodiment shown, the viewing angle of the observation point relative to the screen, the preset distance information is as follows: Figure 3 The distance between the observation point and the screen in the embodiment shown.
[0145] In the embodiment of the present application, after S1001, the image processing method may further include: S1102-S1104.
[0146] S1102: The terminal determines a third difference value corresponding to each piece of fourth image information according to the state information of the display screen, the first difference value, and the depth information in each piece of fourth image information.
[0147] In a possible implementation, the terminal may determine the distance between the second sub-area at each zoom level and the preset observation point based on the preset distance information, the pixel size information, the first difference value, and the depth information in each fourth image information. Afterwards, the terminal may determine the third difference value corresponding to each fourth image information based on the distance between the second sub-area at each zoom level and the preset observation point, the height information, the preset field of view angle information, and the first difference value, and the third difference value is used to indicate the degree of difference allowed for the pixels in the display screen.
[0148] It should be noted that the process of determining the distance between the second sub-region of each zoom level and the preset observation point according to the preset distance information, the pixel size information, the first difference and the depth information in each fourth image information can refer to the above Figure 3 In the illustrated embodiment, the rendering device determines the process of determining the distance between the new object under each node and the observation point based on the distance between the observation point and the screen, the size information of the pixel points, the geometric error value of the new object and the depth information corresponding to the new object at each node, which is not described in detail here.
[0149] In a possible design, the terminal uses the above method to obtain the distance, height information, preset field of view angle information and the first difference between the second sub-area of each zoom level and the preset observation point. Figure 3 Formula 1 in the embodiment shown in the figure determines the third difference value corresponding to each fourth image information. That is, the third difference value is the above Figure 3 The allowable error value of a pixel in the embodiment shown.
[0150] S1103. The terminal calculates the difference between each third difference and the second difference respectively, and determines a plurality of fourth differences.
[0151] The plurality of fourth image information corresponds one-to-one to the plurality of third difference values.
[0152] S1104. The terminal uses the zoom level of the fourth image information corresponding to the smallest difference value among the multiple fourth differences as a preset zoom threshold.
[0153] Exemplarily, the plurality of fourth differences include: difference A, difference B, and difference C. Difference A corresponds to fourth image information A at a zoom level of 2, difference B corresponds to fourth image information B at a zoom level of 1, and difference A corresponds to fourth image information C at a zoom level of 3. If difference A is 5, difference B is 2, and difference C is 3.6, the terminal determines that the preset zoom threshold is 1.
[0154] It is understandable that the terminal can determine the preset zoom threshold value by displaying the state information of the screen, the first difference, the second difference, and the depth information in each fourth image information. In other words, the terminal can determine the most appropriate zoom level of the second sub-area in the display screen by displaying the state information of the screen, the first difference, the second difference, and the depth information in each fourth image information. In this way, the accuracy of the determined image information can be improved, and the display effect of the image corresponding to the second sub-area displayed subsequently can be improved, thereby improving the user experience.
[0155] It should be noted that, when the terminal obtains the third image information, if the amount of fourth image information obtained by the terminal is large, the amount of information processed by the terminal is large, which prolongs the rendering time and seriously affects the rendering efficiency.
[0156] In some embodiments, Fig.12 As shown, in the image processing method, S1002 may include: S1201.
[0157] S1201. The terminal obtains multiple third image information from multiple fourth image information according to a preset zoom threshold and a preset set.
[0158] In a possible implementation, the terminal stores a preset set, which includes: multiple second zoom levels. The terminal can use the fourth image information whose zoom level is less than or equal to the preset zoom threshold and whose zoom level is equal to the second zoom level among the multiple fourth image information as the third image information according to the preset zoom threshold, the preset set and the zoom level of each fourth image information among the multiple fourth image information. In other words, the zoom level of the third image information is less than or equal to the preset zoom threshold, which specifically means: the zoom level of the third image information is less than or equal to the preset zoom threshold, and the zoom level of the third image information is equal to the second zoom level.
[0159] Exemplarily, the plurality of fourth image information includes: information A, information B, information C, and information D. The zoom level of information A is 6, the zoom level of information B is 5, the zoom level of information C is 3, and the zoom level of information D is 1. If the preset zoom threshold is 5, and the preset set includes: 0 (i.e., the second zoom level), 1, 2, 5, 6, and 8, the terminal uses both information B and information D as the third image information, and the plurality of third image information includes: information B and information D.
[0160] In a possible design, after the terminal obtains multiple third image information from multiple fourth image information, the terminal can sort the multiple third image information in ascending order according to the zoom level of each third image information to generate an image information stack. Figure 3 A data request stack in the illustrated embodiment.
[0161] Exemplarily, in combination with the image information shown in Table 1, Fig.13 As shown, the plurality of fourth image information includes: information A, information B, information C and information D. The zoom level of information A is 0, the zoom level of information B is 1, the zoom level of information C is 2, and the zoom level of information D is 3. If the preset zoom threshold is 3, and the preset set includes: 0 (i.e., the second zoom level), 1, 3 and 5, then Fig.13 As shown in (a), the terminal determines that the zoom levels less than or equal to the preset zoom threshold include: 0, 1 and 3, and determines that the plurality of third image information includes: information A, information B and information D. Then, the terminal sorts the information A, information B and information D in order from small to large, and generates the following Fig.13 The image information stack 1300 shown in (b) includes: information A, information B and information D.
[0162] It is understandable that the terminal can filter the image information with a zoom level equal to the second zoom level from the image information with a zoom level less than the preset zoom threshold according to the preset set. In this way, the amount of information processed by the terminal can be reduced, the rendering steps can be reduced, the rendering time can be shortened, and the rendering efficiency can be improved.
[0163] In some embodiments, the second sub-area may include: a plurality of first objects, and the third image information may include: a plurality of first sub-image information, and one first object corresponds to one first sub-image information. Fig.14 As shown, before S907, the image processing method may further include: S1401-S1405.
[0164] S1401. The terminal obtains second sub-image information and third sub-image information in each third image information.
[0165] The second sub-image information is the first sub-image information corresponding to the second object, the third sub-image information is the first sub-object information corresponding to the third object, and the second object and the third object are any one of the multiple first objects.
[0166] S1402: The terminal determines whether the second object partially overlaps with the third object.
[0167] In a possible implementation, the terminal stores the location information of each first object. The terminal can obtain the location information of the second object and the location information of the third object, and determine whether the second object and the third object partially overlap according to the location information of the second object and the location information of the third object.
[0168] In some embodiments, if the terminal determines that the second object partially overlaps with the third object, the terminal executes S1403.
[0169] S1403: The terminal determines whether the depth information in the second sub-image information is smaller than the depth information in the third sub-image information.
[0170] In some embodiments, if the terminal determines that the depth information in the second sub-image information is less than the depth information in the third sub-image information, the terminal executes S1404.
[0171] S1404: The terminal determines whether the zoom level of the second sub-image information is equal to the zoom level of the third sub-image information.
[0172] In a possible implementation, the terminal stores the zoom level of each first sub-image information. The terminal may obtain the zoom level of the second sub-image information and the zoom level of the third sub-image information, and determine whether the zoom level of the second sub-image information is equal to the zoom level of the third sub-image information according to the zoom level of the second sub-image information and the zoom level of the third sub-image information.
[0173] In some embodiments, if the terminal determines that the zoom level of the second sub-image information is equal to the zoom level of the third sub-image information, the terminal executes S1405.
[0174] It should be noted that the embodiment of the present application does not limit the order of S1402, S1403 and S1404. For example, the terminal may first execute S1404, then execute S1402, and finally execute S1403. For another example, the terminal may first execute S1403, then execute S1404, and finally execute S1402. For another example, the terminal may execute S1402, S1403 and S1404 at the same time.
[0175] S1405. The terminal determines a third area and a fourth area.
[0176] The third area is an area in the second sub-area corresponding to the second object, and the fourth area is an area in the second sub-area corresponding to the third object that does not overlap with the area corresponding to the second object.
[0177] In a possible implementation manner, the terminal may determine the third area and the fourth area from the second sub-area according to the location information of the second object and the location information of the third object.
[0178] In the embodiment of the present application, after the terminal determines the third area and the fourth area, during the process of the terminal executing S907, for each third image information, the terminal can render the image corresponding to the third area according to the second sub-image information to generate a first sub-image, and the first sub-image is the image corresponding to the third area. In addition, the terminal can render the image corresponding to the fourth area according to the image information of the fourth area in the third sub-image information to generate a second sub-image, and the second sub-image is the image corresponding to the fourth area. Afterwards, the terminal splices the first sub-image with the second sub-image to generate a third image, and the third image includes: the first sub-image and the second sub-image.
[0179] Exemplarily, in combination with the image information shown in Table 1, Fig.15 As shown, during the first rendering of the second sub-area by the terminal, the terminal can obtain the following Fig.15The image 1501 (i.e., the second sub-region) and the fragment set 1502 (i.e., the second sub-image information) shown in (a) above are shown in FIG. 1 . The fragment set 1502 includes: fragment B1, fragment B2, fragment B3, fragment B4, fragment B5, and fragment B6. The depth information of fragments B1, B2, B3, B4, B5, and B6 are all 5, and fragments B1, B2, B3, B4, B5, and B6 are all fragments of region B. Afterwards, the terminal fits fragments B1, B2, B3, B4, B5, and B6 onto the image 1501 to generate the following image: Fig.15 The terminal generates the following according to the node corresponding to each fragment in fragment B1, fragment B2, fragment B3, fragment B4, fragment B5 and fragment B6: Fig.15 The relationship diagram 1504 shown in (b) is shown in FIG. 1504. Then, during the second rendering of the second sub-area by the terminal, the terminal can obtain the following information: Fig.15 The fragment set 1505 (i.e., the third sub-image information) shown in (c) includes: fragment F1, fragment G1, fragment C1, fragment C2, fragment C3, and fragment C4. Among them, the depth information of fragment F1 is 4, the depth information of fragment G1 is 3, the depth information of fragment C1 is 5, the depth information of fragment C2 is 5, the depth information of fragment C3 is 4, and the depth information of fragment C4 is 5. Moreover, fragment C1, fragment C2, fragment C3, and fragment C4 are all fragments of area C, fragment C2 is the fragment of school F, and fragment G1 is the fragment of community G. Afterwards, the terminal combines the relationship graph 1504, and fits fragment C3 and fragment C4 onto image 1503 to generate the following. Fig.15 The terminal combines the relationship graph 1504 and generates the following according to the nodes corresponding to each fragment in the fragment C3 and the fragment C4: Fig.15 Relationship diagram 1507 shown in (d).
[0180] It is understandable that by comparison Figure 2 The embodiments shown and Fig.15 In the embodiment shown, the terminal can filter the image information according to the judgment of the overlapping area, the comparison of the depth information and the comparison of the zoom level during the multiple rendering of the image. In this way, the amount of information processed by the terminal can be reduced, the rendering steps can be reduced, the rendering time can be shortened, and the rendering efficiency can be improved.
[0181] In some embodiments, the target instruction may also include: a target zoom level. After the terminal displays the first image, the terminal may establish a correspondence between the first image and the first zoom level. After the terminal determines that the first area and the second area partially overlap, and determines the first sub-area and the second sub-area, the terminal may determine whether the target zoom level is greater than the first zoom level. If the terminal determines that the target zoom level is less than or equal to the first zoom level, the terminal obtains the first image information of the target zoom level from the multiple first image information, and obtains the fifth image information of the second sub-area from the first image information of the target zoom level, and the zoom level of the fifth image information is the target zoom level. Afterwards, the terminal generates an image corresponding to the second sub-area based on the fifth image information. Afterwards, the terminal splices the image corresponding to the first sub-area in the first image with the image corresponding to the second sub-area to generate an image corresponding to the second area.
[0182] In a possible implementation, if the terminal determines that the target zoom level is greater than the first zoom level, the terminal obtains the first image information of the target zoom level from the multiple first image information, and obtains the sixth image information of the second area from the first image information of the target zoom level, and the zoom level of the sixth image information is the target zoom level. Afterwards, the terminal generates an image corresponding to the second area according to the sixth image information.
[0183] It is understandable that the terminal can determine the area to be rendered and the image information to be obtained by judging whether the target zoom level is greater than the first zoom level, thereby avoiding obtaining image information with a small zoom level and generating images corresponding to areas that do not need to be rendered based on the image information with a small zoom level.
[0184] The following is a specific example to illustrate the above Fig. 9 The illustrated embodiment is described.
[0185] Exemplarily, in combination with the image information shown in Table 1, Fig.16 As shown, the terminal screen displays Fig.16 The image 1601 (i.e., the first image) and the relationship diagram 1602 shown in (a) are as follows: the image 1601 is a terminal Fig.16 The fragments in the fragment set 1603 (i.e., the image information corresponding to the first area in the second image information) shown in (b) are attached to Fig.16The image generated in the image 1604 (i.e., the first area) shown in (b) is a relationship diagram generated by the terminal according to the nodes corresponding to each fragment in the fragment set 1603. Among them, image 1604 includes: area 1605, area 1606, area 1607 and area 1608, and the fragment set 1603 includes: fragment B1, fragment B2, fragment C1 and fragment C2, and the depth information of fragment B1, fragment B2, fragment C1 and fragment C2 is 5, and fragment B1 and fragment B2 are both fragments of area B, and fragment C1 and fragment C2 are both fragments of area C. In response to the user's operation of sliding one pixel to the left on the image 1601 displayed on the screen (i.e., the target instruction), the terminal obtains the following Fig.16 The image 1609 (i.e., the second region) and the fragment set 1610 shown in (c) are shown in FIG. Among them, the image 1609 includes: region 1607, region 1608, fragment 1611, and fragment 1612, and the fragment set 1610 includes: fragment A1, fragment A2, fragment A3, and fragment A4, and the depth information of fragment A1, fragment A2, fragment A3, and fragment A4 is 4, and fragment A1, fragment A2, fragment A3, and fragment A4 are all fragments of city A. Afterwards, the terminal obtains the image X (i.e., the second image) corresponding to the region M (i.e., the first sub-region) including the regions 1607 and 1608 in the image 1601 and the fragment set Y (i.e., the third image information) corresponding to the region N (i.e., the second sub-region) including the regions 1611 and 1612 in the fragment set 1610, and the fragment set Y includes: fragment A2 and fragment A4. Afterwards, the terminal combines the relationship graph 1602, fits the fragments A2 and A4 in the fragment set Y into the region N, and concatenates them with the image X to generate the following: Fig.16 The terminal combines the relationship graph 1602 and generates the following according to the nodes corresponding to the fragments A2 and A4: Fig.16 Afterwards, the terminal displays the image 1613 on the screen and establishes a corresponding relationship between the image 1613 and the relationship graph 1614.
[0186] The following is a flow chart of the image processing method provided by the present application, in conjunction with a specific embodiment. Fig.17 As shown, the specific steps are as follows:
[0187] Step A: The rendering device determines the scene change (ie, the terminal receives the target instruction).
[0188] Step B: The rendering device calculates the optimal data level (ie, the terminal uses the zoom level of the fourth image information corresponding to the smallest difference among the plurality of fourth differences as the preset zoom threshold).
[0189] Step C: The rendering device calculates a data request stack (ie, the terminal obtains the plurality of third image information from the plurality of fourth image information according to a preset zoom threshold).
[0190] Step D: The rendering device obtains new data.
[0191] Step E: The rendering device performs rasterization processing on the new data through the Z buffer algorithm and the node relationship (ie, the terminal executes S907 and S908).
[0192] Step F: The rendering device updates the scene (ie, the terminal executes S909 ).
[0193] It should be noted that after the rendering device updates the scene, the rendering device may sequentially obtain image information of the new object at different nodes from the data request stack, and implement the update of the scene through steps E and F.
[0194] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of a computer device. It is understandable that, in order to realize the above functions, the computer device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the steps of the image processing methods of each example described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0195] The embodiment of the present application also provides an image processing device, which can be a computer device, a CPU in the computer device, an image processing module in the computer device, or a client in the computer device for processing images.
[0196] The embodiment of the present application can divide the image processing device into functional modules or functional units according to the above method example. For example, each functional module or functional unit can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiment of the present application is schematic, which is only a logical function division. There may be other division methods in actual implementation.
[0197] like Fig.18 FIG. 1 is a schematic diagram of the structure of an image processing device provided in an embodiment of the present application. The image processing device is used to perform Fig. 9 , Fig.10 , Fig.11 , Fig.12 or Fig.14 The image processing method shown in the figure. The image processing device 1800 may include: a display module 1801 , a receiving module 1802 and a processing module 1803 .
[0198] The display module 1801 is used to display the first image corresponding to the first area in the target area, the first image is the image corresponding to the image information of the first area in the second image information, and the second image information is the first image information at the first zoom level. The receiving module 1802 is used to receive the target instruction, and the target instruction is used to indicate the display of the image corresponding to the second area in the target area. The processing module 1803 is used to determine the first sub-area and the second sub-area if the first area partially overlaps with the second area, the first sub-area is the area in the second area that overlaps with the first area, and the second sub-area is the area in the second area that does not overlap with the first area. The processing module 1803 is also used to obtain the second image corresponding to the first sub-area from the first image. The processing module 1803 is also used to obtain the third image information corresponding to the second sub-area from each first image information according to a preset zoom threshold, so as to obtain multiple third image information, and the zoom level of the third image information is less than or equal to the preset zoom threshold. The processing module 1803 is also used to render the image corresponding to the second sub-area according to each third image information, respectively, to generate multiple third images, and the multiple third images correspond to the zoom levels of the multiple third image information one by one. The processing module 1803 is further used to stitch the second image with each of the third images to generate a plurality of fourth images, where the plurality of fourth images are all images corresponding to the second area. The display module 1801 is further used to display the plurality of fourth images in sequence according to a preset order based on the zoom level corresponding to each of the third images.
[0199] Optionally, the processing module 1803 is used to obtain the fourth image information corresponding to the second sub-region from each first image information to obtain multiple fourth image information. The processing module 1803 is used to obtain multiple third image information from the multiple fourth image information according to a preset zoom threshold.
[0200] Optionally, the image information includes: depth information, and the display device includes: a display screen. The receiving module 1802 is further used to obtain the state information of the display screen, the first difference and the second difference, the first difference is used to indicate the degree of difference between the image information of the second sub-area displayed by the pixel point in the display screen and the image information of the collected second sub-area, and the second difference is used to indicate the degree of difference between the image information of the collected second sub-area and the real image information of the second sub-area. The processing module 1803 is used to determine the third difference corresponding to each fourth image information according to the state information of the display screen, the first difference and the depth information in each fourth image information, so as to determine multiple third differences, and the third difference is used to indicate the degree of difference allowed by the pixel point in the display screen. The processing module 1803 is used to calculate the difference between each third difference and the second difference respectively, and determine multiple fourth differences, and the zoom levels of the multiple fourth image information correspond to the multiple fourth differences one by one. The processing module 1803 is used to use the zoom level of the fourth image information corresponding to the smallest difference among the multiple fourth differences as the preset zoom threshold.
[0201] Optionally, processing module 1803 is used to obtain multiple third image information from multiple fourth image information according to a preset zoom threshold and a preset set, the preset set including: multiple second zoom levels, the zoom level of the third image information is less than or equal to the preset zoom threshold: the zoom level of the third image information is less than or equal to the preset zoom threshold, and the zoom level of the third image information is equal to the second zoom level.
[0202] Optionally, the second sub-region includes: a plurality of first objects, and the third image information includes: a plurality of first sub-image information, and one first object corresponds to one first sub-image information. The processing module 1803 is further used to obtain the second sub-image information and the third sub-image information in each third image information, the second sub-image information is the first sub-image information corresponding to the second object, the third sub-image information is the first sub-object information corresponding to the third object, and the second object and the third object are any object among the plurality of first objects. The processing module 1803 is further used to determine the third region and the fourth region if the second object partially overlaps with the third object, the depth information in the second sub-image information is less than the depth information in the third sub-image information, and the zoom level of the second sub-image information is equal to the zoom level of the third sub-image information, the third region is the region corresponding to the second object in the second sub-region, and the fourth region is the region corresponding to the third object in the second sub-region that does not overlap with the region corresponding to the second object. The processing module 1803 is used to render the image corresponding to the third region according to the second sub-image information to generate the first sub-image corresponding to the third region. The processing module 1803 is used to render the image corresponding to the fourth area according to the image information corresponding to the fourth area in the third sub-image information to generate a second sub-image corresponding to the fourth area. The processing module 1803 is used to splice the first sub-image with the second sub-image to generate a third image, and the third image includes: the first sub-image and the second sub-image.
[0203] Fig.19 1 is a schematic diagram of a hardware structure of an image processing device according to an exemplary embodiment. The image processing device may include a processor 1902, and the processor 1902 is used to execute application code to implement the image processing method in the present application.
[0204] Processor 1902 may be a central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.
[0205] like Fig.19 As shown, the image processing device may further include a memory 1903. The memory 1903 is used to store application program codes for executing the solution of the present application, and the execution is controlled by the processor 1902.
[0206] The memory 1903 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 1903 may exist independently and be connected to the processor 1902 via the bus 1904. The memory 1903 may also be integrated with the processor 1902.
[0207] like Fig.19 As shown, the image processing device may further include a communication interface 1901, wherein the communication interface 1901, the processor 1902, and the memory 1903 may be coupled to each other, for example, via a bus 1904. The communication interface 1901 is used to exchange information with other devices, for example, to support information exchange between the image processing device and other devices.
[0208] It should be pointed out that Fig.19 The device structure shown in the figure does not constitute a limitation on the image processing device. Fig.19 In addition to the components shown, the image processing device may include more or fewer components than shown, or combine certain components, or arrange the components differently.
[0209] In actual implementation, the functions implemented by the processing module 1803 can be Fig.19 The processor 1902 shown calls the program code in the memory 1903 to implement.
[0210] The present application also provides a computer-readable storage medium, on which instructions are stored. When the instructions in the computer-readable storage medium are executed by a processor of a computer device, the computer can execute the image processing method provided by the above-mentioned embodiment. For example, the computer-readable storage medium may be a memory 1903 including instructions, and the above instructions may be executed by a processor 1902 of a computer device to complete the above method. Optionally, the computer-readable storage medium may be a non-temporary computer-readable storage medium, for example, a non-temporary computer-readable storage medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
[0211] Fig. 20 A conceptual partial view of a computer program product provided by an embodiment of the present application is exemplarily shown, where the computer program product includes a computer program for executing a computer process on a computing device.
[0212] In one embodiment, the computer program product is provided using a signal bearing medium 2000. The signal bearing medium 2000 may include one or more program instructions that, when executed by one or more processors, may provide the above-described Fig. 9 , Fig.10 , Fig.11 , Fig.12 or Fig.14 Thus, for example, reference to Fig. 9 In the embodiment shown in , one or more features of S901 to S909 may be undertaken by one or more instructions associated with the signal bearing medium 2000. In addition, Fig. 20 The program instructions in also describe example instructions.
[0213] In some examples, the signal bearing medium 2000 may include a computer readable medium 2001, such as, but not limited to, a hard drive, a compact disk (CD), a digital video disk (DVD), a digital tape, a memory, a read-only memory (ROM) or a random access memory (RAM), and the like.
[0214] In some implementations, the signal bearing medium 2000 may include a computer recordable medium 2002 such as, but not limited to, a memory, a read / write (R / W) CD, a R / W DVD, or the like.
[0215] In some embodiments, signal bearing medium 2000 may include communication medium 2003, such as, but not limited to, digital and / or analog communication media (eg, fiber optic cables, waveguides, wired communication links, wireless communication links, etc.).
[0216] The signal bearing medium 2000 may be communicated by a wireless form of communication medium 2003. The one or more program instructions may be, for example, computer executable instructions or logic implemented instructions.
[0217] In some examples, such as for Fig.18 The described image processing apparatus may be configured to provide various operations, functions, or actions in response to one or more program instructions via computer-readable medium 2001 , computer-recordable medium 2002 , and / or communication medium 2003 .
[0218] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0219] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0220] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0221] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0222] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the full classification part or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute the full classification part or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes various media that can store program codes, such as-U disk, mobile hard disk, ROM, RAM, disk or CD.
[0223] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. An image processing method, characterized in that: Applied to a display device, the display device stores a plurality of first image information, the first image information is image information of a target area, and each of the first image information has a different zoom level, the method includes: Displaying a first image corresponding to a first area in the target area, where the first image is an image corresponding to image information of the first area in second image information, and the second image information is the first image information at a first zoom level; receiving a target instruction, wherein the target instruction is used to instruct to display an image corresponding to a second area in the target area; If the first area partially overlaps with the second area, a first sub-area and a second sub-area are determined, wherein the first sub-area is an area in the second area that overlaps with the first area, and the second sub-area is an area in the second area that does not overlap with the first area; Acquire a second image corresponding to the first sub-region from the first image; According to a preset zoom threshold, acquiring third image information corresponding to the second sub-area from each of the first image information to acquire a plurality of the third image information, wherein the zoom level of the third image information is less than or equal to the preset zoom threshold; According to each piece of the third image information, respectively render the image corresponding to the second sub-area to generate a plurality of third images, wherein the plurality of third images correspond one to one to the zoom levels of the plurality of the third image information; Splicing the second image with each of the third images to generate a plurality of fourth images, where the plurality of fourth images are all images corresponding to the second area; The plurality of fourth images are displayed in sequence according to a preset order based on a zoom level corresponding to each of the third images.
2. The method according to claim 1, characterized in that: The acquiring, according to a preset zoom threshold, third image information corresponding to the second sub-region from each of the first image information includes: Acquire fourth image information corresponding to the second sub-area from each of the first image information to acquire a plurality of the fourth image information; According to the preset zoom threshold, a plurality of the third image information is acquired from a plurality of the fourth image information.
3. The method according to claim 2, characterized in that The image information includes: depth information, and the display device includes: a display screen; after determining the first sub-area and the second sub-area, the method further includes: Acquire state information of the display screen, a first difference, and a second difference, wherein the first difference is used to indicate a degree of difference between image information of the second sub-area displayed by a pixel point in the display screen and collected image information of the second sub-area, and the second difference is used to indicate a degree of difference between the collected image information of the second sub-area and actual image information of the second sub-area; After acquiring fourth image information corresponding to the second sub-region from each of the first image information, the method further includes: Determine, according to the state information of the display screen, the first difference value and the depth information in each of the fourth image information, a third difference value corresponding to each of the fourth image information, so as to determine a plurality of the third difference values, wherein the third difference values are used to indicate an allowable degree of difference of pixels in the display screen; respectively calculating the difference between each of the third difference values and the second difference value to determine a plurality of fourth difference values, wherein the plurality of zoom levels of the fourth image information correspond one to one to the plurality of fourth difference values; The zoom level of the fourth image information corresponding to the smallest difference value among the multiple fourth differences is used as the preset zoom threshold.
4. The method according to claim 2 or 3, characterized in that: The acquiring the plurality of third image information from the plurality of fourth image information according to the preset zoom threshold comprises: According to the preset zoom threshold and the preset set, multiple third image information are obtained from multiple fourth image information, and the preset set includes: multiple second zoom levels, and the zoom level of the third image information is less than or equal to the preset zoom threshold: the zoom level of the third image information is less than or equal to the preset zoom threshold, and the zoom level of the third image information is equal to the second zoom level.
5. The method according to claim 4, characterized in that The second sub-area includes: a plurality of first objects, and the third image information includes: a plurality of first sub-image information, one first object corresponds to one first sub-image information; before rendering the image corresponding to the second sub-area according to each of the third image information to generate a plurality of third images, the method further includes: Acquire second sub-image information and third sub-image information in each of the third image information, wherein the second sub-image information is the first sub-image information corresponding to a second object, the third sub-image information is the first sub-image information corresponding to a third object, and the second object and the third object are any object among the multiple first objects; If the second object partially overlaps with the third object, the depth information in the second sub-image information is less than the depth information in the third sub-image information, and the zoom level of the second sub-image information is equal to the zoom level of the third sub-image information, then determining a third area and a fourth area, the third area being an area in the second sub-area corresponding to the second object, and the fourth area being an area in the second sub-area corresponding to the third object that does not overlap with an area corresponding to the second object; Rendering the image corresponding to the second sub-region according to the third image information to generate the third image includes: Rendering the image corresponding to the third area according to the second sub-image information to generate a first sub-image corresponding to the third area; Rendering the image corresponding to the fourth area according to the image information corresponding to the fourth area in the third sub-image information to generate a second sub-image corresponding to the fourth area; The first sub-image and the second sub-image are spliced to generate the third image, and the third image includes: the first sub-image and the second sub-image.
6. An image processing device, characterized in that: Applied to a display device, the display device stores a plurality of first image information, the first image information is image information of a target area, and each of the first image information has a different zoom level, the device comprises: A display module, configured to display a first image corresponding to a first area in the target area, where the first image is an image corresponding to image information of the first area in second image information, where the second image information is the first image information at a first zoom level; A receiving module, used for receiving a target instruction, wherein the target instruction is used for instructing to display an image corresponding to the second area in the target area; a processing module, configured to determine a first sub-region and a second sub-region if the first region partially overlaps with the second region, wherein the first sub-region is a region in the second region that overlaps with the first region, and the second sub-region is a region in the second region that does not overlap with the first region; The processing module is further configured to obtain a second image corresponding to the first sub-region from the first image; The processing module is further used to obtain, according to a preset zoom threshold, third image information corresponding to the second sub-area from each of the first image information to obtain a plurality of the third image information, wherein the zoom level of the third image information is less than or equal to the preset zoom threshold; The processing module is further used to render the image corresponding to the second sub-area according to each of the third image information to generate a plurality of third images, wherein the plurality of third images correspond to the zoom levels of the plurality of the third image information in a one-to-one manner; The processing module is further used to perform splicing processing on the second image and each of the third images respectively to generate a plurality of fourth images, wherein the plurality of fourth images are all images corresponding to the second area; The display module is further configured to display the plurality of fourth images in sequence according to a preset order based on a zoom level corresponding to each of the third images.
7. The device according to claim 6, characterized in that The processing module is used to obtain fourth image information corresponding to the second sub-area from each of the first image information, so as to obtain a plurality of the fourth image information; The processing module is used to obtain the plurality of third image information from the plurality of fourth image information according to the preset zoom threshold.
8. The device according to claim 7, characterized in that The image information includes: depth information, and the display device includes: a display screen; The receiving module is further used to obtain state information of the display screen, a first difference, and a second difference, wherein the first difference is used to indicate a degree of difference between image information of the second sub-area displayed by pixels in the display screen and acquired image information of the second sub-area, and the second difference is used to indicate a degree of difference between acquired image information of the second sub-area and actual image information of the second sub-area; The processing module is used to determine a third difference value corresponding to each of the fourth image information according to the state information of the display screen, the first difference value and the depth information in each of the fourth image information, so as to determine a plurality of the third difference values, wherein the third difference value is used to indicate an allowable degree of difference of pixels in the display screen; The processing module is used to calculate the difference between each of the third difference values and the second difference value, respectively, to determine a plurality of fourth difference values, and the plurality of zoom levels of the fourth image information correspond one to one to the plurality of fourth difference values; The processing module is configured to use the zoom level of the fourth image information corresponding to the smallest difference value among the multiple fourth differences as the preset zoom threshold value.
9. An image processing device, characterized in that: include: Processor and memory; The processor is coupled to the memory; The memory is used to store one or more programs, and the one or more programs include computer-executable instructions. When the image processing device is running, the processor executes the computer-executable instructions stored in the memory to enable the image processing device to perform the image processing method as described in any one of claims 1-5.
10. A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, characterized in that: When a computer executes the instructions, the computer performs the image processing method according to any one of claims 1 to 5.
Citation Information
Patent Citations
Video picture splicing method and device, terminal and storage medium
CN114554281A
Distribution map rendering method, electronic equipment and storage medium
CN114840288A