Cloud map processing method and apparatus, computer device, computer readable storage medium, and computer program product
By constructing spatial and local coordinate systems and sampling cloud maps based on viewpoint positions, the plane coordinate uniformity and accuracy problems in sphere surface map generation are solved, and the accuracy and efficiency of cloud map processing are improved.
Patent Information
- Application Number
- PCT/CN2024/084465
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-26
- Filing Date
- 2024-03-28
- Publication Date
- 2024-12-05
AI Technical Summary
When generating surface maps of spheres, existing cloud map processing methods are difficult to ensure the uniform distribution of plane coordinates, resulting in distortion in high-latitude areas, and it is difficult to balance the accuracy and data volume, resulting in low processing efficiency and insufficient accuracy.
By constructing a spatial coordinate system and a local coordinate system, sampling is performed based on the viewpoint position, and it is converted into a sphere scrolling on the plane to generate a plan map near the tangent point, simplifying the data production process and improving sampling efficiency.
It achieves the improvement of the accuracy and efficiency of cloud map processing, reduces resource consumption, and avoids distortion problems in high-latitude areas.
Smart Images

Figure CN2024084465_05122024_PF_FP_ABST
Abstract
Description
Cloud image processing method, device, computer equipment, computer readable storage medium and computer program product
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] The embodiments of this application are based on and claim the priority of Chinese patent application with application number 202310605898.4 and application date May 26, 2023. The entire contents of the Chinese patent application are hereby introduced into the embodiments of this application as a reference. Technical Field
[0003] The present application relates to the field of computer technology, and in particular to a cloud image processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art
[0004] Currently, most cloud maps are mainly for flat surfaces, usually generating planar maps and applying planar maps on the surface of a sphere to generate a spherical surface map. In this process, an infinitely large plane map is generally generated manually or programmatically. When it is necessary to sample the cloud map of a certain point on the earth's surface, the longitude and latitude of that location are projected to the corresponding plane coordinates on the plane map, and the plane coordinates are used to sample on the infinitely large plane cloud map. This method makes it difficult to ensure the uniform distribution of plane coordinates and will cause distortion in high-latitude areas, resulting in low accuracy of the longitude and latitude projection results. Alternatively, a map of the entire spherical surface can be directly generated through a modeling tool. This method makes it difficult to balance the contradiction between accuracy and data volume. Generating a high-precision plane map requires a large storage overhead and generation resources, resulting in low cloud map processing efficiency; generating a low-precision plane map will result in a lack of details in the plane map, resulting in low cloud map processing accuracy.
[0005] Summary of the Invention
[0006] The embodiments of the present application provide a cloud image processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product, which can improve the accuracy and efficiency of cloud image processing.
[0007] The present invention provides a cloud image processing method, which includes:
[0008] Construct a spatial coordinate system and build basic cloud map data in the spatial coordinate system;
[0009] Taking the first viewpoint position as the origin, constructing a local coordinate system corresponding to the first viewpoint position, obtaining sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position, performing position conversion on the sampling point position information to obtain cloud sampling position information; different viewpoint positions correspond to different local coordinate systems;
[0010] Based on the cloud sampling position information, the basic cloud map data is sampled to obtain the sampling cloud information of the first sampling point.
[0011] The present invention provides a cloud image processing device, which includes:
[0012] A cloud map construction module is configured to construct a spatial coordinate system and construct basic cloud map data in the spatial coordinate system;
[0013] A local construction module is configured to construct a local coordinate system corresponding to the first viewpoint position with the first viewpoint position as an origin; different viewpoint positions correspond to different local coordinate systems;
[0014] a position determination module configured to obtain sampling point position information of the first sampling point in a local coordinate system corresponding to the first viewpoint position, perform position conversion on the sampling point position information, and obtain cloud sampling position information;
[0015] The cloud sampling module is configured to sample the basic cloud map data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point.
[0016] An embodiment of the present application provides a computer device, including a processor, a memory, and an input and output interface;
[0017] The processor is connected to the memory and the input and output interface respectively, wherein the input and output interface is used to receive and output data, the memory is used to store the computer program, and the processor is used to call the computer program so that the computer device including the processor executes the cloud map processing method provided in the embodiment of the present application.
[0018] An embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for being loaded and executed by a processor so that a computer device having the processor executes the cloud image processing method provided by the embodiment of the present application.
[0019] The present invention provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the cloud image processing method provided in the present invention.
[0020] Applying the embodiments of the present application will have the following beneficial effects:
[0021] In an embodiment of the present application, a spatial coordinate system can be constructed, and basic cloud map data can be constructed in the spatial coordinate system; a local coordinate system corresponding to the first viewpoint position is constructed with the first viewpoint position as the origin, and the sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position is obtained, and the sampling point position information is converted to obtain cloud sampling position information; different viewpoint positions correspond to different local coordinate systems; based on the cloud sampling position information, the basic cloud map data is sampled to obtain the sampling cloud information of the first sampling point. Through the above process, a basic cloud map data can be constructed, and then when sampling, the coordinates are determined based on the local coordinate system. In other words, it is equivalent to converting the problem of "generating a spherical map on the surface of a sphere" into the problem of "rolling a sphere on a plane and generating a planar map near the tangent point (i.e., sampling of the local coordinate system)", which simplifies the cloud map data production process and efficiency. Moreover, based on local sampling, when generating cloud map data with higher accuracy, it does not require a lot of overhead and resources, thereby saving resources and improving the accuracy and efficiency of cloud map processing. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0023] FIG1 is a diagram of a network interaction architecture for cloud image processing provided by an embodiment of the present application;
[0024] FIG2 is a schematic diagram of a cloud image processing scenario provided by an embodiment of the present application;
[0025] FIG3 is a flow chart of a cloud image processing method provided in an embodiment of the present application;
[0026] FIG4a is a schematic diagram of a cloud map construction scenario provided by an embodiment of the present application;
[0027] FIG4 b is an example of cloud map construction provided in an embodiment of the present application;
[0028] FIG5 is a schematic diagram of another cloud map construction scenario provided in an embodiment of the present application;
[0029] FIG6 is a schematic diagram of a local coordinate construction scene provided by an embodiment of the present application;
[0030] FIG7 is a schematic diagram of a coordinate system conversion scenario provided by an embodiment of the present application;
[0031] FIG8 is a schematic diagram of a location determination scenario provided by an embodiment of the present application;
[0032] FIG9 is a schematic diagram of a cloud map data iterative processing flow provided in an embodiment of the present application;
[0033] FIG10 is a schematic diagram of a cloud sampling process provided by an embodiment of the present application;
[0034] FIG11 is a schematic diagram of a cloud image processing device provided in an embodiment of the present application;
[0035] FIG12 is a schematic structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0036] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0037] Among them, if it is necessary to collect object (such as user, etc.) data in this application, a prompt interface or pop-up window will be displayed before or during the collection. The prompt interface or pop-up window is used to remind the user that XXXX data is currently being collected. Only after the user confirms the prompt interface or pop-up window, the relevant steps for data acquisition will be started, otherwise it will end. Moreover, the acquired user data will be used in reasonable and legal scenarios or purposes. In some scenarios where user data needs to be used but the user has not authorized it, authorization can be requested from the user, and the user data can be used when the authorization is passed. Among them, the use of user data complies with the relevant provisions of laws and regulations.
[0038] In an embodiment of the present application, please refer to FIG. 1 , which is a network interaction architecture diagram for cloud image processing provided by an embodiment of the present application. As shown in FIG. 1 , a computer device 101 can construct a local coordinate system based on the positions of each viewpoint on the surface of an object model and determine cloud information for each sampling point using the local coordinate system, thereby implementing cloud image parsing of the object model. Optionally, the computer device 101 can receive cloud image data rendering requests from any one or more business devices, determine cloud information for each sampling point based on the cloud image data rendering request, and send the determined cloud information to the business device corresponding to the cloud image data rendering request. The number of business devices can be one or more, such as business device 102a, business device 102b, and business device 102c shown in FIG. The object model refers to the model of the object to be parsed for cloud image parsing. The object to be parsed refers to the object for cloud image parsing, which can be a physical object or a virtual object in an application. The physical object can be, but is not limited to, the Earth or other large objects. The virtual object can be, but is not limited to, an object in an application that requires cloud image processing, such as a virtual planet in a game application. Through the above process, cloud map analysis can be performed on each sampling point based on the local coordinate system, so that the problem of "generating a spherical map on the surface of a sphere" can be simplified to the problem of "local mapping", which simplifies the cloud map processing process and thus improves the accuracy and efficiency of cloud map processing.
[0039] Specifically, please refer to Figure 2, which is a schematic diagram of a cloud map processing scenario provided by an embodiment of the present application. As shown in Figure 2, the computer device can construct a spatial coordinate system 201, which includes a horizontal coordinate axis (u-axis), a vertical coordinate axis (v-axis) and a coordinate system origin (ori point). The spatial coordinate system 201 can be considered as a plane coordinate system. For example, the horizontal coordinate axis and the vertical coordinate axis can be constructed with two cloud distribution ranges (such as 0 to 1, etc.), and the spatial coordinate system 201 is constructed based on the horizontal coordinate axis and the vertical coordinate axis. Further, basic cloud map data 202 can be constructed in the spatial coordinate system 201. Among them, the cloud map data (Cloud-map / Weather-map / Weather-texture) in the embodiment of the present application is used to represent information such as the distribution and morphology of volumetric clouds from a bird's-eye view, that is, a cloud map. Furthermore, a local coordinate system 204 corresponding to the first viewpoint position 203 can be constructed with the first viewpoint position 203 as the origin. This local coordinate system 204 can be considered to be generated based on the tangent plane of the object model at the first viewpoint position 203. Sampling point position information of the first sampling point 205 in the local coordinate system 204 corresponding to the first viewpoint position 203 can be obtained. Position conversion is performed on the sampling point position information to obtain cloud sampling position information. This cloud sampling position information is used to represent the position of the first sampling point 205 in the basic cloud image data 202. Different viewpoint positions correspond to different local coordinate systems. Based on the cloud sampling position information, the basic cloud image data 202 can be sampled to obtain sampling cloud information for the first sampling point 205. By constructing a local coordinate system, each sampling point determines the cloud sampling position information in the local coordinate system corresponding to the adjacent viewpoint position. The construction of the local coordinate system makes the area corresponding to each local coordinate system smaller, and the plane coordinate distribution under each local coordinate system is more uniform, so that each sampling point can be better and more accurately mapped to the basic cloud map data for sampling, thereby improving the accuracy and efficiency of cloud map processing.
[0040] It is understood that the computer devices mentioned in the embodiments of the present application include but are not limited to terminal devices or servers. In other words, the computer device can be a server or a terminal device, or a system consisting of a server and a terminal device. Among them, the terminal device mentioned above can be an electronic device, including but not limited to a mobile phone, a tablet computer, a desktop computer, a laptop computer, a PDA, a vehicle-mounted device, an augmented reality / virtual reality (AR / VR) device, a helmet display, a smart TV, a wearable device, a smart speaker, a digital camera, a camera and other mobile internet devices (mobile internet device, MID) with network access capability, or a terminal device in scenarios such as a train, a ship, or a flight. As shown in Figure 1, the terminal device can be a laptop computer (as shown in business device 102b), a mobile phone (as shown in business device 102c) or a vehicle-mounted device (as shown in business device 102a), etc. Figure 1 only lists some of the devices. Optionally, the business device 102a refers to a device located in a vehicle 103. The business device 102a can be used to display cloud map data, etc. Among them, the servers mentioned above can be independent physical servers, or they can be server clusters or distributed systems composed of multiple physical servers. They can also be cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, vehicle-road collaboration, content delivery networks (CDNs), as well as big data and artificial intelligence platforms.
[0041] The data involved in the embodiments of the present application can be stored in a computer device, or the data can be stored based on cloud storage technology or a blockchain network, without limitation here.
[0042] Please refer to Figure 3, which is a flow chart of a cloud image processing method provided by an embodiment of the present application. As shown in Figure 3, the cloud image processing process includes the following steps:
[0043] Step S301: construct a spatial coordinate system and construct basic cloud map data in the spatial coordinate system.
[0044] In some embodiments, the computer device can implement the construction of basic cloud map data in the spatial coordinate system in step S301 in the following manner: obtain candidate cloud map data, and associate the candidate cloud map data with the spatial coordinate system to generate initial unit cloud map data; determine the initial unit cloud map data as basic cloud map data, or seamlessly continue the initial unit cloud map data to generate basic cloud map data.
[0045] In practical applications, a computer device may first construct a spatial coordinate system, construct initial unit cloud map data in the spatial coordinate system, and determine the initial unit cloud map data as basic cloud map data; or, based on the initial unit cloud map data, seamlessly continue the initial unit cloud map data, including seamlessly connecting the upper and lower parts and the left and right parts, to generate basic cloud map data. For example, a spatial coordinate system may be constructed, wherein the horizontal coordinate is constructed within a first value range and the vertical coordinate is constructed within a second value range, and the horizontal and vertical coordinates form a spatial coordinate system; candidate cloud map data is obtained, and the candidate cloud map data is associated with the spatial coordinate system to generate initial unit cloud map data. Among them, associating the candidate cloud map data with the spatial coordinate system refers to determining the position of each pixel point in the candidate cloud map data in the spatial coordinate system. The candidate cloud map data refers to fine cloud map data drawn manually, or fine cloud map data generated by a model and optimized manually, etc. The size of the candidate cloud map data is small, such as the size of the candidate cloud map data is less than or equal to the unit size threshold, such as 50 meters × 50 meters, etc. It can be specifically determined based on the cost of drawing the cloud map data. For example, when the cost of producing cloud map data decreases, the unit size threshold can be increased, etc., so that when generating candidate cloud map data, only less labor cost and resources are required to obtain the required cloud map data, thereby reducing the cost of generating cloud map data.
[0046] In some embodiments, the computer device can implement step S301 in the following manner: obtain the image to be analyzed, perform coordinate conversion on the image size of the image to be analyzed, and obtain a spatial coordinate system; perform image analysis on the image to be analyzed, map the analysis result to the spatial coordinate system, and obtain initial unit cloud map data; based on the initial unit cloud map data, seamlessly continue the initial unit cloud map data to generate basic cloud map data.
[0047] In practical applications, a computer device can obtain an image to be analyzed, perform coordinate conversion on the image size of the image to be analyzed, and obtain a spatial coordinate system. For example, referring to FIG4a, FIG4a is a schematic diagram of a cloud map construction scene provided by an embodiment of the present application. As shown in FIG4a, the computer device can use the lower left corner 4011 of the image to be analyzed 401 as the origin of the coordinate system, construct a horizontal coordinate axis (u axis) based on the width of the image to be analyzed 401, and construct a vertical coordinate axis (v axis) based on the height of the image to be analyzed 401. The coordinate system origin, the horizontal coordinate axis and the vertical coordinate axis are used to construct an initial coordinate system. The initial coordinate system can be considered as a two-dimensional coordinate system. The horizontal coordinate value in the two-dimensional coordinate system belongs to a first value range, and the vertical coordinate value belongs to a second value range, wherein the first value range and the second value range can be considered as the default texture coordinate range, that is, the UV coordinate range "0~1" and the like; the size of the image to be analyzed 401 is scaled, the coordinate scale corresponding to the initial coordinate system is determined, the coordinate scale is associated with the initial coordinate system, and a spatial coordinate system 402 is generated. The scaling method includes, but is not limited to, normalization and coordinate conversion (i.e., scaling the size of the image to be parsed 401 using a coordinate conversion function). For example, if the image to be parsed 401 is a 100×50 image, a spatial coordinate system 402 is generated based on the size of the image to be parsed 401. In this case, the spatial coordinate system can be used to represent the position of any point in the spatial coordinate system in the image to be parsed 401, such as (0.1, 0.2) in the spatial coordinate system represents the pixel point (10, 10) in the image to be parsed 401. The coordinate scale is used to represent the coordinate association relationship between the initial coordinate system and the image to be parsed, that is, it can represent the position of any point in the initial coordinate system in the image to be parsed, or the position of any point in the image to be parsed in the initial coordinate system. By associating the coordinate scale in the initial coordinate system, any point in the basic cloud map data constructed using the spatial coordinate system can find the corresponding pixel point in the image to be parsed. That is, it can be considered that when the images to be analyzed are different, the initial coordinate system is the same. The spatial coordinate system is mainly used to map the image to be analyzed to the initial coordinate system, that is, to carry the coordinate scale. For example, the initial coordinate system is composed of a horizontal axis of "0~1" and a vertical axis of "0~1". The image to be analyzed 401 is a 100×50 image, and the coordinate scale includes "width: 0.01, height: 0.02". That is, the pixel point at position (x1, y1) in the image to be analyzed 401 is at position (x1×0.01, y1×0.02) in the initial coordinate system, and the point at position (x2, y2) in the initial coordinate system is at position (x2 / 0.01, y2 / 0.02) in the image to be analyzed.
[0048] For example, see Figure 4b, which illustrates an example of cloud map construction provided by an embodiment of the present application. As shown in Figure 4b, an initial coordinate system 403 can be constructed, an image to be parsed 404 can be acquired, and a coordinate scale between the initial coordinate system 403 and the image to be parsed 404 can be determined based on the initial coordinate system 403 and the image to be parsed 404. The coordinate scale is then associated with the initial coordinate system 403 to obtain a spatial coordinate system.
[0049] After obtaining the spatial coordinate system, image analysis is performed on the image to be analyzed, and the analysis results are mapped to the spatial coordinate system to obtain initial unit cloud map data. The image to be analyzed refers to an image carrying cloud information. The computer device can extract cloud information from the image to be analyzed to obtain image cloud information. Based on the distribution of the image cloud information in the image to be analyzed, the image cloud information is mapped to the spatial coordinate system to obtain initial unit cloud map data. For example, the distribution of the image cloud information in the spatial coordinate system can be determined based on the distribution of the image cloud information in the image to be analyzed and the coordinate scale. Based on the distribution of the image cloud information in the spatial coordinate system, the image cloud information is mapped to the spatial coordinate system to obtain initial unit cloud map data. As shown in Figure 4b, the image cloud information can be mapped to the spatial coordinate system 403 based on the distribution of the image cloud information in the spatial coordinate system to obtain initial unit cloud map data 405. The cloud map data represents information such as the distribution and morphology of the volumetric cloud from a bird's-eye view.
[0050] In some embodiments, after obtaining the initial unit cloud map data, the initial unit cloud map data can be determined as the basic cloud map data. Since the cloud sampling position information of the sampling point can be mapped to the initial unit cloud map data when the cloud map data is subsequently sampled, the initial unit cloud map data can be directly used as the basic cloud map data and as the cloud map data for subsequent sampling. This can reduce the amount of cloud map data that needs to be maintained, save a lot of space for fine storage of cloud map data, and thus improve the efficiency of cloud map processing.
[0051] In some embodiments, the following method can be used to seamlessly continue the initial unit cloud map data based on the initial unit cloud map data to generate basic cloud map data: based on the initial unit cloud map data, the initial unit cloud map data is seamlessly continued, including seamless self-connection up and down and left and right, etc., to generate basic cloud map data. In this case, the basic cloud map data refers to infinite cloud map data. For example, see Figure 5, which is another schematic diagram of a cloud map construction scene provided by an embodiment of the present application. As shown in Figure 5, the computer device can seamlessly continue the initial unit cloud map data 501 based on the initial unit cloud map data 501, that is, continuously copy the initial unit cloud map data 501, and seamlessly connect the copied initial unit cloud map data with the initial unit cloud map data 501 at the beginning (before copying), as shown in the directions indicated by the hollow arrows in Figure 5, and continuously seamlessly connect the existing initial unit cloud map data, so as to obtain an infinite basic cloud map data 502.
[0052] In some embodiments, the number of images to be analyzed is N, where N is a positive integer. At this time, the initial unit cloud map data can be seamlessly continued on the basis of the initial unit cloud map data to generate basic cloud map data in the following manner: according to the initial unit cloud map data corresponding to the N images to be analyzed, the hierarchical cloud map data corresponding to the N images to be analyzed are determined; based on the height ranges corresponding to the N images to be analyzed, the cloud map height ranges corresponding to the N hierarchical cloud map data are determined; based on the cloud map height ranges corresponding to the N hierarchical cloud map data, the N hierarchical cloud map data are combined to obtain basic cloud map data.
[0053] In practical applications, assuming that the number of images to be parsed is N, where N is a positive integer, the initial unit cloud data is seamlessly continued on the basis of the initial unit cloud data to generate basic cloud data. The N initial unit cloud data can be seamlessly continued on the basis of the initial unit cloud data corresponding to the N images to be parsed to generate N level cloud data. The generation method of each level cloud data can refer to the generation method of the basic cloud data 502. Taking the generation of the first level cloud data as an example, in the initial unit cloud data corresponding to the first image to be parsed, Based on the data (i.e. the first initial unit cloud map data), the first initial unit cloud map data is seamlessly continued, that is, the first initial unit cloud map data is continuously copied, and the copied initial unit cloud map data is seamlessly connected with the first initial unit cloud map data at the beginning (before copying), and the existing first initial unit cloud map data is continuously seamlessly connected, so that an infinitely large basic cloud map data, i.e. the first level cloud map data, can be obtained; through the above method, the second, third, ..., Nth level cloud map data can be obtained, that is, N level cloud map data need to be determined.
[0054] After determining N levels of cloud image data, the cloud image height ranges corresponding to each of the N levels of cloud image data are determined based on the height ranges corresponding to the N images to be analyzed. The height range corresponding to each image to be analyzed can be provided by the user who provided the image to be analyzed or manually set. Alternatively, the N images to be analyzed can be input into a height analysis model, which analyzes the cloud information features corresponding to each of the N images to be analyzed, performs height matching on the cloud information features, and determines the height ranges corresponding to each of the N images to be analyzed. Based on the cloud image height ranges corresponding to each of the N levels of cloud image data, the N levels of cloud image data are combined to obtain basic cloud image data. For example, assuming N is 3, and the cloud image height ranges corresponding to the N levels of cloud image data are "0-500 meters," "500 meters-1500 meters," and "above 1500 meters," this means that the cloud image height ranges corresponding to the N levels of cloud image data are "0-500 meters," "500 meters-1500 meters," and "above 1500 meters," etc.
[0055] That is to say, the basic cloud map data may be a two-dimensional cloud map data, or may include N levels of cloud map data carrying height information, etc.
[0056] In step S302 , a local coordinate system corresponding to the first viewpoint position is constructed with the first viewpoint position as the origin, sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position is obtained, and the sampling point position information is converted to obtain cloud sampling position information.
[0057] Among them, different viewpoint positions correspond to different local coordinate systems. The local coordinate system corresponding to the first viewpoint position refers to a coordinate system consisting of three coordinate axes constructed by the first viewpoint position and taking the first viewpoint position as the origin.
[0058] In some embodiments, step S302 of constructing a local coordinate system corresponding to the first viewpoint position with the first viewpoint position as the origin can be achieved as follows: in the i-th viewpoint movement frame, when i is an initial value, the first viewpoint position i is determined based on the first geographic coordinate point, the first coordinate axis i is determined based on the second geographic coordinate point and the first geographic coordinate point, the second coordinate axis i is constructed in the direction from the center point of the object model to the first viewpoint position i, the third coordinate axis i is determined based on the first coordinate axis i and the second coordinate axis i, and the first coordinate axis i, the second coordinate axis i and the third coordinate axis i are combined to form the local coordinate system i corresponding to the first viewpoint position i.
[0059] Among them, the first geographic coordinate point can be a coordinate obtained arbitrarily from the surface of the object model of the object to be analyzed, or it can be the coordinate of the initial point on the surface of the object model. If the object model is the earth, the first geographic coordinate point can be the point of world coordinates (0, 0, 0); if the object model is a model of a virtual object in an application, the first geographic coordinate point can be the coordinate of the initial point of the application, etc.
[0060] Furthermore, the first viewpoint position i can be determined as the origin, and the first coordinate axis i can be determined based on the second geographic coordinate point and the first geographic coordinate point. In some embodiments, determining the first coordinate axis i based on the second geographic coordinate point and the first geographic coordinate point can be achieved as follows: obtaining a tangent plane of the object model at the first geographic coordinate point, obtaining the projection length of the second geographic coordinate point on the tangent plane, and when the projection length of the second geographic coordinate point on the tangent plane is not 0, determining the direction from the first geographic coordinate point to the second geographic coordinate point as the first coordinate axis i; when the projection length of the second geographic coordinate point on the tangent plane is 0, moving the second geographic coordinate point along the tangent plane to obtain a third geographic coordinate, and when the projection length of the third geographic coordinate on the tangent plane is not 0, determining the direction from the first geographic coordinate point to the third geographic coordinate as the first coordinate axis i.
[0061] The projection length represents the distance between the projection point of the second geographic coordinate point on the tangent plane and the first geographic coordinate point. The tangent plane is a plane tangent to the surface of the object model, with the first geographic coordinate point being the tangent point. If the projection length is not 0, the direction from the first geographic coordinate point to the second geographic coordinate point is determined as the first coordinate axis i. If the projection length is 0, indicating that the second geographic coordinate point is located on a line perpendicular to the tangent plane and cannot be used as the first coordinate axis i, the third geographic coordinate point is obtained. If the projection length of the third geographic coordinate point on the tangent plane is not 0, the direction from the first geographic coordinate point to the third geographic coordinate point is determined as the first coordinate axis i.
[0062] For example, if the second geographic coordinate point is (1, 0, 0), and the projection length of the second geographic coordinate point on the tangent plane is 0, then the third geographic coordinate point is (0, 1, 0), and the direction from the first geographic coordinate point to the third geographic coordinate point is determined as the first coordinate axis i. Since the second geographic coordinate point is located on the perpendicular line of the tangent plane, specifically on the coordinate axis perpendicular to the tangent plane, the third geographic coordinate point obtained by moving the second geographic coordinate point along the tangent plane will not be located on the coordinate axis perpendicular to the tangent plane. Based on this, the first coordinate axis i can be determined. Among them, the viewpoint moving frame is used to indicate that when a local coordinate system is constructed for the surface of the object model to be analyzed, the stage of the local coordinate system construction can be considered as a viewpoint moving frame, and different viewpoint moving frames correspond to different first viewpoint positions. That is to say, the cloud map analysis of the object to be analyzed can be approximated as the analysis process of the surface of the object model of the object to be analyzed rolling in a plane. At this time, it can be considered that a local coordinate system is constructed with a first viewpoint position as the initial point, and then based on this initial point, the surface of the object model of the object to be analyzed is continuously offset to obtain the next first viewpoint position, and the local coordinate system is determined until the surface traversal of the object model of the object to be analyzed is completed. Among them, the construction process of each local coordinate system can be considered as a viewpoint moving frame.
[0063] A second coordinate axis i is constructed from the direction from the center point of the object model to the first viewpoint position i. That is, the vector o in the direction from the center point of the object model to the first viewpoint position i is determined as the second coordinate axis i. A third coordinate axis i is determined based on the first coordinate axis i and the second coordinate axis i. Specifically, the third coordinate axis i can be determined by taking the cross product of the vectors corresponding to the first coordinate axis i and the second coordinate axis i. The first coordinate axis i, the second coordinate axis i, and the third coordinate axis i form the local coordinate system i corresponding to the first viewpoint position i. The center point of the object model refers to the center point of the object model for cloud analysis. In other words, with any surface position of the object model as the starting point, there is a plane tangent to the object model at that point. Therefore, the local coordinate system i corresponding to the first viewpoint position i can be determined using the first viewpoint position i and the tangent plane of the first viewpoint position i. The first coordinate axis i and the third coordinate axis i are located on the tangent plane corresponding to the first viewpoint position i. The cloud coordinates of the first viewpoint position i can be determined as the origin coordinates in the local coordinate system i corresponding to the first viewpoint position i. The cloud coordinates are used to represent the coordinates of the corresponding point (such as the viewpoint position or the acquisition point) in the local coordinate system. For example, the cloud coordinates of the first viewpoint position i refer to the coordinates of the first viewpoint position i in the local coordinate system i. In practical applications, the default origin coordinates, such as (0, 0), can be determined as the cloud coordinates of the first viewpoint position i; or, a coordinate mapping method can be used to convert the geographic coordinates of the first viewpoint position i into cloud coordinates. The coordinate mapping method refers to a method of mapping geographic coordinates to a local coordinate system. It can be manually determined or other methods of converting three-dimensional coordinates into two-dimensional coordinates are used. There is no limitation here. The geographic coordinates refer to coordinates in a global coordinate system. For example, when the object to be parsed is the earth, the global coordinate system can be the world coordinates on the earth. For example, when the object to be parsed is an object in a game application, the global coordinate system can be the coordinate system of the game map in the game application, etc.
[0064] For example, refer to Figure 6, which is a schematic diagram of a local coordinate construction scene provided by an embodiment of the present application. As shown in Figure 6, assuming that the first viewpoint position i in the object model 601 is point P, the first viewpoint position i is used as the origin, and the second coordinate axis i, that is, the direction of the vector o, is constructed in the direction from the center 6011 of the object model to the first viewpoint position i; the first coordinate axis i, that is, the direction of the vector r, is determined based on the second geographic coordinate point and the first geographic coordinate point; further, based on the cross product of the first coordinate axis i and the second coordinate axis i, the third coordinate axis i, that is, the direction of the vector f, is determined. Furthermore, coordinate scales can be associated with the first coordinate axis i, the second coordinate axis i, and the third coordinate axis i, respectively, to obtain the local coordinate system i corresponding to the first viewpoint position i, wherein the coordinates of the origin i of the local coordinate system i can be recorded as (0, 0). Among them, the first coordinate axis i and the third coordinate axis i are located on the tangent plane 602 corresponding to the first viewpoint position i.
[0065] In some embodiments, step S302 of constructing a local coordinate system corresponding to the first viewpoint position with the first viewpoint position as the origin can be achieved as follows: in the i-th viewpoint moving frame, when i is not the initial value, the viewing angle acquisition point of the i-th viewpoint moving frame is determined as the first viewpoint position i, and the first viewpoint position i is used as the origin. The second coordinate axis i is constructed in the direction from the center point of the object model to the first viewpoint position i, and the first coordinate axis i is constructed based on the third coordinate axis (i-1) corresponding to the (i-1)-th viewpoint moving frame and the second coordinate axis i. The third coordinate axis i is constructed based on the first coordinate axis i and the second coordinate axis i. The first coordinate axis i, the second coordinate axis i and the third coordinate axis i form the local coordinate system i corresponding to the first viewpoint position i.
[0066] Among them, when constructing the first coordinate axis i, the third coordinate axis (i-1) can be translated to the first viewpoint position i to obtain the reference third coordinate axis. Based on the reference third coordinate axis and the second coordinate axis i, the first coordinate axis i is constructed. For example, the cross product of the direction vector corresponding to the reference third coordinate axis and the direction vector corresponding to the second coordinate axis i can be determined as the direction vector of the first coordinate axis i. Based on the direction vector of the first coordinate axis i, the first coordinate axis i can be obtained. Of course, other methods can also be used to determine the first coordinate axis i, that is, when two coordinate axes are known, the third coordinate axis can be constructed.
[0067] When the third coordinate axis i is constructed based on the first coordinate axis i and the second coordinate axis i, and the first coordinate axis i, the second coordinate axis i and the third coordinate axis i are combined to form the local coordinate system i corresponding to the first viewpoint position i, when the viewpoint moves at a near-ground position, it can be regarded as the object model rolling on an infinitely large plane. The cloud data within the visible range changes continuously, and the change trend is the same as the rolling process. When rendering, it is generally only necessary to render the clouds within a certain range centered on the viewpoint, and there is no need to observe from a distance in outer space. Therefore, there is no need to directly generate a cloud covering the entire viewpoint. The cloud distribution image on the surface of the image model can be used to dynamically generate a local coordinate system based on the viewpoint movement. Moreover, it only focuses on whether the clouds within the viewpoint range are correctly displaced relative to the camera during the viewpoint movement process, and is not sensitive to the direction and shape of the cloud distribution at the same position some time ago. Therefore, the problem of generating a spherical map on the surface of a sphere can be transformed into the problem of rolling the sphere on an infinitely large plane and dynamically generating a planar map near the tangent point (i.e., the viewpoint position). In other words, the local coordinate system of the current viewpoint movement frame can be constructed based on the previous viewpoint movement frame. Among them, the above-mentioned label (i-1) is used to indicate that the corresponding data is the data generated in the (i-1)th viewpoint movement frame, such as the third coordinate axis (i-1) is used to indicate the third coordinate axis in the local coordinate system corresponding to the (i-1)th viewpoint movement frame, and the first viewpoint position (i-1) is used to indicate the first viewpoint position corresponding to the (i-1)th viewpoint movement frame.
[0068] In practical applications, if i is not the initial value, the viewing angle acquisition point (i.e., viewpoint) of the i-th viewpoint moving frame can be determined as the first viewpoint position i. As shown in FIG6 , the first viewpoint position i is point P'. The first viewpoint position i can be considered to be obtained by moving the viewpoint position from the first viewpoint position (i-1). Assuming that the first viewpoint position (i-1) is point P, the moving vector can be recorded as m, i.e., m=PP'. Assuming that the cloud coordinates of point P can be recorded as P(U, V), and the cloud coordinates of point P' can be recorded as P'(U', V'), then it can be recorded as U'=U+Δu, V'=V+Δv, and the coordinates (Δu, Δv) of the first viewpoint position i in the local coordinate system (i-1) can be determined as the position offset of the first viewpoint position i relative to the first viewpoint position (i-1); on the cloud coordinates of the first viewpoint position (i-1), the position offset of the first viewpoint position i relative to the first viewpoint position (i-1) is added to obtain the cloud coordinates of the first viewpoint position i, recorded as P'(U', V')=P'(U+Δu, V'=V+Δv). Similarly, the cloud coordinates of any first viewpoint position used to construct the local coordinate system can be obtained. Among them, the cloud coordinates of any point (such as the first viewpoint position or the first sampling point, etc.) refer to the coordinates of the point in the corresponding local coordinate system. Among them, the length of m is less than or equal to the adjacent frame movement threshold, that is, the length of PP' is less than or equal to the adjacent frame movement threshold. Through the adjacent frame movement threshold, the viewpoint movement distance between two adjacent viewpoint movement frames, that is, the change distance of the first viewpoint position, is limited, so that the two adjacent local coordinate systems will not undergo sudden changes, thereby improving the fault tolerance of the local coordinate system in cloud image processing, thereby improving the accuracy and efficiency of cloud image processing.
[0069] In the i-th viewpoint movement frame, the direction of the vector f corresponding to point P and the direction of the vector r passing through point P are no longer tangent to the surface of the object model. In order to ensure that the plane passing through the viewpoint position formed by the two coordinate axes in the local coordinate system always maintains a tangent relationship with the surface of the object model, the local coordinate system can be updated. Specifically, please refer to Figure 7, which is a schematic diagram of a coordinate system conversion scene provided by an embodiment of the present application. As shown in Figure 7, the second coordinate axis i, that is, the direction of the vector o', can be constructed in the direction from the object model center point 7011 of the object model 701 to the first viewpoint position i; first assume that the third coordinate axis (i-1) remains unchanged, that is, the direction of the vector f remains unchanged, and construct the first coordinate axis i, that is, the direction of the vector r', based on the third coordinate axis (i-1) and the second coordinate axis i. Based on the first coordinate axis i and the third coordinate axis i, the third coordinate axis i, that is, the direction of the vector f', is constructed. The first coordinate axis i, the second coordinate axis i, and the third coordinate axis i are combined to form the local coordinate system i corresponding to the first viewpoint position i. In this case, the first coordinate axis i and the third coordinate axis i can be considered to be located on the tangent plane 702 corresponding to the first viewpoint position i (i.e., point P'). Specifically, based on the first viewpoint position i as the origin i, the above-mentioned coordinate scales can be associated with the first coordinate axis i, the second coordinate axis i, and the third coordinate axis i, respectively, to obtain the local coordinate system i corresponding to the first viewpoint position i. The coordinate scale is used to represent the scale change method used to convert the coordinates on the object model to the local coordinate system. Optionally, the coordinates of the origin i can be marked as (0, 0). In this case, the coordinate values of the local coordinate systems corresponding to different viewpoint positions can be considered to be the same. Alternatively, the object coordinates of the first viewpoint position i can be converted into cloud coordinates, and the cloud coordinates corresponding to the first viewpoint position i are determined as the coordinates of the origin i. Based on the coordinate scale, the coordinate values of the local coordinate system i on the first coordinate axis i and the third coordinate axis i are determined. Among them, in any two adjacent viewpoint movement frames, the movement distance is very small relative to the object model, and the slight turn generated each time is imperceptible to the human eye. Therefore, at the viewpoint position near the viewpoint acquisition device (such as the camera in the game application, etc.), the human subjective feeling is the local coordinate system of the viewpoint position, which changes continuously according to the direction of the viewpoint acquisition device. This makes it possible to improve the accuracy of cloud map processing when constructing the local coordinate system based on adjacent viewpoint movement frames.
[0070] In some embodiments, obtaining the sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position in step S302 can be implemented as follows: obtaining the position information of the first viewpoint position and obtaining the coordinate offset of the first sampling point in the local coordinate system corresponding to the first viewpoint position; and adding the coordinate offset to the position information of the first viewpoint position to determine the sampling point position information of the first sampling point.
[0071] In practical applications, when obtaining the sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position, performing position conversion on the sampling point position information, and obtaining the cloud sampling position information, the first sampling point in the local coordinate system i can be obtained, the sampling coordinates of the first sampling point in the local coordinate system i are obtained, and the sampling coordinates of the first sampling point in the local coordinate system i are used as the sampling point position information of the first sampling point. When obtaining the position information of the first viewpoint position and obtaining the coordinate offset of the first sampling point in the local coordinate system corresponding to the first viewpoint position, for example, refer to FIG8 , FIG8 is a schematic diagram of a position determination scene provided by an embodiment of the present application. As shown in FIG8 , area 801 is used to represent a cross-sectional view at the first viewpoint position P. Assuming that the first sampling point is point A, the position information of the first viewpoint position P is obtained, that is, the cloud coordinates of the first viewpoint position P, and the coordinate offset of the first sampling point A in the local coordinate system corresponding to the first viewpoint position P is obtained, that is, (u A , v A ). Add the coordinate offset to the position information of the first viewpoint position to determine the sampling point position information of the first sampling point, recorded as A(U+u A , V+v A The closer the sampling point is to the surface of the object model, the greater the actual shape distortion will be. For example, the shape distortion of point B in Figure 8 is greater than that of point A. However, in real scenes, the closer the position is to the surface of the object model, the smaller the actual screen ratio occupied by the cloud image data, and the more likely it is to be blocked by more foreground objects. Therefore, this will not affect the realism of the image result and can ensure the accuracy of cloud image processing.
[0072] In some embodiments, the coordinates of the origins of different local coordinate systems are all (0, 0), and the sampling coordinates of the first sampling point in the corresponding local coordinate system can be determined as the sampling point position information of the first sampling point; or, the cloud coordinates of the first viewpoint position can be determined as the position information of the first viewpoint position, and the sampling coordinates of the first sampling point in the corresponding local coordinate system can be determined as the coordinate offset of the first sampling point in the local coordinate system corresponding to the first viewpoint position, and the coordinate offset can be determined as the sampling point position information of the first sampling point, which is recorded as (u A , v A ), or the coordinate offset can be added to the position information of the first viewpoint position to determine the sampling point position information of the first acquisition point, which is recorded as (U+u A , V+v A ). As shown in FIG8 , the projection distance of the first sampling point A on the r-axis is determined as the coordinate offset u of the first sampling point A. AIn other embodiments, the coordinates of the origin of each local coordinate system are the cloud coordinates of the corresponding first viewpoint position, and the sampling coordinates of the first sampling point in the local coordinate system can be obtained, and the sampling coordinates of the first sampling point are determined as the sampling point position information of the first sampling point.
[0073] In some embodiments, performing position conversion on the sampling point position information to obtain cloud sampling position information in step S302 can be achieved by performing modulo processing on the sampling point position information to obtain cloud sampling position information. For example, performing modulo processing on 1 can determine the decimal place of the sampling point position information as the cloud sampling position information of the first sampling point.
[0074] Step S303: based on the cloud sampling position information, sample the basic cloud map data to obtain the sampling cloud information of the first sampling point.
[0075] In some embodiments, step S303 may be implemented as follows: obtaining first pixel information of a pixel point at the cloud sampling position information of the basic cloud image data, and determining the first pixel information as the sampling cloud information of the first sampling point.
[0076] In some embodiments, step S303 can also be implemented as follows: when the basic cloud map data includes N levels of cloud map data, the computer device can obtain target level cloud map data whose cloud map height range includes the position height in the cloud sampling position information from the N levels of cloud map data, and sample the target level cloud map data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point, such as obtaining the second pixel information of the pixel point of the target level cloud map data at the cloud sampling position information, and determining the second pixel information as the sampling cloud information of the first sampling point.
[0077] In some embodiments, step S303 can also be implemented as follows: when the latitude of the first viewpoint is a third latitude threshold, sampling the basic cloud image data based on the cloud sampling location information to obtain first cloud information for the first sampling point; sampling the polar cloud image data based on the cloud sampling location information to obtain second cloud information for the first sampling point; and fusing the first cloud information with the second cloud information to obtain sampled cloud information for the first sampling point. The third latitude threshold can be the boundary between low and medium latitudes and high latitudes. For example, obtaining fourth pixel information of a pixel point in the polar cloud image data at the cloud sampling location information and determining the fourth pixel information as the second cloud information for the first sampling point; and fusing the first cloud information with the second cloud information to obtain the sampled cloud information for the first sampling point.
[0078] In practical applications, after obtaining the sampled cloud information for the first sampling point, the first sampling point can be rendered based on the sampled cloud information. Alternatively, noise data can be added to the sampled cloud information for the first sampling point to obtain cloud density information for the first sampling point, and the cloud density information for the first sampling point can be used to render the first sampling point. The noise data can be random noise. Adding noise data to the basic cloud image data can increase the randomness of the cloud density information for different sampling points without disrupting the order of the cloud density information, thereby improving the accuracy of cloud image processing. For details, see the relevant description of step S907 in FIG. 9 below.
[0079] In an embodiment of the present application, a spatial coordinate system can be constructed, and basic cloud map data can be constructed in the spatial coordinate system; a local coordinate system corresponding to the first viewpoint position is constructed with the first viewpoint position as the origin, and the sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position is obtained, and the sampling point position information is converted to obtain cloud sampling position information; different viewpoint positions correspond to different local coordinate systems; based on the cloud sampling position information, the basic cloud map data is sampled to obtain the sampling cloud information of the first sampling point. Through the above process, a basic cloud map data can be constructed, and then when sampling, the coordinates are determined based on the local coordinate system. In other words, it is equivalent to converting the problem of "generating a spherical map on the surface of a sphere" into the problem of "rolling a sphere on a plane and generating a planar map near the tangent point (i.e., sampling of the local coordinate system)", which simplifies the cloud map data production process and efficiency. Moreover, based on local sampling, when generating cloud map data with higher accuracy, it does not require a lot of overhead and resources, thereby saving resources and improving the accuracy and efficiency of cloud map processing.
[0080] Next, refer to Figure 9, which is a schematic diagram of a cloud map data iterative processing flow provided by an embodiment of the present application. As shown in Figure 9, the process may include the following steps:
[0081] Step S901: construct a spatial coordinate system and construct basic cloud map data in the spatial coordinate system.
[0082] In practical applications, reference may be made to the relevant description in step S301 of FIG3 , which will not be repeated here.
[0083] Step S902 : In the i-th video moving frame, a local coordinate system i corresponding to the first viewpoint position i is constructed with the first viewpoint position i as the origin.
[0084] In practical applications, the local coordinate system corresponding to the first viewpoint position i refers to a coordinate system with the first viewpoint position i as the origin and composed of three coordinate axes constructed by the first viewpoint position i. For details, please refer to the relevant description in step S302 of Figure 3, which will not be repeated here.
[0085] Step S903 : Obtain a first sampling point, obtain sampling point position information of the first sampling point in the local coordinate system i corresponding to the first viewpoint position i, perform position conversion on the sampling point position information, and obtain cloud sampling position information.
[0086] In practical applications, a computer device may obtain first sampling points based on the first viewpoint position i, where the number of the first sampling points is one or at least two, wherein the first sampling points refer to viewpoints within the area covered by the viewpoint acquisition device corresponding to the first viewpoint position i. Alternatively, a viewpoint region including the first viewpoint position i may be obtained, and the viewpoints included in the viewpoint region may be determined as the first sampling points. The size of the viewpoint region may be a local sampling size, which may be a default size or may be determined based on the distance between the first viewpoint positions corresponding to adjacent viewpoint moving frames, etc., without limitation herein.
[0087] Step S904: based on the cloud sampling position information, sample the basic cloud map data to obtain the sampling cloud information of the first sampling point.
[0088] In practical applications, please refer to the relevant description of step S302 in Figure 3 and will not be repeated here. That is, first pixel information at the cloud sampling location information can be obtained from the basic cloud image data and determined as the sampled cloud information for the first sampling point. Alternatively, when the basic cloud image data includes N levels of cloud image data, second pixel information at the cloud sampling location information can be obtained from the determined first level of cloud image data and determined as the sampled cloud information for the first sampling point. This sampled cloud information can represent information such as the cloud concentration at the corresponding first sampling point and can be used to construct the cloud image data.
[0089] Step S905: Check the completion status of the cloud map data.
[0090] In actual applications, the completion status of the cloud map data of the object model can be detected. If the cloud map processing of the object model is completed, step S907 is executed; if the cloud map processing of the object model is not completed, step S906 is executed.
[0091] Step S906, i++, simulate the movement of the object model to determine the first viewpoint position i.
[0092] In practical applications, i++ is used to perform the next viewpoint movement frame. For example, assuming that the update of i is i=2+1, that is, the second viewpoint movement frame is updated to the third viewpoint movement frame, then the i-th viewpoint movement frame is equivalent to the third viewpoint movement frame, the second viewpoint movement frame becomes the (i-1)-th viewpoint movement frame, and the first viewpoint position corresponding to the (i-1)-th viewpoint movement frame is recorded as the first viewpoint position (i-1). The object model can be simulated for movement to determine the tangent point between the moved object model and the simulated plane, and the tangent point between the moved object model and the simulated plane is determined as the first viewpoint position i; or, after performing i++, a candidate position range with the first viewpoint position (i--) as the center and the adjacent movement threshold as the radius can be determined on the surface of the object model of the object to be analyzed, and the first viewpoint position i is randomly selected within the candidate position range; or, the first viewpoint position i is selected within the candidate position range along the viewpoint movement direction, and the viewpoint movement direction is used to represent the direction of the first viewpoint position i relative to the first viewpoint position (i--). Among them, the area covered by the local coordinate system of the first viewpoint position i on the object surface of the object to be analyzed is adjacent to the area covered by the local coordinate system of the first viewpoint position (i--) on the surface of the object model of the object to be analyzed, or the intersecting area is less than or equal to the local repetition threshold.
[0093] Further return to execute step S902. Among them, the distance between the first viewpoint position i and the first viewpoint position (i-1) is less than or equal to the adjacent frame movement threshold, and the adjacent frame movement threshold is much smaller than the radius of the object model, that is, the distance between the first viewpoint positions corresponding to any two adjacent viewpoint movement frames is less than or equal to the adjacent frame movement threshold. In this way, when constructing the local coordinate system, the local coordinate system corresponding to the two adjacent viewpoint movement frames changes less, that is, the direction of the first coordinate axis and the direction of the third coordinate axis will not change suddenly, but will change gradually within a range that cannot be perceived by the human eye, so that the observation result of the human eye on the cloud map data sampling is in line with the law of continuous relative motion, thereby improving the accuracy of cloud map processing.
[0094] Step S907 , performing cloud image data rendering based on the sampling cloud information of the first sampling point.
[0095] In an embodiment of the present application, the sampling cloud information of all first sampling points can be obtained through the above process. Assume that the number of all first sampling points is M, and M is a positive integer. Among them, since the cloud map data is used to represent the distribution and morphology of the volume cloud from a bird's-eye view, that is, the sampling cloud information corresponding to the M first sampling points can be combined to obtain the object cloud map data corresponding to the object model. Alternatively, noise data can be added to the sampling cloud information corresponding to the M first sampling points to obtain the cloud density information corresponding to the M first sampling points. Based on the cloud density information corresponding to the M first sampling points, the M first sampling points are rendered to obtain the object cloud map data corresponding to the object model. In other words, the relevant information of the cloud corresponding to each first sampling point is known (i.e., the sampling cloud information or cloud density information), that is, the relevant information of the cloud corresponding to each first sampling point can be constructed into the object cloud map data of the object model, thereby realizing the drawing of the cloud map data of the object to be analyzed.
[0096] When the object model is a model of the earth, the object cloud map data can be integrated into a navigation simulation system. When performing simulated flight in the navigation simulation system, the object cloud map data can be rendered to simulate a real sky scene, so that a real flight scene can be simulated based on the object cloud map data. Alternatively, the object cloud map data can be integrated into a virtual reality (VR) scene, and the object cloud map data can be rendered in the VR scene so that users participating in the VR scene can obtain a more realistic scene experience, including a navigation VR scene or a VR game scene. For example, in a navigation VR scene, users can experience a real navigation process based on the rendered object cloud map data; in a VR game scene, when cloud map data is needed, the VR game scene can be rendered based on the object cloud map data, and users can participate in the VR game scene, such as an air combat VR game.
[0097] Through the above process, only the plane cloud map data within a smaller square area, namely the initial unit cloud map data, can be provided to dynamically generate seamless spherical cloud map data sampling on a global scale at runtime, which can save a lot of space for fine storage of cloud map data and cloud map processing resources, and improve the efficiency and accuracy of cloud map processing.
[0098] Next, refer to Figure 10, which is a schematic diagram of a cloud sampling process provided by an embodiment of the present application. As shown in Figure 10, the process may include the following steps:
[0099] Step S1001: Acquire the latitude of a first viewpoint position, and construct a local coordinate system corresponding to the first viewpoint position based on the latitude of the first viewpoint position.
[0100] In practical applications, basic cloud data and polar cloud data are obtained. Specifically, as shown in step S301 of Figure 3 , basic cloud data is generated. At the pole position of the object model, a polar coordinate system is constructed with the pole as the origin and the 0° and 90° meridians as the horizontal and vertical axes, respectively. Polar cloud data is then constructed for this polar coordinate system.
[0101] In some embodiments, the latitude of the first viewpoint location can be obtained. When the latitude of the first viewpoint location is less than or equal to a first latitude threshold, that is, the first viewpoint location is located in a mid-to-low latitude region, the longitude and latitude coordinates of the first sampling point are determined as the cloud sampling location information of the first sampling point. Alternatively, the longitude and latitude coordinates of the first sampling point are modified to obtain the cloud sampling location information of the first sampling point, and step S1003 is executed to determine the basic cloud image data as the cloud image data to be sampled. Based on the cloud sampling location information, the basic cloud image data is sampled to obtain the sampled cloud information of the first sampling point. When the latitude of the first viewpoint location is greater than the first latitude threshold, a local coordinate system corresponding to the first viewpoint location is constructed with the first viewpoint location as the origin, and step S1002 is further executed.
[0102] In other embodiments, when the latitude of the first viewpoint position is greater than a second latitude threshold, indicating that the first viewpoint position is located in a high-latitude region, a polar coordinate system is constructed at the pole of the object model, cloud sampling position information of the first sampling point is obtained in the polar coordinate system, and the polar cloud image data is determined as the basic cloud image data. That is, the polar cloud image data is determined as the cloud image data to be sampled, and step S1003 is executed. Based on the cloud sampling position information, the basic cloud image data is sampled to obtain the sampled cloud information of the first sampling point. The object model refers to the model for performing cloud image parsing. If the first viewpoint position is less than the second latitude threshold, the process of constructing a spatial coordinate system and constructing basic cloud image data in the spatial coordinate system is executed. Further, the basic cloud image data is determined as the cloud image data to be sampled, and step S1002 is executed.
[0103] Among them, the first latitude threshold and the second latitude threshold can be the same. At this time, the first latitude threshold and the second latitude threshold are the boundaries between the low and medium latitude regions and the high latitude regions, that is, at this time it can be the third latitude threshold, and the first latitude threshold and the second latitude threshold can also be different.
[0104] In some embodiments, if the latitude of the first viewpoint is less than or equal to a first latitude threshold, the longitude and latitude coordinates of the first sampling point are determined as the cloud sampling location information of the first sampling point, the basic cloud image data is determined as the cloud image data to be sampled, and step S1003 is executed. If the latitude of the first viewpoint is greater than a second latitude threshold, a polar coordinate system is constructed at the pole of the object model, the cloud sampling location information of the first sampling point is obtained in the polar coordinate system, the polar cloud image data is determined as the cloud image data to be sampled, and step S1003 is executed. If the latitude of the first viewpoint is greater than the first latitude threshold and less than or equal to the second latitude threshold, the basic cloud image data is determined as the cloud image data to be sampled, and step 1002 is executed.
[0105] In other embodiments, if the latitude of the first viewpoint position is the third latitude threshold, both the basic cloud map data and the polar cloud map data are determined as the cloud map data to be sampled, and step S1002 is executed.
[0106] Step S1002 : Obtain cloud sampling position information of a first sampling point in a local coordinate system corresponding to a first viewpoint position.
[0107] In the embodiment of the present application, specific reference may be made to the relevant description of step S302 in FIG3 , which is not limited here.
[0108] Step S1003: Acquire the cloud data to be sampled, sample the cloud data to be sampled based on the cloud sampling position information, and obtain sampling cloud information of the first sampling point.
[0109] In the embodiment of the present application, details may be found in the description of step S303 in FIG. 3 , which is not intended to be limiting. For example, when the cloud image data to be sampled includes basic cloud image data and polar cloud image data, the basic cloud image data may be sampled based on the cloud sampling location information to obtain first cloud information at a first sampling point; the polar cloud image data may be sampled based on the cloud sampling location information to obtain second cloud information at the first sampling point; and the first cloud information and the second cloud information may be fused to obtain sampled cloud information at the first sampling point.
[0110] Targeted sampling and processing are performed through the latitude of the first viewpoint position, so that special processing of the cloud map data can be achieved under special circumstances, so that the sampling results of the cloud map data can be seamlessly and smoothly transitioned. For example, when the latitude of the first viewpoint position is the third latitude threshold, the basic cloud map data and the polar cloud map data are both determined as the cloud map data to be sampled, and certain sampling and fusion operations are performed on the cloud map data on both sides, so that the sampling results of the cloud map data can be seamlessly and smoothly transitioned, thereby improving the accuracy of cloud map processing.
[0111] Referring to FIG11 , FIG11 is a schematic diagram of a cloud image processing device provided in an embodiment of the present application. The cloud image processing device can be a computer program (including program code, etc.) running in a computer device. For example, the cloud image processing device can be an application software; the device can be used to execute the corresponding steps of the method provided in the embodiment of the present application. As shown in FIG11 , the cloud image processing device 1100 can be used in the computer device in the embodiment corresponding to FIG3 . Specifically, the device can include: a cloud image construction module 11, a local construction module 12, a location determination module 13, and a cloud sampling module 14.
[0112] The cloud map construction module 11 is configured to construct a spatial coordinate system and construct basic cloud map data in the spatial coordinate system;
[0113] The local construction module 12 is configured to construct a local coordinate system corresponding to the first viewpoint position with the first viewpoint position as the origin; different viewpoint positions correspond to different local coordinate systems;
[0114] a position determination module 13 configured to obtain sampling point position information of the first sampling point in a local coordinate system corresponding to the first viewpoint position, perform position conversion on the sampling point position information, and obtain cloud sampling position information;
[0115] The cloud sampling module 14 is configured to sample the basic cloud map data based on the cloud sampling position information to obtain sampling cloud information of the first sampling point.
[0116] In some embodiments, the cloud map construction module 11 is further configured to obtain candidate cloud map data, and associate the candidate cloud map data with the spatial coordinate system to generate initial unit cloud map data; determine the initial unit cloud map data as basic cloud map data, or seamlessly continue the initial unit cloud map data to generate basic cloud map data.
[0117] In some embodiments, the cloud map construction module 11 includes:
[0118] An image conversion unit 111 is configured to obtain an image to be analyzed, perform coordinate conversion on the image size of the image to be analyzed, and obtain a spatial coordinate system;
[0119] The parsing and mapping unit 112 is configured to perform image parsing on the image to be parsed, and map the parsing result to a spatial coordinate system to obtain initial unit cloud data;
[0120] The cloud map continuation unit 113 is configured to seamlessly continue the initial unit cloud map data based on the initial unit cloud map data to generate basic cloud map data; the basic cloud map data refers to infinite cloud map data.
[0121] In some embodiments, the number of images to be parsed is N, where N is a positive integer; the cloud image continuation unit 113 includes:
[0122] The layer generation subunit 1131 is configured to seamlessly continue the N initial unit cloud image data corresponding to the N images to be analyzed to generate N layer cloud image data;
[0123] The height determination subunit 1132 is configured to determine the cloud image height ranges corresponding to the N levels of cloud image data based on the height ranges corresponding to the N images to be analyzed;
[0124] The level combination subunit 1133 is configured to combine N levels of cloud image data based on the cloud image height ranges corresponding to the N levels of cloud image data to obtain basic cloud image data.
[0125] In some embodiments, the local building block 12 includes:
[0126] The first construction unit 121 is configured to, in an i-th viewpoint moving frame, when i is an initial value, determine a first viewpoint position i based on the first geographic coordinate point, determine a first coordinate axis i based on the second geographic coordinate point and the first geographic coordinate point, construct a second coordinate axis i in a direction from the center point of the object model to the first viewpoint position i, determine a third coordinate axis i based on the first coordinate axis i and the second coordinate axis i, and form the first coordinate axis i, the second coordinate axis i, and the third coordinate axis i into a local coordinate system i corresponding to the first viewpoint position i; the object model center point refers to the center point of the object model for cloud image parsing;
[0127] The second construction unit 122 is configured to, when i is not an initial value, determine the viewing angle acquisition point of the i-th viewpoint moving frame as the first viewpoint position i, construct the second coordinate axis i in the direction from the center point of the object model to the first viewpoint position i, construct the first coordinate axis i based on the third coordinate axis (i-1) corresponding to the (i-1)-th viewpoint moving frame and the second coordinate axis i, construct the third coordinate axis i based on the first coordinate axis i and the second coordinate axis i, and form the first coordinate axis i, the second coordinate axis i and the third coordinate axis i into a local coordinate system i corresponding to the first viewpoint position i.
[0128] In some embodiments, when determining the first coordinate axis i based on the second geographic coordinate point and the first geographic coordinate point, the first constructing unit 121 includes:
[0129] The coordinate projection subunit 1211 is configured to obtain a tangent plane of the object model at a first geographic coordinate point, and obtain a projection length of a second geographic coordinate point in the tangent plane;
[0130] The coordinate axis determination subunit 1212 is configured to, when the projection length of the second geographic coordinate point in the tangent plane is not zero, determine the direction from the first geographic coordinate point to the second geographic coordinate point as the first coordinate axis i; when the projection length of the second geographic coordinate point in the tangent plane is zero, move the second geographic coordinate point along the tangent plane to obtain a third geographic coordinate; and when the projection length of the third geographic coordinate on the tangent plane is not zero, determine the direction from the first geographic coordinate point to the third geographic coordinate as the first coordinate axis i.
[0131] In some embodiments, the location determination module 13 includes:
[0132] A position acquisition unit 131 is configured to acquire position information of a first viewpoint position;
[0133] The offset obtaining unit 132 is configured to obtain a coordinate offset of the first sampling point in the local coordinate system corresponding to the first viewpoint position;
[0134] A position determination unit 133 is configured to add a coordinate offset to the position information of the first viewpoint position to determine the sampling point position information of the first sampling point;
[0135] The position conversion unit 134 is configured to perform a modulo process on the sampling point position information to obtain cloud sampling position information.
[0136] The basic cloud image data includes N levels of cloud image data; the cloud sampling module 14 includes:
[0137] The level determination unit 141 is configured to obtain, from the N levels of cloud image data, target level cloud image data whose cloud image height range includes the location height in the cloud sampling location information;
[0138] The hierarchical sampling unit 142 is configured to sample the target hierarchical cloud data based on the cloud sampling position information to obtain sampling cloud information of a first sampling point.
[0139] In some embodiments, the apparatus 1100 further includes:
[0140] The sampling calling module 15 is configured to, when the latitude of the first viewpoint position is less than or equal to the first latitude threshold, determine the longitude and latitude coordinates of the first sampling point as the cloud sampling position information of the first sampling point, and execute the step of sampling the basic cloud map data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point.
[0141] The local calling module 16 is configured to execute a process of constructing a local coordinate system corresponding to the first viewpoint position with the first viewpoint position as an origin when the latitude of the first viewpoint position is greater than a first latitude threshold.
[0142] In some embodiments, the apparatus 1100 further includes:
[0143] The pole processing module 17 is configured to, if the latitude of the first viewpoint position is greater than a second latitude threshold, construct a pole coordinate system at the pole of the object model, obtain cloud sampling position information of the first sampling point in the pole coordinate system, determine the polar cloud image data as basic cloud image data, and perform a process of sampling the basic cloud image data based on the cloud sampling position information to obtain the sampled cloud information of the first sampling point; the object model refers to the model for performing cloud image analysis;
[0144] The cloud map calling module 18 is configured to execute the process of constructing a spatial coordinate system and constructing basic cloud map data in the spatial coordinate system if the first viewpoint position is less than the second latitude threshold.
[0145] In some embodiments, the cloud sampling module 14 includes:
[0146] The first sampling unit 143 is configured to sample the basic cloud image data based on the cloud sampling position information to obtain first cloud information of the first sampling point if the latitude of the first viewpoint position is a third latitude threshold;
[0147] The second sampling unit 144 is configured to sample the polar cloud image data based on the cloud sampling position information to obtain second cloud information of the first sampling point;
[0148] The sampling and fusion unit 145 is configured to fuse the first cloud information and the second cloud information to obtain sampling cloud information of the first sampling point.
[0149] In some embodiments, the apparatus 1100 further includes:
[0150] The information processing module 19 is configured to add noise data to the sampled cloud information of the first sampling point to obtain cloud density information of the first sampling point;
[0151] The sampling and rendering module 20 is configured to render the first sampling point using the cloud density information of the first sampling point.
[0152] The embodiment of the present application provides a cloud map processing device, which can construct a spatial coordinate system and construct basic cloud map data in the spatial coordinate system; use a first viewpoint position as an origin to construct a local coordinate system corresponding to the first viewpoint position, obtain sampling point position information of a first sampling point in the local coordinate system corresponding to the first viewpoint position, perform position conversion on the sampling point position information, and obtain cloud sampling position information; different viewpoint positions correspond to different local coordinate systems; based on the cloud sampling position information, the basic cloud map data is sampled to obtain sampling cloud information of the first sampling point. Through the above process, a basic cloud map data can be constructed, and then when sampling, the coordinates are determined based on the local coordinate system. That is, it is equivalent to converting the problem of "generating a spherical map on the surface of a sphere" into the problem of "rolling a sphere on a plane and generating a planar map near the tangent point (i.e., sampling of the local coordinate system)", which simplifies the cloud map data production process and efficiency. Moreover, based on local sampling, when generating cloud map data with higher accuracy, it does not require a lot of overhead and resources, thereby saving resources and improving the accuracy and efficiency of cloud map processing.
[0153] Referring to Figure 12, Figure 12 is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. As shown in Figure 12, the computer device in an embodiment of the present application may include: one or more processors 1201, a memory 1202, and an input / output interface 1203. The processor 1201, the memory 1202, and the input / output interface 1203 are connected via a bus 1204. The memory 1202 is used to store a computer program, which includes program instructions. The input / output interface 1203 is used to receive and output data, such as for data exchange between the computer device and a business device. The processor 1201 is used to execute the program instructions stored in the memory 1202.
[0154] In some embodiments, the processor 1201 may perform the following operations:
[0155] Construct a spatial coordinate system and construct basic cloud map data in the spatial coordinate system; use the first viewpoint position as the origin to construct a local coordinate system corresponding to the first viewpoint position, obtain the sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position, perform position conversion on the sampling point position information, and obtain cloud sampling position information; different viewpoint positions correspond to different local coordinate systems; based on the cloud sampling position information, sample the basic cloud map data to obtain the sampling cloud information of the first sampling point.
[0156] In some embodiments, the processor 1201 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.
[0157] The memory 1202 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1201 and the input / output interface 1203. A portion of the memory 1202 may also include a non-volatile random access memory. For example, the memory 1202 may also store device type information.
[0158] In a specific implementation, the computer device can execute the implementation methods provided by the various steps in Figure 3 through its built-in functional modules. For details, please refer to the implementation methods provided by the various steps in Figure 3, which will not be repeated here.
[0159] The embodiment of the present application provides a computer device including: a processor, an input / output interface, and a memory. The processor obtains a computer program in the memory, executes the various steps of the method shown in FIG3, and performs cloud image processing operations. The embodiment of the present application realizes that a spatial coordinate system can be constructed, and basic cloud image data can be constructed in the spatial coordinate system; a local coordinate system corresponding to the first viewpoint position is constructed with the first viewpoint position as the origin, and the sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position is obtained, and the sampling point position information is converted to obtain cloud sampling position information; different viewpoint positions correspond to different local coordinate systems; based on the cloud sampling position information, the basic cloud image data is sampled to obtain the sampling cloud information of the first sampling point. Through the above process, a basic cloud map data can be constructed, and then when sampling, the coordinates are determined based on the local coordinate system. In other words, it is equivalent to converting the problem of "generating a spherical map on the surface of a sphere" into the problem of "rolling the sphere on a plane and generating a plane map near the tangent point (i.e., sampling of the local coordinate system)". This simplifies the production process and efficiency of the cloud map data. Moreover, based on local sampling, when generating cloud map data with higher precision, there is no need to consume more expenses and resources, thereby saving resources and improving the accuracy and efficiency of cloud map processing.
[0160] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program, and the computer program is suitable for being loaded by the processor and executing the cloud image processing method provided by each step in Figure 3. For details, please refer to the implementation method provided by each step in Figure 3, which will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, the computer program can be deployed to be executed on a computer device, or on multiple computer devices located at one location, or on multiple computer devices distributed at multiple locations and interconnected by a communication network.
[0161] The computer-readable storage medium may be the cloud image processing device provided in any of the aforementioned embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart memory card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device. Furthermore, the computer-readable storage medium may also include both the internal storage unit of the computer device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.
[0162] The embodiment of the present application also provides a computer program product or computer program, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in the various optional methods in Figure 3, thereby constructing a basic cloud map data. Then, when sampling, the coordinates are determined based on the local coordinate system. In other words, it is equivalent to converting the problem of "generating a spherical map on the surface of a sphere" into the problem of "rolling the sphere on a plane and generating a planar map near the tangent point (i.e., sampling of the local coordinate system)", which simplifies the production process and efficiency of the cloud map data. Moreover, based on local sampling, when generating cloud map data with higher precision, there is no need to consume more overhead and resources, thereby saving resources and improving the accuracy and efficiency of cloud map processing.
[0163] The terms "first", "second", etc. in the description, claims, and drawings of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.
[0164] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in this description according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0165] The methods and related devices provided in the embodiments of the present application are described with reference to the method flow charts and / or structural diagrams provided in the embodiments of the present application. Specifically, each process and / or box of the method flow charts and / or structural diagrams, as well as the combination of the processes and / or boxes in the flow charts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable cloud image processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable cloud image processing device produce a device for implementing the functions specified in one process or multiple processes in the flow chart and / or one box or multiple boxes in the structural diagram. These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable cloud image processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the functions specified in one process or multiple processes in the flow chart and / or one box or multiple boxes in the structural diagram. These computer program instructions may also be loaded onto a computer or other programmable cloud processing device so that a series of operating steps are executed on the computer or other programmable device to produce computer-implemented processing, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the structure diagram.
[0166] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.
[0167] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0168] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.
Claims
1. A cloud image processing method, the method being executed by a computer device, the method include: Constructing a spatial coordinate system, and constructing basic cloud image data in the spatial coordinate system; Taking the first viewpoint position as the origin, constructing a local coordinate system corresponding to the first viewpoint position, where different viewpoint positions correspond to different local coordinate systems; Obtaining sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position; Performing position conversion on the sampling point position information to obtain cloud sampling position information; Based on the cloud sampling position information, the basic cloud image data is sampled to obtain the sampling cloud information of the first sampling point.
2. The method according to claim 1, in, The step of constructing basic cloud image data in the spatial coordinate system includes: Acquire candidate cloud image data, and associate the candidate cloud image data with the spatial coordinate system to generate initial unit cloud image data; The initial unit cloud map data is determined as basic cloud map data, or the initial unit cloud map data is seamlessly continued to generate basic cloud map data.
3. The method according to claim 1, in, The step of constructing a spatial coordinate system and constructing basic cloud image data in the spatial coordinate system includes: Acquire an image to be analyzed, and perform coordinate transformation on the image size of the image to be analyzed to obtain a spatial coordinate system; Performing image analysis on the image to be analyzed, mapping the analysis result to the spatial coordinate system, and obtaining initial unit cloud image data; On the basis of the initial unit cloud map data, the initial unit cloud map data is seamlessly continued to generate basic cloud map data; the basic cloud map data refers to infinite cloud map data.
4. The method according to claim 3, in, The number of images to be analyzed is N, where N is a positive integer; The step of seamlessly continuing the initial unit cloud map data based on the initial unit cloud map data to generate basic cloud map data includes: Based on the initial unit cloud map data corresponding to the N images to be analyzed, the N initial unit cloud map data are seamlessly continued to generate N level cloud map data; Based on the height ranges respectively corresponding to the N images to be analyzed, determining the cloud image height ranges respectively corresponding to the N levels of cloud image data; Based on the cloud image height ranges respectively corresponding to the N levels of cloud image data, the N levels of cloud image data are combined to obtain basic cloud image data.
5. The method according to claim 1, in, Taking the first viewpoint position as the origin, constructing a local coordinate system corresponding to the first viewpoint position, including: In the i-th viewpoint moving frame, when i is an initial value, a first viewpoint position i is determined based on a first geographic coordinate point, a first coordinate axis i is determined based on a second geographic coordinate point and the first geographic coordinate point, a second coordinate axis i is constructed in a direction from the center point of the object model to the first viewpoint position i, a third coordinate axis i is determined based on the first coordinate axis i and the second coordinate axis i, and the first coordinate axis i, the second coordinate axis i and the third coordinate axis i are combined to form a local coordinate system i corresponding to the first viewpoint position i; the center point of the object model refers to the center point of the object model for cloud image parsing; When i is not the initial value, the viewing angle acquisition point of the i-th viewpoint moving frame is determined as the first viewpoint position i, and the second coordinate axis i is constructed in the direction from the center point of the object model to the first viewpoint position i. The first coordinate axis i is constructed based on the third coordinate axis (i-1) corresponding to the (i-1)-th viewpoint moving frame and the second coordinate axis i. The third coordinate axis i is constructed based on the first coordinate axis i and the second coordinate axis i. The first coordinate axis i, the second coordinate axis i and the third coordinate axis i form a local coordinate system i corresponding to the first viewpoint position i.
6. The method according to claim 5, in, The determining the first coordinate axis i based on the second geographic coordinate point and the first geographic coordinate point includes: Obtain a tangent plane of the object model at the first geographic coordinate point, and obtain a tangent plane of the second geographic coordinate point at the tangent plane. Projection length in the plane; When the projection length of the second geographic coordinate point in the tangent plane is not 0, the direction from the first geographic coordinate point to the second geographic coordinate point is determined as the first coordinate axis i.
7. The method according to claim 6, in, The determining the first coordinate axis i based on the second geographic coordinate point and the first geographic coordinate point includes: When the projection length of the second geographic coordinate point in the tangent plane is 0, the second geographic coordinate point is moved along the tangent plane to obtain a third geographic coordinate; When the projection length of the third geographic coordinate on the tangent plane is not 0, the direction from the first geographic coordinate point to the third geographic coordinate is determined as the first coordinate axis i.
8. The method according to claim 1, in, The step of acquiring sampling point position information of the first sampling point in the local coordinate system corresponding to the first viewpoint position, and performing position conversion on the sampling point position information to obtain cloud sampling position information includes: Acquire the position information of the first viewpoint position, and acquire the coordinate offset of the first sampling point in the local coordinate system corresponding to the first viewpoint position; Add the coordinate offset to the position information of the first viewpoint position to determine the sampling point position information of the first sampling point; The sampling point location information is subjected to modulo processing to obtain cloud sampling location information.
9. The method according to claim 1, in, The basic cloud image data includes N levels of cloud image data; The step of sampling the basic cloud image data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point includes: From the N levels of cloud image data, obtain target level cloud image data whose cloud image height range includes the location height in the cloud sampling location information; Based on the cloud sampling position information, the target level cloud image data is sampled to obtain the sampling cloud information of the first sampling point.
10. The method according to claim 1, in, The step of sampling the basic cloud image data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point includes: The first pixel information of the pixel point of the basic cloud image data at the cloud sampling position information is obtained, and the first pixel information is determined as the sampling cloud information of the first sampling point.
11. The method according to claim 1, in, The method further comprises: When the latitude of the first viewpoint position is less than or equal to a first latitude threshold, the longitude and latitude coordinates of the first sampling point are determined as the cloud sampling position information of the first sampling point, and the step of sampling the basic cloud image data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point is performed; When the latitude of the first viewpoint position is greater than the first latitude threshold, the process of constructing a local coordinate system corresponding to the first viewpoint position with the first viewpoint position as the origin is performed.
12. The method of claim 1, in, The method further comprises: When the latitude of the first viewpoint position is greater than the second latitude threshold, a polar coordinate system is constructed at the pole of the object model, cloud sampling position information of the first sampling point is obtained in the polar coordinate system, polar circle cloud map data is determined as basic cloud map data, and the process of sampling the basic cloud map data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point is performed; the object model refers to a model for performing cloud map analysis; When the first viewpoint position is less than the second latitude threshold, the process of constructing the spatial coordinate system and constructing basic cloud map data in the spatial coordinate system is executed.
13. The method of claim 1, in, The step of sampling the basic cloud image data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point includes: When the latitude of the first viewpoint position is a third latitude threshold, sampling the basic cloud image data based on the cloud sampling position information to obtain first cloud information of the first sampling point; Based on the cloud sampling position information, the polar cloud image data is sampled to obtain the second cloud information of the first sampling point. interest; The first cloud information and the second cloud information are fused to obtain sampling cloud information of the first sampling point.
14. The method of claim 1, in, The method further comprises: adding noise data to the sampled cloud information of the first sampling point to obtain cloud density information of the first sampling point; The cloud density information of the first sampling point is used to render the first sampling point.
15. A cloud image processing device, the device include: A cloud map construction module is configured to construct a spatial coordinate system and construct basic cloud map data in the spatial coordinate system; A local construction module, configured to construct a local coordinate system corresponding to the first viewpoint position with the first viewpoint position as an origin; a position determination module configured to obtain sampling point position information of the first sampling point in a local coordinate system corresponding to the first viewpoint position, and perform position conversion on the sampling point position information to obtain cloud sampling position information; different viewpoint positions correspond to different local coordinate systems; The cloud sampling module is configured to sample the basic cloud image data based on the cloud sampling position information to obtain the sampling cloud information of the first sampling point.
16. A computer device comprising a processor, a memory, and an input and output interface; The processor is connected to the memory and the input / output interface respectively. in, The input and output interface is used to receive data and output data, the memory is used to store a computer program, and the processor is used to call the computer program so that the computer device executes the method according to any one of claims 1 to 14.
17. A computer-readable storage medium storing a computer program, wherein the computer program is suitable for being loaded and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 14.
18. A computer program product, comprising a computer program, wherein the computer program implements the method according to any one of claims 1 to 14 when executed by a processor.
Citation Information
Patent Citations
Cloudscape rebuilding method combining satellite cloud pictures and natural images
CN107689079A
Three-dimensional cloud scene modeling and visualization method based on foundation cloud picture
CN114332364A
Construction method and device of scene space model and storage medium
CN114399597A
Cloud picture processing method and device, computer and readable storage medium
CN116385622A
Cloud picture processing method and device, computer and readable storage medium
CN117237511A
