Method and device for ocean scene construction and storage medium

Abstract

The invention relates to the technical field of image processing, and discloses a method and device for ocean scene construction and a storage medium. The method comprises the following steps: determining a seawater color parameter value of an on-site marine environment according to an image sequence of a standard color palette collected in the on-site marine environment; determining vertex position information of each vertex of the ocean surface in each frame of picture in the simulated ocean environment, the simulated light condition of the simulated ocean environment being determined according to the acquisition time of the image sequence; and according to the vertex position information and the seawater color parameter value, constructing the surface appearance of the seawater in the simulated marine environment. In this way, color reconstruction of the ocean surface and the sky in an ocean environment is achieved, and the authenticity and effectiveness of scene simulation are improved.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, for example, to a method, device and storage medium for constructing an ocean scene. Background Art

[0002] Constructing an ocean scene specifically refers to using 3D graphics technology and simulation technology to create a virtual ocean environment that can simulate the real ocean environment and is conducive to research and application in ocean science, engineering, meteorology, navigation, and military affairs.

[0003] Among them, most of the rendering methods of ocean scenes focus on the dynamic simulation of seawater, which can construct a sparkling sea surface. However, the color reproduction of water and sky is not the focus of construction and rendering. In the rendering process, seawater is usually rendered as water, the refractive index is set to 1.33, and the refraction and reflection of the water surface are calculated according to this refractive index, and the corresponding water appearance is rendered. The appearance rendering of the sky depends entirely on the environment map, and the colors of the seawater and the sky are not collected at the same time for rendering. However, in fact, the color of the seawater surface is determined by the lighting conditions in the scene and the color of the scattered light of the seawater. Therefore, the constructed ocean scene is not accurate enough, and its practical value needs to be enhanced.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0006] The embodiments of the present disclosure provide a method, device and storage medium for ocean scene construction to solve the technical problem that the accuracy of ocean scene construction needs to be improved.

[0007] In some embodiments, the method comprises:

[0008] Determine the seawater color parameter values ​​of the on-site marine environment based on the image sequence of the standard color plate collected under the on-site marine environment;

[0009] Determine vertex position information of each vertex on the ocean surface in each frame of the image in the simulated ocean environment, wherein the simulated light condition of the simulated ocean environment is determined according to the acquisition time of the image sequence;

[0010] According to the vertex position information and the seawater color parameter values, the surface appearance of the seawater in the simulated ocean environment is constructed.

[0011] In some embodiments, determining the seawater color parameter value of the on-site marine environment includes:

[0012] Acquire multiple image sequences that match the positional relationships between sunlight, an image acquisition device, and a standard color plate in a live marine environment;

[0013] After synthesizing each image sequence into a corresponding high dynamic range HDR image, determine the standard color plate in the direct HDR image that matches the vertical position relationship between sunlight and the standard color plate, and perform color correction on each HDR image according to the standard color plate to obtain a corresponding HDR corrected image;

[0014] Determine the luminance RGB values ​​of each HDR corrected image.

[0015] In some embodiments, the acquisition of multiple image sequences that match the positional relationships between sunlight, an image acquisition device, and a standard color plate in a live ocean environment includes:

[0016] In the on-site marine environment, when sunlight vertically impinges on the standard color plate, direct images of the standard color plate corresponding to a plurality of fixed exposure amounts are acquired to form a first image sequence;

[0017] In the on-site ocean environment, when the standard color plate is facing away from the sunlight, acquiring the standard color plate atmospheric scattering images corresponding to a plurality of fixed exposures to form a second image sequence;

[0018] In the on-site marine environment, when the image acquisition device equipped with a polarizer is perpendicular to the standard color plate located near the sea surface, standard color plate seawater scattering images corresponding to multiple fixed exposures are obtained to form a third image sequence.

[0019] In some embodiments, constructing the surface appearance of seawater in a simulated ocean environment comprises:

[0020] According to the simulated light conditions of the simulated ocean environment and the vertex position information, the reflectivity of the simulated seawater corresponding to each vertex is determined;

[0021] According to the reflectivity, as well as the direct brightness RGB value, the atmospheric scattering RGB value, and the seawater scattering RGB value in the seawater color parameter value, the simulated brightness value corresponding to each vertex is obtained.

[0022] In some embodiments, determining the reflectivity of the simulated seawater corresponding to each vertex includes:

[0023] According to the simulated light conditions of the simulated ocean environment, determine the incident direction vector L of the virtual light source toward the current vertex;

[0024] According to the vertex position information of the current vertex, determine the corresponding normal direction vector N and the observation direction unit vector V from the current vertex to the virtual camera;

[0025] Determine the reflectivity that matches the normal direction vector N and the viewing direction unit vector V.

[0026] In some embodiments, obtaining the simulated brightness value corresponding to each vertex includes:

[0027] Determine the unit vector V' of the mirror reflection direction from the current vertex to the viewing direction of the virtual camera;

[0028] When the incident direction vector L is equal to the unit vector V' of the mirror reflection direction, the simulated brightness value corresponding to the current vertex is determined according to formula (1);.

[0029] When the incident direction vector L is not equal to the unit vector V' of the mirror reflection direction, the simulation brightness value corresponding to the current vertex is determined according to formula (2); wherein,

[0030] C p =ρ·[R(N,V)·(C d +C i )+C v ] (1)

[0031] C p =ρ·[R(N,V)·C i +C v ] (2)

[0032] C p is the simulated brightness value, ρ is the scene brightness coefficient, R(N,V) is the reflectivity determined by the Fresnel function, C d is the direct brightness RGB value, C i is the RGB value of atmospheric scattering brightness, C v It is the RGB value of seawater scattering brightness.

[0033] In some embodiments, it also includes:

[0034] A sky environment map is obtained based on an image sequence of a standard color plate located below a mirror sphere collected in a field ocean environment;

[0035] The surface appearance of the sky in the simulated ocean environment is constructed based on the brightness of each pixel in the sky environment map and the scene brightness coefficient.

[0036] In some embodiments, obtaining a sky environment map includes:

[0037] In the on-site marine environment, when the standard color plate is located below the mirror sphere and placed vertically on the sea surface, and the image acquisition device is facing the first surface of the standard color plate, direct images of the standard color plate at two angles corresponding to a fixed plurality of exposures are obtained to form two corresponding sky image sequences, wherein the two angles differ by 180°;

[0038] After synthesizing each sky image sequence into a corresponding sky HDR image, color correction and spherical environment mapping are performed to obtain the corresponding environment map, and the two environment maps are superimposed and culled to obtain a sky environment map.

[0039] In some embodiments, the apparatus for constructing an ocean scene includes a processor and a memory storing program instructions, and the processor is configured to execute the above-mentioned method for constructing an ocean scene when executing the program instructions.

[0040] In some embodiments, the storage medium stores program instructions, and when the program instructions are run, the method for constructing an ocean scene is executed.

[0041] The method, device and storage medium for constructing an ocean scene provided by the embodiments of the present disclosure can achieve the following technical effects:

[0042] In the on-site ocean environment, an image sequence of standard color plates can be obtained through an image acquisition device, and the corresponding seawater color parameter values ​​can be obtained. In this way, when the ocean scene is constructed according to the seawater color parameter values, the ocean color appearance in this simulated ocean environment can be consistent with the actual scene, which is more conducive to research and application in marine science, engineering, meteorology, navigation, military and other aspects, and improves the practical value of the simulated ocean environment.

[0043] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0045] Figure 1 is a flow chart of a method for constructing an ocean scene provided by an embodiment of the present disclosure;

[0046] Figure 2 is a schematic diagram of a scene for collecting image sequences in ocean scene construction provided by an embodiment of the present disclosure;

[0047] Figure 3 is a schematic diagram of a scene for simulating and constructing an ocean scene provided by an embodiment of the present disclosure;

[0048] Figure 4 It is a schematic diagram of a process for collecting and processing image data in ocean scene construction provided by an embodiment of the present disclosure;

[0049] Figure 5 is a schematic diagram of a process for constructing an ocean scene provided by an embodiment of the present disclosure;

[0050] Figure 6 is a structural schematic diagram of a device for constructing an ocean scene provided by an embodiment of the present disclosure;

[0051] Figure 7 is a structural schematic diagram of a device for constructing an ocean scene provided by an embodiment of the present disclosure;

[0052] Figure 8 It is a schematic diagram of a simulation device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0053] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0054] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0055] Unless otherwise stated, the term "plurality" means two or more.

[0056] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0057] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0058] Constructing an ocean scene specifically refers to creating a virtual ocean environment using three-dimensional graphics technology and simulation technology. In the disclosed embodiment, when constructing an ocean scene, attention is paid to the colors of the water and the sky, that is, in a live ocean environment, an image sequence of a standard color plate can be obtained through an image acquisition device, and the corresponding seawater color parameter value can be obtained. In this way, the ocean scene can be constructed based on the seawater color parameter value obtained by measuring the actual environment, so that the ocean color appearance in this simulated ocean environment can be consistent with the actual scene, which improves the accuracy of the ocean scene construction, is more conducive to research and application in marine science, engineering, meteorology, navigation, military and other aspects, and improves the practical value of the simulated ocean environment.

[0059] Figure 1 FIG. 1 is a flow chart of a method for constructing an ocean scene provided by an embodiment of the present disclosure. Figure 1 As shown in the figure, the process of ocean scene construction includes:

[0060] Step 101: Determine the seawater color parameter value of the on-site marine environment according to the image sequence of the standard color plate collected in the on-site marine environment.

[0061] In the disclosed embodiment, one or more of the direct solar radiation illumination, atmospheric scattered radiation illumination, and seawater scattered brightness of a real ocean scene can be measured on-site, and then the obtained illumination or brightness data is used as input data to reconstruct the measured ocean scene in the simulation system. Therefore, in some embodiments, determining the seawater color parameter value of the on-site ocean environment includes: obtaining multiple image sequences that match the positional relationship between sunlight, an image acquisition device, and a standard color plate in the on-site ocean environment; after synthesizing each image sequence into a corresponding high dynamic range HDR image, determining the standard color plate in the direct HDR image that matches the vertical positional relationship between sunlight and the standard color plate, and performing color correction on each HDR image according to the standard color plate to obtain a corresponding HDR corrected image; and determining the brightness RGB value of each HDR corrected image.

[0062] Among them, only one image acquisition device and one standard color plate are needed to complete the image data acquisition of an actual ocean scene, and the ocean scene can be reconstructed using the acquired image data. The image acquisition device can be a visible light camera, such as a SLR camera.

[0063] The central exposure parameters of the image acquisition device, including the aperture and the shutter, can be determined by actual shooting. Of course, the central exposure parameters of the image acquisition device can also be preset, or the central exposure parameters of the image acquisition device can be obtained through data transmission. The details are not listed one by one. In this way, during the subsequent image data acquisition, the positions of the image acquisition device and the standard color plate may change, but the central exposure parameters are kept consistent during each acquisition process.

[0064] In some embodiments, obtaining multiple image sequences that match the positional relationships between sunlight, an image acquisition device, and a standard color plate in a live ocean environment includes: in the live ocean environment, when sunlight is vertically incident on the standard color plate, obtaining direct images of the standard color plate corresponding to multiple fixed exposures to form a first image sequence; in the live ocean environment, when the standard color plate is facing away from the sunlight, obtaining atmospheric scattering images of the standard color plate corresponding to multiple fixed exposures to form a second image sequence; in the live ocean environment, when an image acquisition device equipped with a polarizer is perpendicular to the standard color plate located near the sea surface, obtaining seawater scattering images of the standard color plate corresponding to multiple fixed exposures to form a third image sequence.

[0065] like Figure 2 As shown in (a), the image acquisition device is a single-lens reflex camera. In the on-site marine environment, the standard color plate is placed in the sun so that the sun is incident vertically on the standard color plate, that is, the sunlight is incident vertically on the standard color plate. Then, the automatic bracketing exposure method is used to shoot a plurality of standard color plate image sequences with different exposure amounts, that is, a plurality of standard color plate direct images are obtained to form a first image sequence. The central exposure parameter of the bracketing exposure can be determined by test shooting or preset, and the exposure amounts of the multiple exposures form an arithmetic progression.

[0066] Likewise, Figure 2 As shown in (b), in the on-site marine environment, the standard color plate is facing away from the sun, that is, the standard color plate is facing away from the sunlight, and then, as described above, a plurality of standard color plate image sequences with different exposures are taken using the automatic bracketing exposure method, that is, a plurality of standard color plate atmospheric scattering images are obtained to form a second image sequence. Of course, the exposure amount is also as described above, and the central exposure parameter of the bracketing exposure can be determined by test shooting or preset, and the exposure amounts of the multiple exposures form an arithmetic progression.

[0067] like Figure 2 As shown in (c), in the on-site marine environment, a polarizing filter is installed on the SLR camera, the camera is directed toward the water surface and the direction is perpendicular to the water surface, the water surface reflection is adjusted to the minimum by rotating the polarizing filter, and the standard color plate is placed near the water surface, that is, the image acquisition device with the polarizing filter is perpendicular to the standard color plate located near the sea surface, and then, as above, multiple standard color plate image sequences with different exposure amounts are taken using the automatic bracketing exposure method, that is, multiple standard color plate seawater scattering images are obtained to form a third image sequence. Of course, the exposure amount is also as described above, and the central exposure parameter of the bracketing exposure can be determined by test shooting or preset, and the exposure amounts of multiple exposures form an arithmetic progression.

[0068] Of course, it is also necessary to record the time of field data collection, including date and time. In this way, after acquiring one, two or more image sequences, image data processing is required to obtain the corresponding seawater color parameter values ​​of the field ocean environment, including one or more of direct brightness RGB value, atmospheric scattering RGB value, and seawater scattering RGB value. In the embodiment of the present disclosure, the standard color palette contains at least 24 color blocks, and includes a neutral white color block for white balance.

[0069] First, each image sequence can be synthesized into a corresponding high dynamic range (HDR) image. Then, in the HDR image obtained by direct sunlight color measurement, a standard color plate is found, that is, a standard color plate in the direct HDR image that matches the vertical position relationship between sunlight and the standard color plate is determined; based on this standard color plate, all other HDR images are corrected to the color space based on this standard color plate using an image color correction method, and finally, a corresponding color-corrected HDR image, that is, an HDR corrected image, can be obtained. Among them, the color correction method includes but is not limited to a color lookup table method and a color correction method based on a BP neural network.

[0070] If the image sequences that match the positional relationship between sunlight, the image acquisition device, and the standard color plate in the on-site ocean environment include: a first image sequence, a second image sequence, and a third image sequence, the HDR correction image I of the direct sunlight color measurement can be obtained respectively. d ,HDR Corrected Image of Atmospheric Scattering Color Measurement I i, And, HDR corrected image I of seawater scattering color measurement v .

[0071] HDR Corrected Image I of Atmospheric Scattering Color Measurement i , find the neutral white color block, calculate the average RGB value of the color block, and you can get the atmospheric scattering RGB value C i Then, the HDR-corrected image I d Find the neutral white patch, calculate the average RGB value of the patch, and subtract C i , get the direct brightness RGB value C d . And, HDR-corrected image I of seawater scattering color measurement v In the above example, a water surface is selected and the average RGB value of the water surface pixels is calculated to obtain the seawater scattering RGB value C v .

[0072] Step 102: Determine vertex position information of each vertex on the ocean surface in each frame of the image in the simulated ocean environment, wherein the simulated light condition of the simulated ocean environment is determined according to the acquisition time of the image sequence.

[0073] After determining the seawater color parameter values ​​of the on-site ocean environment, the seawater color parameter values ​​need to be used as input data to reconstruct the measured ocean scene in the simulation system. Therefore, the simulated light conditions of the simulated ocean environment need to be consistent with the light conditions of the measured ocean scene. Therefore, the simulated light conditions of the simulated ocean environment can be determined based on the time of field data acquisition, that is, the acquisition time of the image sequence. It can include: constructing a virtual light source (representing the sun) and a virtual camera in the simulated ocean environment. The zenith angle and direction angle of the virtual light source (sun) are calculated by recording the date and time of field data acquisition. It can be seen that the simulated light conditions of the simulated ocean environment are determined based on the acquisition time of the image sequence.

[0074] The position information P of each vertex on the ocean surface in each frame of the image under this lighting condition can be obtained through a wave dynamic simulation algorithm.

[0075] Step 103: construct the surface appearance of the seawater in the simulated ocean environment according to the vertex position information and the seawater color parameter value.

[0076] The seawater color parameter value and vertex position information are used as input data to reconstruct the measured ocean scene in the simulation system, which may include: determining the reflectivity of the simulated seawater corresponding to each vertex according to the simulated light conditions of the simulated ocean environment and the vertex position information; and obtaining the simulated brightness value corresponding to each vertex according to the reflectivity, and the direct brightness RGB value, atmospheric scattering RGB value, and seawater scattering RGB value in the seawater color parameter value.

[0077] In some embodiments, determining the reflectivity of the simulated seawater corresponding to each vertex includes: determining the incident direction vector L of the virtual light source toward the current vertex according to the simulated light conditions of the simulated ocean environment; determining the corresponding normal direction vector N and the observation direction unit vector V from the current vertex to the virtual camera according to the vertex position information of the current vertex; and determining the reflectivity that matches the normal direction vector N and the observation direction unit vector V.

[0078] like Figure 3As shown, the positions of the virtual light source and a virtual camera have been determined. According to the position information P of the current vertex, the incident direction vector L of the virtual light source to the current vertex can be determined, and the corresponding normal direction vector N and the observation direction unit vector V from the current vertex to the virtual camera can also be obtained. In this way, according to the normal direction vector N and the observation direction unit vector V, the reflectivity of the simulated seawater corresponding to the current vertex can be obtained. In some embodiments, the Fresnel reflectivity R(N,V) can be the reflectivity of the simulated seawater corresponding to the current vertex. Of course, in some embodiments, the Fresnel reflectivity R(N,V) can also be replaced by the seawater surface BRDF.

[0079] After determining the reflectivity of the simulated seawater corresponding to each vertex, the simulated brightness value corresponding to each vertex can be obtained based on the reflectivity and the seawater color parameter value. In some embodiments, if the seawater color parameter value includes: direct brightness RGB value, atmospheric scattering RGB value, and seawater scattering RGB value, obtaining the simulated brightness value corresponding to each vertex may include: determining the mirror reflection direction unit vector V' from the current vertex to the viewing direction of the virtual camera; when the incident direction vector L is equal to the mirror reflection direction unit vector V', according to formula (1), determining the simulated brightness value corresponding to the current vertex; when the incident direction vector L is not equal to the mirror reflection direction unit vector V', according to formula (2), determining the simulated brightness value corresponding to the current vertex; wherein,

[0080] C p =ρ·[R(N,V)·(C d +C i )+C v ] (1)

[0081] C p =ρ·[R(N,V)·C i +C v ] (2)

[0082] C p is the simulated brightness value, ρ is the scene brightness coefficient, R(N,V) is the reflectivity determined by the Fresnel function, C d is the direct brightness RGB value, C i is the RGB value of atmospheric scattering brightness, C v It is the RGB value of seawater scattering brightness.

[0083] Of course, a screening function Δ(L, V') can also be constructed, where L = V' is 1 and 0 in other cases. In this way, after determining the mirror reflection direction unit vector V' from the current vertex to the viewing direction of the virtual camera according to the normal direction vector N and the viewing direction unit vector V, the simulation brightness value corresponding to the current vertex can be directly determined according to formula (3); where,

[0084] C p =ρ·[R(N,V)·(Δ(L,V')·C d +C i )+C v ] (3)

[0085] Thus, according to C p In the process of constructing the surface appearance of seawater in a simulated ocean environment, the contribution of direct sunlight is composed of the scene brightness coefficient ρ, the Fresnel reflectivity R(N,V) and the direct brightness RGB value C d The contribution of atmospheric scattering is determined by the scene brightness coefficient ρ, the Fresnel reflectivity R(N,V) and the atmospheric scattering RGB value C i The contribution of seawater scattering is determined by the scene brightness coefficient ρ and the seawater scattering RGB value C v Decide.

[0086] It can be seen that in the embodiments of the present disclosure, when constructing the ocean scene, attention is paid to the color of the water body, that is, in the on-site ocean environment, an image sequence of a standard color plate can be obtained through an image acquisition device, and the corresponding seawater color parameter values ​​can be obtained. In this way, the ocean scene can be constructed based on the seawater color parameter values ​​measured in the actual environment, so that the color appearance of the ocean in this simulated ocean environment can be consistent with the actual scene, thereby improving the accuracy of the ocean scene construction, and is more conducive to research and application in marine science, engineering, meteorology, navigation, military and other aspects, thereby improving the practical value of the simulated ocean environment.

[0087] When constructing an ocean scene, one may not only pay attention to the color of the water, but also the color of the sky. Therefore, in some embodiments, the process of constructing an ocean scene also includes: obtaining a sky environment map based on a sequence of images of a standard color plate located below a mirror sphere collected in a live ocean environment; constructing the surface appearance of the sky in a simulated ocean environment based on the brightness of each pixel in the sky environment map and the scene brightness coefficient.

[0088] In this way, in the process of collecting image data of an actual ocean scene, not only can the first image sequence, the second image sequence and the third image sequence be collected and obtained through the image acquisition device and the standard color plate, but also the sky image sequence of the mirror sphere and the standard color plate can be collected and obtained through the image acquisition device, the standard color plate and the mirror sphere, thereby obtaining the corresponding sky environment map. Therefore, in some embodiments, obtaining the sky environment map includes: in the on-site ocean environment, when the standard color plate is located below the mirror sphere and placed vertically on the sea surface, and the image acquisition device is facing the first surface of the standard color plate, obtaining direct images of the standard color plate at two angles corresponding to the fixed multiple exposures to form two corresponding sky image sequences, wherein the two angles differ by 180°; after synthesizing each sky image sequence into a corresponding sky HDR image, color correction and spherical environment mapping processing are performed to obtain a corresponding environment map; superimposing and eliminating the two environment maps to obtain a sky environment.

[0089] like Figure 2 As shown in (d), the image acquisition device is a SLR camera. In the on-site ocean environment, a mirror sphere is placed directly above the standard color plate, the standard color plate is placed vertically, and the camera is facing the mirror sphere and the standard color plate. The automatic bracketing exposure method is used to shoot multiple mirror sphere and standard color plate image sequences with different exposure amounts. Then, with the sphere as the origin, the camera and the standard color plate are rotated 180 degrees, and this step is repeated to obtain the second series of mirror sphere and standard color plate image sequences, that is, two sky image sequences are obtained. Of course, the central exposure parameters of the bracketing exposure can be determined by test shooting or preset, and the exposure amounts of multiple exposures form an arithmetic progression, that is, consistent with the central exposure parameters in the above-mentioned process of obtaining the first image sequence, the second image sequence, and the third image sequence.

[0090] In this way, in the process of processing the two sky image sequences, the two sky image sequences can also be synthesized into corresponding HDR images respectively. Then, after finding the standard color plate in the HDR image obtained by direct sunlight color measurement, the two HDR images are corrected to the color space based on the standard color plate by using the image color correction method, and finally, two corresponding color-corrected HDR sky calibration images I can be obtained. e1 and I e2 , that is, color correction is performed, and then the reflection direction corresponding to each pixel on the mirror sphere is calculated, and then two environment maps corresponding to the two HDR sky calibration images are obtained by reflection angle interpolation. The two environment maps are aligned and superimposed through image editing, and the mirror images of the camera and the photographer are removed from the final environment map to obtain an HDR sky environment map without the mirror images of the camera and the photographer. e .

[0091] In this way, the HDR sky environment map I e As input data, when reconstructing the measured ocean scene in the simulation system, the environment map I e The brightness of each pixel in the scene is multiplied by the scene brightness coefficient ρ to obtain the corresponding simulated sky color brightness value, and then the surface appearance of the sky in the simulated ocean environment is constructed.

[0092] It can be seen that in this embodiment, when constructing an ocean scene, attention is paid to the color of the water and the sky, that is, through image data acquisition, image data processing and scene rendering, the color reconstruction of the ocean surface and the sky in an ocean environment can be achieved. The rendered scene can accurately reflect the impact of direct sunlight, atmospheric scattering and seawater scattering on the color change of the ocean surface. At the same time, the color of the sky can also be accurately reproduced, which further improves the accuracy of the construction of the ocean scene, and is more conducive to research and application in marine science, engineering, meteorology, navigation, military and other aspects, and improves the practical value of the simulated ocean environment.

[0093] The operation flow is summarized into a specific embodiment below to illustrate the ocean scene construction process provided by the embodiment of the present invention.

[0094] In one embodiment of the present disclosure, the image acquisition device is a single-sided camera, and the standard color palette can be 24 color blocks, including a neutral white color block for white balance. Figure 2 , Figure 4 , used to determine the simulation input data in the process of ocean scene construction:

[0095] Step 401: In a live ocean environment, when sunlight vertically impinges on a standard color plate, a simulation device acquires direct images of the standard color plate corresponding to a plurality of fixed exposure amounts to form a first image sequence.

[0096] Step 402: In a live ocean environment, when the standard color plate faces away from the sunlight, the simulation device obtains atmospheric scattering images of the standard color plate corresponding to a plurality of fixed exposures to form a second image sequence.

[0097] Step 403: In the on-site marine environment, when the image acquisition device equipped with a polarizer is perpendicular to the standard color plate located near the sea surface, the simulation device obtains the standard color plate seawater scattering images corresponding to multiple fixed exposures to form a third image sequence.

[0098] Step 404: In the on-site ocean environment, when the standard color plate is located below the mirror sphere and placed perpendicular to the sea surface, and the image acquisition device is facing the first side of the standard color plate, the simulation device obtains direct images of the standard color plate at two angles corresponding to multiple fixed exposures to form two corresponding sky image sequences, where the two angles differ by 180°.

[0099] Among them, in step 401-step 404, the simulation device can obtain five image sequences through a SLR camera, and in each step, the center exposure parameter of the bracketing exposure of the single-lens reflex camera can be determined by test shooting or preset, and the exposure amounts of multiple exposures form an arithmetic progression.

[0100] Step 405: The simulation device synthesizes the five image sequences into corresponding high dynamic range HDR images respectively.

[0101] Step 406: The simulation device determines a standard color palette in the direct HDR image formed by the first image sequence, and performs color correction on each HDR image according to the standard color palette to obtain five corresponding HDR corrected images.

[0102] The five corresponding HDR correction images are respectively HDR correction image I for direct sunlight color measurement d ,HDR Corrected Image of Atmospheric Scattering Color Measurement I i, , HDR correction image I of seawater scattering color measurement v , and the HDR sky calibration image I e1 and I e2 .

[0103] Step 407: Simulate the HDR correction image I measured by the device from the atmospheric scattering color i In the process, determine the neutral white color plate, calculate the average RGB value of the color block, and obtain the atmospheric scattering RGB value C i .

[0104] Step 408: Simulate the HDR image I of the device under direct sunlight color measurement d Find the neutral white patch, calculate the average RGB value of the patch, and subtract C i , get the direct brightness RGB value C d .

[0105] Step 409: HDR correction image I of the simulated device in the seawater scattering color measurement v In the above example, a water surface is selected and the average RGB value of the water surface pixels is calculated to obtain the seawater scattering RGB value C v .

[0106] Step 410: Simulate the device to calibrate the HDR sky image I e1 and I e2 Perform spherical environment mapping, superposition and culling to obtain the sky environment map I e .

[0107] The simulation device can calculate the reflection direction corresponding to each pixel on the mirror sphere, and then obtain the reflection angle interpolation corresponding to the two HDR sky calibration images Ie1 and I e2 Then, the two environment maps are aligned and superimposed through image editing, and the mirror images of the camera and the photographer are removed from the final environment map to obtain an HDR sky environment map without the mirror images of the camera and the photographer. e .

[0108] Step 411: The simulation device records the date and time of field data collection.

[0109] In this way, only relatively simple equipment such as SLR cameras, mirror spheres, standard color plates, etc. are needed to measure the direct solar radiation illumination, atmospheric scattered radiation illumination and seawater scattered brightness of real ocean scenes on site, and collect the high dynamic range environment map of the sky in the scene. After processing the measured and collected image data, three brightness data and environment map data can be obtained. They can be used as input data to reconstruct the measured ocean scene in the simulation system. That is, no expensive devices are needed, and no professional equipment usage knowledge is required to achieve the reconstruction of the ocean scene, which has better practical value.

[0110] Combination Figure 3 , Figure 5 ,The process of ocean scene construction includes:

[0111] Step 501: The simulation device constructs a simulated ocean environment, including a virtual light source (representing the sun) and a virtual camera, wherein the zenith angle and direction angle of the virtual light source (sun) are calculated by recording the date and time of field data collection.

[0112] Step 502: The simulation device obtains the position P and the normal direction unit vector N of each vertex on the ocean surface in each frame of the image under the illumination condition through a wave dynamic simulation algorithm.

[0113] Step 503: The simulation device determines the observation direction unit vector V from each vertex to the virtual camera, and the mirror reflection direction unit vector V' in the observation direction can be calculated from the normal direction unit vector N of the vertex and the observation direction unit vector V.

[0114] Step 504: The simulation device determines the reflectivity R(N, V) of the simulated seawater corresponding to each vertex.

[0115] Step 505: The simulation device obtains the simulation brightness value corresponding to each vertex according to formula (3).

[0116] C p =ρ·[R(N,V)·(Δ(L,V')·C d +C i )+C v ] (3)

[0117] Among them, C p is the simulated brightness value, ρ is the scene brightness coefficient, R(N,V) is the reflectivity determined by the Fresnel function, C d is the direct brightness RGB value, C i is the RGB value of atmospheric scattering brightness, C v is the RGB value of seawater scattering brightness, the screening function Δ(L,V'), which is 1 when L = V' and 0 in other cases.

[0118] Step 506: The simulation device performs calculations based on the brightness of each pixel in the sky environment map and the scene brightness coefficient to obtain a corresponding simulated sky color brightness value.

[0119] Step 507: The simulation device reconstructs the simulated ocean environment by using a tone mapping algorithm according to the simulated brightness value corresponding to each vertex and the simulated sky color brightness value.

[0120] It can be seen that in the present embodiment, under the on-site marine environment, through the image acquisition device, the standard color plate, and the mirror sphere, the image sequence of the standard color plate can be obtained, and the corresponding seawater color parameter value and the sky environment map can be obtained. In this way, when the marine scene is constructed according to the seawater color parameter value and the sky environment map, the color reconstruction of the ocean surface and the sky in an ocean environment can be realized. In addition, the drawn marine scene can accurately reflect the influence of direct sunlight, atmospheric scattering and seawater scattering on the color change of the ocean surface, and the color of the sky can also be accurately reproduced. This not only improves the authenticity and effectiveness of the scene simulation, but also is more conducive to the research and application of marine science, engineering, meteorology, navigation, military and other aspects, and improves the practical value of the simulated marine environment.

[0121] According to the above process for constructing an ocean scene, a device for constructing an ocean scene can be constructed.

[0122] Figure 6 Schematic diagram of a device for constructing an ocean scene provided by an embodiment of the present disclosure. Figure 6 As shown, the ocean scene construction device 600 includes: a collection and processing module 610 , a simulation determination module 620 and a simulation construction module 630 .

[0123] The acquisition and processing module 610 is configured to determine the seawater color parameter value of the on-site marine environment according to the image sequence of the standard color plate acquired in the on-site marine environment.

[0124] The simulation determination module 620 is configured to determine the vertex position information of each vertex on the ocean surface in each frame of the image in the simulated ocean environment, wherein the simulated light condition of the simulated ocean environment is determined according to the acquisition time of the image sequence.

[0125] The simulation construction module 630 is configured to construct the surface appearance of seawater in the simulated ocean environment according to the vertex position information and the seawater color parameter value.

[0126] In some embodiments, the acquisition processing module 610 includes:

[0127] The acquisition unit is configured to acquire a plurality of image sequences that respectively match the positional relationships between sunlight, the image acquisition device, and the standard color plate in a live ocean environment.

[0128] The image processing unit is configured to synthesize each image sequence into a corresponding high dynamic range HDR image, determine a standard color plate in the direct HDR image that matches the vertical position relationship between sunlight and the standard color plate, and perform color correction on each HDR image according to the standard color plate to obtain a corresponding HDR corrected image; and determine the brightness RGB value of each HDR corrected image.

[0129] In some embodiments, the collection and acquisition unit is specifically configured to acquire direct images of the standard color plate corresponding to multiple fixed exposures in a field marine environment when sunlight is vertically incident on the standard color plate to form a first image sequence; to acquire atmospheric scattering images of the standard color plate corresponding to multiple fixed exposures in a field marine environment when the standard color plate is facing away from the sunlight to form a second image sequence; and to acquire seawater scattering images of the standard color plate corresponding to multiple fixed exposures in a field marine environment when an image acquisition device equipped with a polarizer is perpendicular to the standard color plate located near the sea surface to form a third image sequence.

[0130] In some embodiments, the simulation construction module 630 includes:

[0131] The first determination unit is configured to determine the reflectivity of the simulated seawater corresponding to each vertex according to the simulated light conditions of the simulated ocean environment and the vertex position information.

[0132] The second determination unit is configured to obtain a simulation brightness value corresponding to each vertex according to the reflectivity, and the direct brightness RGB value, the atmospheric scattering RGB value, and the seawater scattering RGB value in the seawater color parameter value.

[0133] In some embodiments, the first determination unit is specifically configured to determine the incident direction vector L of the virtual light source toward the current vertex according to the simulated light conditions of the simulated ocean environment; determine the corresponding normal direction vector N and the observation direction unit vector V from the current vertex to the virtual camera according to the vertex position information of the current vertex; and determine the reflectivity matching the normal direction vector N and the observation direction unit vector V.

[0134] In some embodiments, the second determination unit is specifically configured to determine the mirror reflection direction unit vector V' from the current vertex to the viewing direction of the virtual camera; when the incident direction vector L is equal to the mirror reflection direction unit vector V', the simulation brightness value corresponding to the current vertex is determined according to formula (1); when the incident direction vector L is not equal to the mirror reflection direction unit vector V', the simulation brightness value corresponding to the current vertex is determined according to formula (2); wherein,

[0135] C p =ρ·[R(N,V)·(C d +C i )+C v ] (1)

[0136] C p =ρ·[R(N,V)·C i +C v ] (2)

[0137] C p is the simulated brightness value, ρ is the scene brightness coefficient, R(N,V) is the reflectivity determined by the Fresnel function, C d is the direct brightness RGB value, C i is the RGB value of atmospheric scattering brightness, C v It is the RGB value of seawater scattering brightness.

[0138] In some embodiments, the acquisition and processing module 610 is further configured to obtain a sky environment map based on a sequence of images of a standard color plate located below the mirror sphere acquired in a live ocean environment.

[0139] The simulation construction module 620 is further configured to construct the surface appearance of the sky in the simulated ocean environment according to the brightness of each pixel in the sky environment map and the scene brightness coefficient.

[0140] In some embodiments, the collection and acquisition unit is further specifically configured to acquire direct images of the standard color plate at two angles corresponding to multiple fixed exposures in a live ocean environment, when the standard color plate is located below the mirror sphere and placed perpendicular to the sea surface, and the image acquisition device is facing the first surface of the standard color plate, to form two corresponding sky image sequences, wherein the two angles differ by 180°.

[0141] The image processing unit is also specifically configured to synthesize each sky image sequence into a corresponding sky HDR image, perform color correction and spherical environment mapping processing to obtain a corresponding environment map; and superimpose and eliminate two environment maps to obtain a sky environment map.

[0142] It can be seen that in this embodiment, the device for constructing the ocean scene can obtain an image sequence of a standard color plate, and obtain the corresponding seawater color parameter value and sky environment map. In this way, when constructing the ocean scene according to the seawater color parameter value and the sky environment map, the color reconstruction of the ocean surface and the sky in an ocean environment can be achieved. In addition, the drawn ocean scene can accurately reflect the influence of direct sunlight, atmospheric scattering and seawater scattering on the color change of the ocean surface, and the color of the sky can also be accurately reproduced. This not only improves the authenticity and effectiveness of the scene simulation, but also is more conducive to research and application in marine science, engineering, meteorology, navigation, military and other aspects, and improves the practical value of the simulated ocean environment.

[0143] Combination Figure 7 The embodiment of the present disclosure provides a device 700 for constructing an ocean scene, comprising:

[0144] The processor 1000 and the memory 1001 may also include a communication interface 1002 and a bus 1003. The processor 1000, the communication interface 1002, and the memory 1001 may communicate with each other through the bus 1003. The communication interface 1002 may be used for information transmission. The processor 1000 may call the logic instructions in the memory 1001 to execute the method for constructing an ocean scene in the above embodiment.

[0145] In addition, the logic instructions in the above-mentioned memory 1001 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0146] The memory 1001 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 1000 executes the functional application and data processing by running the program instructions / modules stored in the memory 1001, that is, the method for constructing an ocean scene in the above method embodiment is implemented.

[0147] The memory 1001 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 1001 may include a high-speed random access memory and may also include a non-volatile memory.

[0148] An embodiment of the present disclosure provides a device for constructing an ocean scene, comprising: a processor and a memory storing program instructions, wherein the processor is configured to execute a method for constructing an ocean scene when executing the program instructions.

[0149] Combination Figure 8 , the embodiment of the present disclosure provides a simulation device 800, including: a device body, and the above-mentioned device 600 (700) for constructing an ocean scene. The device 600 (700) for constructing an ocean scene is installed in the device body. The installation relationship described here is not limited to placement inside the product, but also includes installation connections with other components of the product, including but not limited to physical connections, electrical connections, or signal transmission connections. It can be understood by those skilled in the art that the device 600 (700) for constructing an ocean scene can be adapted to a feasible device body, thereby realizing other feasible embodiments.

[0150] An embodiment of the present disclosure provides a storage medium storing program instructions, which, when run, execute the above-mentioned method for constructing an ocean scene.

[0151] An embodiment of the present disclosure provides a computer program product, which includes a computer program stored on a storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned method for constructing an ocean scene.

[0152] The above-mentioned storage medium may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0153] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes, or a transient storage medium.

[0154] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, individual components and functions are optional, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims, and all available equivalents of the claims. When used in this application, although the terms "first", "second", etc. may be used in this application to describe each element, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without changing the meaning of the description, the first element can be called the second element, and similarly, the second element can be called the first element, as long as all occurrences of the "first element" are renamed consistently and all occurrences of the "second element" are renamed consistently. The first element and the second element are both elements, but may not be the same element. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates, the singular forms "a", "an" and "the" are intended to include the plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of one or more associated listings. In addition, when used in this application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups of these. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the presence of other identical elements in the process, method or device including the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0155] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0156] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0157] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for constructing an ocean scene, characterized in that: include: Determine the seawater color parameter values ​​of the on-site marine environment based on the image sequence of the standard color plate collected under the on-site marine environment; Determine vertex position information of each vertex on the ocean surface in each frame of the image in the simulated ocean environment, wherein the simulated light condition of the simulated ocean environment is determined according to the acquisition time of the image sequence; According to the vertex position information and the seawater color parameter values, the surface appearance of the seawater in the simulated ocean environment is constructed.

2. The method according to claim 1, characterized in that The seawater color parameter values ​​for determining the on-site marine environment include: Acquire multiple image sequences that match the positional relationships between sunlight, an image acquisition device, and a standard color plate in a live marine environment; After synthesizing each image sequence into a corresponding high dynamic range HDR image, determine the standard color plate in the direct HDR image that matches the vertical position relationship between sunlight and the standard color plate, and perform color correction on each HDR image according to the standard color plate to obtain a corresponding HDR corrected image; Determine the luminance RGB values ​​of each HDR corrected image.

3. The method according to claim 2, characterized in that The acquisition of multiple image sequences that match the positional relationships between sunlight, an image acquisition device, and a standard color plate in a live ocean environment includes: In the on-site marine environment, when sunlight vertically impinges on the standard color plate, direct images of the standard color plate corresponding to a plurality of fixed exposure amounts are acquired to form a first image sequence; In the on-site ocean environment, when the standard color plate is facing away from the sunlight, acquiring the standard color plate atmospheric scattering images corresponding to a plurality of fixed exposures to form a second image sequence; In the on-site marine environment, when the image acquisition device equipped with a polarizer is perpendicular to the standard color plate located near the sea surface, standard color plate seawater scattering images corresponding to multiple fixed exposures are obtained to form a third image sequence.

4. The method according to claim 1, characterized in that: The construction of the surface appearance of seawater in the simulated ocean environment comprises: According to the simulated light conditions of the simulated ocean environment and the vertex position information, the reflectivity of the simulated seawater corresponding to each vertex is determined; According to the reflectivity, as well as the direct brightness RGB value, the atmospheric scattering RGB value, and the seawater scattering RGB value in the seawater color parameter value, the simulated brightness value corresponding to each vertex is obtained.

5. The method according to claim 4, characterized in that Determining the reflectivity of the simulated seawater corresponding to each vertex includes: According to the simulated light conditions of the simulated ocean environment, determine the incident direction vector L of the virtual light source toward the current vertex; According to the vertex position information of the current vertex, determine the corresponding normal direction vector N and the observation direction unit vector V from the current vertex to the virtual camera; Determine the reflectivity that matches the normal direction vector N and the viewing direction unit vector V.

6. The method according to claim 5, characterized in that The obtaining of the simulated brightness value corresponding to each vertex comprises: Determine the unit vector V' of the mirror reflection direction from the current vertex to the viewing direction of the virtual camera; When the incident direction vector L is equal to the unit vector V' of the mirror reflection direction, the simulation brightness value corresponding to the current vertex is determined according to formula (1); When the incident direction vector L is not equal to the unit vector V' of the mirror reflection direction, the simulation brightness value corresponding to the current vertex is determined according to formula (2); wherein, C p =ρ·[R(N,V)·(C d +C i )+C v ] (1) C p =ρ·[R(N,V)·C i +C v ] (2) C p is the simulated brightness value, ρ is the scene brightness coefficient, R(N,V) is the reflectivity determined by the Fresnel function, C d is the direct brightness RGB value, C i is the RGB value of atmospheric scattering brightness, C v It is the RGB value of seawater scattering brightness.

7. The method according to any one of claims 1 to 6, characterized in that: Also includes: A sky environment map is obtained based on an image sequence of a standard color plate located below a mirror sphere collected in a field ocean environment; The surface appearance of the sky in the simulated ocean environment is constructed based on the brightness of each pixel in the sky environment map and the scene brightness coefficient.

8. The method according to claim 7, characterized in that The obtaining of the sky environment map comprises: In the on-site marine environment, when the standard color plate is located below the mirror sphere and placed vertically on the sea surface, and the image acquisition device is facing the first surface of the standard color plate, direct images of the standard color plate at two angles corresponding to a fixed plurality of exposures are obtained to form two corresponding sky image sequences, wherein the two angles differ by 180°; After synthesizing each sky image sequence into a corresponding sky HDR image, color correction and spherical environment mapping are performed to obtain the corresponding environment map, and the two environment maps are superimposed and culled to obtain a sky environment map.

9. A device for constructing an ocean scene, the device comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to perform the method for constructing an ocean scene according to any one of claims 1 to 8 when executing the program instructions.

10. A storage medium storing program instructions, characterized in that: When the program instructions are executed, the method for constructing an ocean scene as described in any one of claims 1 to 8 is executed.

Images