Decoding method and device suitable for space images

Abstract

The present application discloses a decoding method and device suitable for spatial images. A specific implementation of the method includes: determining the target longitude and latitude corresponding to the target spatial image desired by the user according to the acquired operation information; determining the position information of the target spatial image in the encoding file and the target image group to which the target spatial image belongs according to the target longitude and latitude; determining the target key frame corresponding to the target image group from the preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoding file; decoding the target spatial image according to the target key frame and the position information. The present application improves the efficiency of spatial decoding while ensuring the flexibility of the spatial decoding process.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, specifically to decoding technology, and more particularly to a decoding method, device, computer-readable medium, and electronic device applicable to spatial images. Background Art

[0002] Compared with the traditional video bitstream based on time sequence, the traditional video bitstream is continuous in time sequence, while the spatial bitstream is continuous in space. A basic requirement of the spatial bitstream is that it can be decoded by space during decoding, rather than by the storage order in the bitstream. This is the biggest difference from the time sequence bitstream. In order to facilitate storage and transmission, I frames (key frames) and P frames (predicted frames) are often used during encoding. In this way, the decoding of dependent frames causes several times the pressure of time sequence decoding, which greatly reduces the efficiency of spatial decoding. Summary of the invention

[0003] The embodiments of the present application provide a decoding method, device, computer-readable medium and electronic device suitable for spatial images.

[0004] In a first aspect, an embodiment of the present application provides a decoding method suitable for spatial images, comprising: determining the target longitude and latitude corresponding to the target spatial image expected by the user based on the acquired operation information; determining the position information of the target spatial image in the encoded file and the target image group to which the target spatial image belongs based on the target longitude and latitude; determining the target key frame corresponding to the target image group from a preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoded file; and decoding to obtain the target spatial image based on the target key frame and the position information.

[0005] In some examples, the above-mentioned determining the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs based on the target longitude and latitude, includes: determining the target picture group identifier of the target picture group to which the target spatial picture belongs and the target picture identifier of the target spatial picture based on the target longitude and latitude and the key frame longitude and latitude of the key frames in each picture group in the encoded file; determining the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs based on the target picture group identifier and the target picture identifier.

[0006] In some examples, the above-mentioned determination of the target picture group identifier of the target spatial picture to which the target spatial picture belongs and the target picture identifier of the target spatial picture according to the target longitude and latitude and the key frame longitude and latitude of the key frames in each picture group in the encoding file includes: taking the picture group to which the key frame corresponding to the key frame longitude and latitude closest to the target longitude and latitude among the key frame longitudes and latitudes of the key frames in each picture group in the encoding file belongs as the target picture group, and determining the target picture group identifier; determining the target picture identifier according to the offset between the target longitude and latitude and the key frame longitude and latitude corresponding to the key frame in the target picture group.

[0007] In some examples, determining the target key frame corresponding to the target picture group from the preloaded key frame sequence includes: determining the target key frame corresponding to the target picture group from the key frame sequence according to the target picture group identifier.

[0008] In some examples, before determining the target key frame corresponding to the target picture group from the preloaded key frame sequence, the method further includes: during the initialization process, loading the decoded key frame included in the encoding file to generate a key frame sequence.

[0009] In some examples, the above-mentioned decoding to obtain the target space picture according to the target key frame and position information includes: determining, according to the target picture identifier, whether the target space picture is a key frame in the target picture group, or a predicted frame in the target picture group; in response to determining that the target space picture is a predicted frame in the target picture group, decoding the predicted frame corresponding to the target picture identifier according to the target key frame and position information to obtain the target space picture.

[0010] In some examples, the above decoding to obtain the target space picture according to the target key frame and the position information further includes: in response to determining that the target space picture is a key frame in the target picture group, using the target key frame as the target space picture.

[0011] In the second aspect, an embodiment of the present application provides a decoding device suitable for spatial images, including: a first determination unit, configured to determine the target longitude and latitude corresponding to the target spatial picture expected by the user based on the acquired operation information; a second determination unit, configured to determine the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs based on the target longitude and latitude; a third determination unit, configured to determine the target key frame corresponding to the target picture group from a preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoded file; a decoding unit, configured to decode the target spatial picture based on the target key frame and the position information.

[0012] In some examples, the above-mentioned second determination unit is further configured to: determine the target picture group identifier of the target picture group to which the target spatial picture belongs and the target picture identifier of the target spatial picture based on the target longitude and latitude and the key frame longitude and latitude of the key frames in each picture group in the encoded file; determine the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs based on the target picture group identifier and the target picture identifier.

[0013] In some examples, the above-mentioned second determination unit is further configured to: take the picture group to which the key frame corresponding to the key frame longitude and latitude closest to the target longitude and latitude in the key frame in each picture group in the encoded file belongs as the target picture group, and determine the target picture group identifier; determine the target picture identifier based on the offset between the target longitude and latitude and the key frame longitude and latitude corresponding to the key frame in the target picture group.

[0014] In some examples, the third determining unit is further configured to: determine, according to the target picture group identifier, a target key frame corresponding to the target picture group from the key frame sequence.

[0015] In some examples, the apparatus further includes: a loading unit configured to: during an initialization process, load decoded key frames included in the encoding file to generate a key frame sequence.

[0016] In some examples, the above-mentioned decoding unit is further configured to: determine, based on the target picture identifier, whether the target spatial picture is a key frame in the target picture group, or a predicted frame in the target picture group; in response to determining that the target spatial picture is a predicted frame in the target picture group, decode the predicted frame corresponding to the target picture identifier according to the target key frame and position information to obtain the target spatial picture.

[0017] In some examples, the decoding unit is further configured to: in response to determining that the target spatial picture is a key frame in the target picture group, use the target key frame as the target spatial picture.

[0018] In a third aspect, an embodiment of the present application provides a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation manner of the first aspect is implemented.

[0019] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by one or more processors, the one or more processors implement the method described in any implementation manner of the first aspect.

[0020] The decoding method and device for spatial images provided in the embodiments of the present application determine the target longitude and latitude corresponding to the target spatial picture expected by the user according to the acquired operation information; determine the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs according to the target longitude and latitude; determine the target key frame corresponding to the target picture group from the preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoded file; and decode the target spatial picture according to the target key frame and the position information, thereby providing a decoding method for spatial pictures. During the decoding process, the target longitude and latitude corresponding to the target spatial picture expected by the user are mapped to the corresponding position in the encoded file to decode the data at the corresponding position, and all the key frames in the encoded file are preloaded as external reference frames of the predicted frames in the encoded file, thereby avoiding the time loss caused by repeated decoding of key frames during the decoding process, and improving the spatial decoding efficiency while ensuring the flexibility of the spatial decoding process. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0022] Figure 1 is an exemplary system architecture diagram in which an embodiment of the present application may be applied;

[0023] Figure 2 It is a schematic diagram of the spatial layout of the sampling points of the latitude and longitude sampling method of this application;

[0024] Figure 3 is a schematic diagram of the spatial picture matrix of the present application;

[0025] Figure 4 Schematic diagram of the reference method between the predicted frame and the key frame in the picture group of this application

[0026] Figure 5 is a flowchart of an embodiment of a decoding method applicable to a spatial image according to the present application;

[0027] Figure 6 is a schematic diagram of an operation trajectory of a user in a spatial picture matrix according to this embodiment;

[0028] Figures 7A-7C is a schematic diagram of various reference frame management methods according to this embodiment;

[0029] Figure 8 is a schematic diagram of an application scenario of a decoding method applicable to a spatial image according to this embodiment;

[0030] Fig. 9is a flowchart of another embodiment of a decoding method applicable to a spatial image according to the present application;

[0031] Fig.10 is a structural diagram of an embodiment of a decoding device applicable to spatial images according to the present application;

[0032] Fig.11 It is a schematic diagram of the structure of a computer system suitable for implementing the embodiments of the present application. DETAILED DESCRIPTION

[0033] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It should also be noted that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0034] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0035] It should be noted that the collection, collection, updating, analysis, processing, use, transmission, storage and other aspects of user personal information involved in the technical solution of this disclosure are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0036] Figure 1 An exemplary architecture 100 to which the decoding method and apparatus for spatial images of the present application can be applied is shown.

[0037] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The communication connection between the terminal devices 101, 102, 103 constitutes a topological network, and the network 104 is used to provide a medium for the communication link between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0038] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Terminal devices 101, 102, 103 can be hardware devices or software that support network connection for data interaction and data processing. When terminal devices 101, 102, 103 are hardware, they can be various electronic devices that support network connection, information acquisition, interaction, display, processing and other functions, including but not limited to smart phones, tablet computers, e-book readers, laptop portable computers and desktop computers, etc. When terminal devices 101, 102, 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules for providing distributed services, for example, or it can be implemented as a single software or software module. No specific limitation is made here.

[0039] The server 105 may be a server that provides various services, for example, it may be a background processing server that decodes and obtains the target space image desired by the user according to the operation information and preloaded key frames of the terminal devices 101, 102, 103. As an example, the server 105 may be a cloud server.

[0040] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0041] It should also be noted that the decoding method for spatial images provided in the embodiments of the present application can be executed by a server, or by a terminal device, or by a server and a terminal device in cooperation with each other. Accordingly, the various parts (such as various units) included in the decoding device for spatial images can be all set in the server, or all set in the terminal device, or can be set in the server and the terminal device respectively.

[0042] It should be understood that Figure 1 The number of terminal devices, networks, and servers in the system architecture is only illustrative. Any number of terminal devices, networks, and servers may be provided as required. When the electronic device on which the decoding method for spatial images is running does not need to perform data transmission with other electronic devices, the system architecture may only include the electronic device (e.g., server or terminal device) on which the decoding method for spatial images is running.

[0043] In order to fully illustrate the decoding method applicable to spatial images, a flow chart of an embodiment of the corresponding decoding method applicable to spatial images is given, which includes the following steps:

[0044] The first step is to generate a spatial picture matrix including a plurality of spatial pictures collected by the plurality of sampling points according to the longitudes and latitudes corresponding to the plurality of sampling points at different spatial angles.

[0045] The spatial images represent images of target objects obtained at different spatial angles. The target objects can be various objects such as people and objects.

[0046] As an example, a plurality of sampling points may be uniformly arranged at different spatial angles to capture spatial images of the target object at different spatial angles, that is, a uniform sampling method.

[0047] As another example, multiple sampling points can be non-uniformly arranged at different spatial angles around the target object at preset intervals of longitude and latitude to capture spatial images of the target object at different spatial angles, that is, longitude and latitude sampling.

[0048] like Figure 2 As shown, a schematic diagram 200 of the spatial layout of sampling points in a latitude and longitude sampling method is shown. For the upper hemisphere of the target object, sampling is performed at intervals of 10°, then there are 36 sampling points in the longitude direction and 9 sampling points in the latitude direction, and there are 324 (36×9) sampling points in the upper hemisphere of the target object. Among them, Figure 2 The left sub-image in is a top view of the spatial layout of the sampling points, and the right sub-image is a front view of the spatial layout of the sampling points.

[0049] The longitude and latitude corresponding to the sampling points at different spatial angles are different, so the spatial images at different spatial angles are sampled. The spatial image matrix can be obtained by arranging the spatial images at different spatial angles in a certain arrangement order. As an example, for each spatial image, the spatial image is named according to the longitude and latitude of the sampling point corresponding to the spatial image; then, according to the naming information of each spatial image, multiple spatial images are arranged to generate a spatial image matrix. For example, the longitude and latitude of the sampling point corresponding to the spatial image is (10 ° , 20 ° ), then the space picture can be named "10-20.jpg".

[0050] In some optional implementations of this embodiment, the above-mentioned execution entity can perform the above-mentioned first step in the following manner: arrange multiple spatial pictures with the longitude of the sampling point corresponding to the spatial picture as the horizontal axis and the latitude of the sampling point corresponding to the spatial picture as the vertical axis to generate a spatial picture matrix.

[0051] Specifically, with the longitude of the sampling point corresponding to the spatial image as the horizontal axis and the latitude of the sampling point corresponding to the spatial image as the vertical axis, multiple spatial images are arranged in the order of longitude from small to large and latitude from small to large to obtain a spatial image matrix.

[0052] Continue with the above Figure 2 Taking the sampling points shown in the figure as an example, the generated spatial image matrix is ​​as follows Figure 3 As shown. Among them, the latitude range in the spatial image matrix is ​​0 ° -80 ° , the range of longitude is 0 ° -350 ° .

[0053] In this implementation, based on the longitude and latitude of the sampling points, an arrangement method that is more in line with the spatial correlation between multiple spatial pictures is provided, so that the generated spatial picture matrix is ​​more conducive to spatial coding to improve spatial coding efficiency.

[0054] The second step is to divide the spatial picture matrix into sub-matrices of preset sizes to obtain multiple picture groups.

[0055] As an example, the preset size may be a preset fixed size, wherein the length and width of the submatrices may be the same or different, for example, the preset size is 3×3.

[0056] As another example, the preset size can be flexibly determined according to the density of the sampling points. When the sampling points are dense, a larger preset size can be set; when the sampling points are sparse, a smaller preset size can be set, that is, the size of the preset size is positively correlated with the density of the sampling points.

[0057] The spatial picture matrix is ​​divided into sub-matrices of a preset size, and the number of spatial pictures included in each obtained picture group is the same as the number of elements included in the sub-matrix. Figure 3 , the spatial picture matrix is ​​divided into sub-matrices with a preset size of 3×3, and a total of 36 picture groups GOP1-GOP36 are obtained, and each picture group includes 9 spatial pictures.

[0058] The third step is to encode the spatial pictures in the spatial picture matrix according to the key frames and the predicted frames respectively included in the plurality of picture groups, and generate an encoded file.

[0059] In the compression encoding process, each frame of the spatial picture represents a still image. When performing actual compression, various compression algorithms are used to reduce the data capacity, among which IPB frame is the most common one. The I frame in the IPB frame is also called the key frame or intra-frame coded frame. The key frame is usually the first frame of each picture group. After moderate compression, it is used as a reference point for random access to generate a static image. The key frame can be regarded as the product of an image after compression. Compression can remove redundant information of the video. The P frame is also called the prediction frame or forward prediction coding frame. For the compressed data corresponding to the prediction frame, the redundant information that is the same as the compressed data corresponding to the key frame in the same picture group is removed to obtain the coded data corresponding to the prediction frame. The prediction frame represents the difference between the prediction frame and the corresponding key frame. When decoding, it is necessary to refer to the corresponding key frame and the decoded data corresponding to the prediction frame to generate the spatial picture corresponding to the prediction frame.

[0060] In this embodiment, a determination method may be preset to determine key frames and prediction frames in a picture group; then, according to the key frames and prediction frames respectively included in a plurality of picture groups, the spatial pictures in the spatial picture matrix are encoded to generate an encoded file.

[0061] For example, for each picture group in multiple picture groups, the spatial picture corresponding to the sampling point with the smallest longitude and latitude in the picture group is used as the key frame, and the remaining spatial pictures in the picture group are used as prediction frames, and the spatial pictures in the spatial picture matrix are encoded to generate an encoded file.

[0062] In some optional implementations of this embodiment, the execution subject may perform the third step in the following manner:

[0063] (1) Arrange picture groups corresponding to sampling points at the same latitude in multiple picture groups in ascending order of the longitudes of the sampling points corresponding to the picture groups, and generate multiple picture group subsequences.

[0064] Continue to refer Figure 3 , the multiple picture group subsequences include a first picture group subsequence, a second picture group subsequence and a third picture group subsequence. The first picture group subsequence is "GOP1—>GOP2—>...—>GOP12", the second picture group subsequence is "GOP13—>GOP14—>...—>GOP24", and the third picture group subsequence is "GOP25—>GOP26—>...—>GOP36".

[0065] (2) Arrange multiple picture group subsequences in ascending order of latitudes of sampling points corresponding to the picture groups, determine picture group identifiers corresponding to each of the multiple picture groups, and generate a picture group sequence.

[0066] Continue to refer Figure 3, the picture group sequence is "GOP1—>GOP2—>GOP3...—>GOP35—>GOP36"

[0067] (3) Arrange the spatial pictures in each picture group in the picture group sequence in the order of key frame first and predicted frame later, determine the picture identifier of the spatial pictures in each picture group in the plurality of picture groups, and generate a spatial picture sequence.

[0068] Specifically, based on the determined picture group sequence, for the spatial pictures in each picture group, the picture sequence within the picture group is determined in the order of key frames first and predicted frames later, and thus the picture identifiers of the spatial pictures in each picture group are determined according to the picture sequence corresponding to the picture group, and finally the spatial picture sequence is obtained.

[0069] For the multiple prediction frames in each picture group, the arrangement order of the multiple prediction frames can be determined according to a preset determination method. For example, the multiple prediction frames are arranged in the order of latitude and longitude of the sampling points corresponding to the spatial pictures from small to large.

[0070] Continue to refer Figure 3 , the spatial picture sequence is "0—>1—>2—>3...—>322—>323". The spatial picture sequence includes multiple picture sequences such as "0—>1—>2—>3...—>8", "9—>10—>11...—>17". Taking the picture sequence "0—>1—>2—>3...—>8" as an example, "0" is the picture identifier of the key frame in the picture sequence, and "1-8" are the picture identifiers of the predicted frames in the picture sequence.

[0071] (4) Encode the spatial picture sequence according to the key frames and prediction frames included in each of the multiple picture groups to generate a coded file.

[0072] In this implementation, the spatial picture matrix is ​​first arranged to obtain a spatial picture sequence, and then encoding is performed according to the arrangement order of the spatial pictures in the spatial picture sequence, as well as the key frames and predicted frames in each picture group, thereby further improving the efficiency and accuracy of the encoding process.

[0073] In some optional implementations of the present embodiment, the execution subject may perform step (3) as follows: taking the spatial picture at the center position of the submatrix corresponding to the picture group as the key frame, taking the spatial picture adjacent to the key frame as the prediction frame, arranging the spatial pictures in each picture group in the picture group sequence in the order of key frame first and prediction frame later, determining the picture identifier of the spatial picture in each picture group in the multiple picture groups, and generating a spatial picture sequence.

[0074] Continue with Figure 3Taking the 3×3 submatrix shown in FIG. 1 as an example, for the 9 spatial pictures in the divided picture group, the 8 spatial pictures around the center position have a high correlation with the spatial picture at the center position, because the 8 surrounding spatial pictures can be regarded as the spatial picture at the center position through 10 in the longitude direction and / or latitude direction. ° obtained by the changes in .

[0075] The spatial picture at the center position of the submatrix corresponding to the picture group is used as the key frame, and the spatial picture adjacent to the key frame is used as the prediction frame, so that the prediction frame and the key frame have a direct and strong correlation, which helps the prediction frame to directly refer to the key frame during the encoding process of the spatial picture, improves the encoding efficiency, and reduces the data volume of the encoded file.

[0076] In some optional implementations of the present embodiment, the execution subject may perform step (4) as follows: for each picture group in a plurality of picture groups, the spatial picture sequence is encoded by using a reference method in which a predicted frame in the picture group uniquely refers to a key frame in the picture group to generate a coding file.

[0077] Continue to refer Figure 4 , a schematic diagram 400 is shown of a reference method between a prediction frame and a key frame in a picture group. For each prediction frame in a picture group, a key frame in the picture group is uniquely referenced to obtain a coded file.

[0078] In this implementation, the spatial picture sequence is encoded by adopting a reference method in which the predicted frame in the picture group uniquely references the key frame in the picture group, which reduces the complexity of the relationship between the predicted frame and the key frame in the encoded file and helps to improve the data determination speed and decoding efficiency during the decoding process.

[0079] In order to more fully illustrate the decoding method applicable to spatial images, a flow chart of another embodiment of the corresponding decoding method applicable to spatial images is provided, which includes the following steps:

[0080] In the first step, a plurality of spatial images are arranged with the longitude of the sampling point corresponding to the spatial image as the horizontal axis and the latitude of the sampling point corresponding to the spatial image as the vertical axis to generate a spatial image matrix.

[0081] The second step is to divide the spatial picture matrix into sub-matrices of preset sizes to obtain multiple picture groups.

[0082] In the third step, the picture groups corresponding to the sampling points at the same latitude in the multiple picture groups are arranged in ascending order according to the longitudes of the sampling points corresponding to the picture groups, so as to generate multiple picture group subsequences.

[0083] The fourth step is to arrange the multiple picture group subsequences in ascending order of the latitudes of the sampling points corresponding to the picture groups, determine the picture group identifiers corresponding to the multiple picture groups, and generate a picture group sequence.

[0084] The fifth step is to take the spatial picture at the center position of the submatrix corresponding to the picture group as the key frame, and the spatial picture adjacent to the key frame as the prediction frame, arrange the spatial pictures in each picture group in the picture group sequence in the order of key frame first and then prediction frame, determine the picture identifier of the spatial picture in each picture group in multiple picture groups, and generate a spatial picture sequence.

[0085] In the sixth step, for each picture group in the plurality of picture groups, a reference method in which a prediction frame in the picture group uniquely refers to a key frame in the picture group is adopted to encode the spatial picture sequence and generate an encoded file.

[0086] Continue to refer Figure 5 , a process 500 of an embodiment of a decoding method applicable to a spatial image is shown, comprising the following steps:

[0087] Step 501: Determine the target longitude and latitude corresponding to the target space image desired by the user according to the acquired operation information.

[0088] In this embodiment, the execution subject (eg Figure 1 The terminal device or server in the system determines the target longitude and latitude corresponding to the target space image desired by the user according to the obtained operation information.

[0089] The operation information may be an action instruction corresponding to the user's sliding operation or a voice instruction corresponding to the voice information. Figure 6 , showing the operation trajectory of the user in the spatial image matrix. Along the operation trajectory, the above-mentioned execution subject aims to decode the spatial image data of the corresponding position, obtain and display the target spatial image expected by the user.

[0090] As an example, the execution subject may pre-establish a correspondence between the user's operation position on the screen and the target longitude and latitude corresponding to the target space picture desired by the user, so as to determine the target longitude and latitude corresponding to the target space picture desired by the user in real time during the user's operation. The target longitude and latitude corresponding to the target space picture is the longitude and latitude corresponding to the sampling point corresponding to the target space picture.

[0091] Step 502: Determine the location information of the target spatial picture in the encoding file and the target picture group to which the target spatial picture belongs according to the target longitude and latitude.

[0092] In this embodiment, the execution subject may determine the position information of the target space picture in the encoding file and the target picture group to which the target space picture belongs according to the target longitude and latitude.

[0093] As an example, the above execution subject can pre-establish the corresponding relationship between the longitude and latitude corresponding to each spatial picture involved in the encoding file and the position information of the spatial picture in the encoding file. Thus, the position information of the target spatial picture in the encoding file is determined according to the target longitude and latitude; and according to the position information, the key frame in the target picture group to which the target spatial picture belongs and the key frame longitude and latitude of the key frame are determined, and then the picture group where the key frame is located is determined.

[0094] In some optional implementations of this embodiment, the execution subject may perform step 502 in the following manner:

[0095] First, according to the target longitude and latitude and the key frame longitude and latitude of the key frames in each picture group in the encoding file, the target picture group identifier of the target spatial picture and the target picture identifier of the target spatial picture are determined.

[0096] As an example, the above-mentioned execution entity can determine the key frame longitudes and latitudes of the key frames in each picture group in the encoded file to generate a key frame longitude and longitude set; then, compare the target longitude and latitude with the key frame longitude and longitude in the key frame longitude and longitude set, and determine the target picture group to which the target space picture belongs based on the comparison result between the target longitude and longitude and the longitude and longitude of each key frame in the key frame longitude and longitude set; then, determine the target picture group identifier of the target picture group and the target picture identifier of the target space picture.

[0097] Continue to refer Figure 3 , and its corresponding key frame longitude and latitude set is

[0098]

[0099] Second, according to the target picture group identifier and the target picture identifier, the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs are determined.

[0100] In the process of encoding to obtain the encoded file, the spatial picture identifier of the spatial picture and the picture group identifier of the picture group to which the spatial picture belongs are generally encoded. After determining the target picture group identifier and the target picture identifier, the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs can be determined.

[0101] In this implementation, a specific implementation method for determining the position information of a target space picture in a coded file and the target picture group to which the target space picture belongs is provided, thereby improving the determination efficiency and accuracy of the information determination process.

[0102] In some optional implementations of the present embodiment, the execution subject may perform the first step as follows: first, the picture group to which the key frame corresponding to the key frame longitude and latitude closest to the target longitude and latitude in the key frame of each picture group in the encoded file belongs is taken as the target picture group, and the target picture group identifier is determined; then, the target picture identifier is determined based on the offset between the target longitude and latitude and the key frame longitude and latitude corresponding to the key frame in the target picture group.

[0103] As an example, the target longitude and latitude is (60, 20), which is the closest to the key frame longitude and latitude (70, 10) in the key frame longitude and latitude set. Then the picture group GOP3 to which the key frame corresponding to the key frame longitude and latitude (70, 10) belongs is taken as the target picture group, and the target picture group identifier is determined to be 3.

[0104] Specifically, the process of determining the target picture group identifier can be expressed by the following formula:

[0105] GOPid=minl2_arg((longitude,latitude)-GOPs)

[0106] Among them, GOPid represents the target picture group identifier, minl2_arg represents the minimum distance requirement, (longitude, latitude) represents the target longitude and latitude, and GOPs represents the key frame longitude and latitude of the key frames in each picture group.

[0107] Then, the offset between the target longitude and latitude and the key frame longitude and latitude corresponding to the key frame in the target picture group is determined to be (-10, 10), and the target picture identifier is determined to be 8.

[0108] Continue with Figure 3 Taking the 3×3 submatrix shown in as an example, the offset between the longitude and latitude corresponding to the spatial picture in each picture group and the longitude and latitude of the key frame corresponding to the key frame is:

[0109]

[0110] According to the arrangement order of the spatial pictures in the picture sequence corresponding to the picture group during the encoding process, the above offset set is reordered to obtain the sorted offset sequence:

[0111] OFFSETs=

[0112] {(0,0),(-10,0),(-10,-10),(0,-10),(10,-10),(10,0),(10,10),(0,10),(-10,10)}

[0113] According to the offset sequence, the target image identifier corresponding to the target space image can be determined.

[0114] Specifically, the process of determining the target image identifier can be expressed by the following formula:

[0115] OFFSETid=

[0116] minl2_arg(((longtitude,latitude)-GOPs[GOPid])-OFFSETs)

[0117] Among them, OFFSETid represents the target image identifier, minl2_arg represents the minimum distance requirement, (longtitude, latitude) represents the target longitude and latitude, GOPs[GOPid] represents the key frame longitude and latitude of the key frame corresponding to the target picture group identifier GOPid, and OFFSETs represents the offset between the longitude and latitude corresponding to the spatial image in the picture group and the key frame longitude and latitude corresponding to the key frame.

[0118] In this implementation, the target picture group identifier of the target picture group is determined based on the comparison results of the key frame longitude and latitude of each key frame involved in the encoding file with the target longitude and latitude of the target spatial picture expected by the user, and then the target picture identifier is determined, thereby improving the versatility and accuracy of the identification information determination process.

[0119] Step 503: determine the target key frame corresponding to the target picture group from the preloaded key frame sequence.

[0120] In this embodiment, the execution subject may determine the target key frame corresponding to the target picture group from the preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoding file.

[0121] As an example, for a preloaded key frame sequence, the correspondence between each key frame in the key frame sequence and the picture group to which it belongs is determined during the loading process. Then, after determining the target picture group, the target key frame corresponding to the target picture group is determined from the key frame sequence according to the correspondence.

[0122] In some optional implementations of this embodiment, the execution subject may perform step 503 in the following manner: determining a target key frame corresponding to the target picture group from a key frame sequence according to the target picture group identifier.

[0123] As an example, for a preloaded key frame sequence, a corresponding relationship between each key frame in the key frame sequence and a picture group identifier of the picture group to which it belongs is determined during the loading process. Then, a target picture group identifier is matched with a picture group identifier in the corresponding relationship, so that a key frame corresponding to a picture group identifier matching the target picture group identifier is determined as a target key frame.

[0124] In this implementation, based on the target picture group identifier, the target key frame corresponding to the target picture group can be quickly determined from the key frame sequence, thereby improving the efficiency of determining the target key frame.

[0125] In some optional implementations of this embodiment, before the above step 503, the above execution subject may also perform the following operations: during the initialization process, load the decoded key frames included in the encoding file to generate a key frame sequence.

[0126] As an example, during the initialization process of the decoding logic for the encoded file, the position information of the key frames in each picture group is determined from the encoded file; all the key frames are decoded according to the position information, and the obtained key frames are cached to generate a key frame sequence.

[0127] In this implementation, key frames included in the encoded file are decoded and preloaded during the initialization process, so that key frames referenced by the data to be decoded are directly determined from the key frame sequence during the subsequent decoding process, which helps to improve decoding efficiency.

[0128] Step 504: Decode and obtain the target space picture according to the target key frame and position information.

[0129] In this embodiment, the above-mentioned execution subject can decode and obtain the target space picture according to the target key frame and position information.

[0130] After determining the location information of the target data to be decoded, the target key frame can be referenced to decode the encoded data at the corresponding position in the encoded file to obtain and display the target space image.

[0131] In some optional implementations of this embodiment, the execution subject may perform step 504 in the following manner:

[0132] First, according to the target picture identifier, it is determined whether the target spatial picture is a key frame in the target picture group or a predicted frame in the target picture group.

[0133] As an example, when it is determined that the target picture identifier is the same as the key frame identifier of the key frame in the target picture group, it is determined that the target spatial picture is the key frame in the target picture group; when it is determined that the target picture identifier is the same as the predicted frame identifier of the predicted frame in the target picture group, it is determined that the target spatial picture is the predicted frame in the target picture group.

[0134] Second, in response to determining that the target spatial picture is a predicted frame in the target picture group, the predicted frame corresponding to the target picture identifier is decoded according to the target key frame and the position information to obtain the target spatial picture.

[0135] When the target spatial picture is a predicted frame in the target picture group, since the predicted frame refers to the key frame in the picture group, it is necessary to refer to the target key frame and decode the predicted frame at the position represented by the position information to obtain the target spatial picture.

[0136] In some optional implementations of this embodiment, the execution subject may also perform step 504 in the following manner: in response to determining that the target space picture is a key frame in the target picture group, using the target key frame as the target space picture.

[0137] When the target spatial picture is a key frame in the target picture group, the decoded target key frame in the key frame sequence is directly used as the target spatial picture without performing the decoding process again.

[0138] Considering the spatial decoding process, B frames are not used in the encoding stage, so B frames are generally not included in the encoded file. However, if only I frames are used in the encoding stage, the compression efficiency is too low, which is not conducive to storage and transmission. Therefore, I frames and P frames are often used in encoded files.

[0139] Not only the frame type affects the decoding efficiency, but also the reference frame management method has a significant impact on the decoding efficiency. Take the following three reference frame management methods as examples: Fig. 7A This is the most common management method, that is, the P frame refers to the previous I frame or P frame in the picture group. At this time, to decode a P frame, you need to first decode all the I frames and P frames that the P frame depends on. Then, Fig. 7A The number of decoded frames for each display frame in the picture group is {1,2,3,4,5,6,7,8,9}, and on average 45 / 9=5 frames need to be decoded to display one frame.

[0140] Figure 7B In the , although each P frame in the picture group has only one reference frame, its reference frame also depends on other frames, so the later the reference frame, the more it actually depends on. Figure 7B , the number of frames that need to be decoded to display each frame is {1,2,3,4,5,6,7,8,9}, and on average 45 / 9=5 frames need to be decoded to display one frame.

[0141] for Figure 7C , all predicted frames in the picture group only refer to I frames, so the number of frames that need to be decoded to display each frame is {1,2,2,2,2,2,2,2,2}, and on average 17 / 9=1.889 frames need to be decoded to display one frame.

[0142] In the above embodiment, since the key frames in the picture group are pre-loaded, the number of frames required to be decoded to display each frame is {0, 1, 1, 1, 1, 1, 1, 1}. Therefore, on average, 8 / 9 = 0.889 frames need to be decoded to display one frame. It can be seen that the decoding efficiency in the above embodiment is much higher than other reference methods.

[0143] Continue to see Figure 8 , Figure 8 FIG. 8 is a schematic diagram 800 of an application scenario of the decoding method for spatial images according to this embodiment. Figure 8 In the application scenario, the server pre-acquires the encoding file obtained by encoding the spatial images of the object to be displayed at different spatial angles. In the process of the user displaying the object to be displayed, first, according to the obtained user operation information, the target longitude and latitude 801 corresponding to the target spatial image expected by the user is determined, wherein the determined target longitude and latitude 801 is (60, 20); then, according to the target longitude and latitude 801, the position information of the target spatial image in the encoding file and the target image group to which the target spatial image belongs are determined; then, the target key frame corresponding to the target image group is determined from the pre-loaded key frame sequence 802, wherein the key frame sequence includes the key frames involved in the encoding file; finally, according to the target key frame and the position information, the target spatial image is decoded.

[0144] The method provided by the above-mentioned embodiments of the present application determines the target longitude and latitude corresponding to the target spatial picture expected by the user according to the acquired operation information; determines the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs according to the target longitude and latitude; determines the target key frame corresponding to the target picture group from the preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoded file; and decodes the target spatial picture according to the target key frame and the position information, thereby providing a decoding method suitable for spatial pictures. During the decoding process, the target longitude and latitude corresponding to the target spatial picture expected by the user are mapped to the corresponding position in the encoded file to decode the data at the corresponding position, and all the key frames in the encoded file are preloaded as external reference frames of the predicted frames in the encoded file, thereby avoiding the time loss caused by repeated decoding of key frames during the decoding process, and improving the spatial decoding efficiency while ensuring the flexibility of the spatial decoding process.

[0145] Continue to refer Fig. 9 , shows a schematic process 900 of another embodiment of a decoding method applicable to a spatial image according to the present application, comprising the following steps:

[0146] Step 901 , during the initialization process, the decoded key frames included in the encoding file are loaded to generate a key frame sequence.

[0147] Step 902: Determine the target longitude and latitude corresponding to the target space image desired by the user according to the acquired operation information.

[0148] Step 903: The picture group to which the key frame corresponding to the key frame longitude and latitude closest to the target longitude and latitude in the key frames in each picture group in the encoded file belongs is taken as the target picture group, and the target picture group identifier is determined.

[0149] Step 904: Determine the target picture identifier according to the offset between the target longitude and latitude and the key frame longitude and latitude corresponding to the key frame in the target picture group.

[0150] Step 905 : Determine the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs according to the target picture group identifier and the target picture identifier.

[0151] Step 906: Determine the target key frame corresponding to the target picture group from the key frame sequence according to the target picture group identifier.

[0152] Step 907: Determine, according to the target picture identifier, whether the target spatial picture is a key frame in the target picture group or a predicted frame in the target picture group.

[0153] Step 908 , in response to determining that the target spatial picture is a predicted frame in the target picture group, the predicted frame corresponding to the target picture identifier is decoded according to the target key frame and the position information to obtain the target spatial picture.

[0154] Step 909 : In response to determining that the target space picture is a key frame in the target picture group, taking the target key frame as the target space picture.

[0155] It can be seen from this embodiment that Figure 6 Compared with the corresponding embodiments, process 900 of the decoding method applicable to spatial images in this embodiment specifically illustrates the preloading process of the key frame sequence, the position information of the target spatial picture in the encoded file and the information determination process of the target picture group to which the target spatial picture belongs, and the decoding process based on the key frame sequence, which further improves the spatial decoding efficiency while ensuring the flexibility of the spatial decoding process.

[0156] Continue to refer Fig.10 As an implementation of the methods shown in the above figures, the present application provides an embodiment of a decoding device suitable for spatial images. Figure 6 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0157] like Fig.10As shown, a decoding device suitable for spatial images includes: a first determination unit 1001, configured to determine the target longitude and latitude corresponding to the target spatial image desired by the user according to the acquired operation information; a second determination unit 1002, configured to determine the position information of the target spatial image in the encoded file and the target image group to which the target spatial image belongs according to the target longitude and latitude; a third determination unit 1003, configured to determine the target key frame corresponding to the target image group from a preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoded file; a decoding unit 1004, configured to decode and obtain the target spatial image according to the target key frame and the position information.

[0158] In some examples, the second determination unit 1002 is further configured to: determine the target picture group identifier of the target picture group to which the target spatial picture belongs and the target picture identifier of the target spatial picture based on the target longitude and latitude and the key frame longitude and latitude of the key frames in each picture group in the encoded file; determine the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs based on the target picture group identifier and the target picture identifier.

[0159] In some examples, the second determination unit 1002 is further configured to: determine the target picture group identifier by taking the key frame longitude and latitude of the key frames in each picture group in the encoded file, the picture group to which the key frame corresponding to the key frame longitude and latitude closest to the target longitude and latitude belongs as the target picture group; determine the target picture identifier according to the offset between the target longitude and latitude and the key frame longitude and latitude corresponding to the key frame in the target picture group.

[0160] In some examples, the third determining unit 1003 is further configured to: determine, according to the target picture group identifier, a target key frame corresponding to the target picture group from the key frame sequence.

[0161] In some examples, the apparatus further includes: a loading unit (not shown in the figure), configured to: during the initialization process, load the decoded key frames included in the encoding file to generate a key frame sequence.

[0162] In some examples, the above-mentioned decoding unit 1004 is further configured to: determine, based on the target picture identifier, whether the target spatial picture is a key frame in the target picture group, or a predicted frame in the target picture group; in response to determining that the target spatial picture is a predicted frame in the target picture group, decode the predicted frame corresponding to the target picture identifier according to the target key frame and position information to obtain the target spatial picture.

[0163] In some examples, the decoding unit 1004 is further configured to: in response to determining that the target spatial picture is a key frame in the target picture group, use the target key frame as the target spatial picture.

[0164] In this embodiment, a first determination unit in a decoding device suitable for spatial images determines the target longitude and latitude corresponding to the target spatial picture expected by the user based on the acquired operation information; a second determination unit determines the position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs based on the target longitude and latitude; a third determination unit determines the target key frame corresponding to the target picture group from a preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoded file; a decoding unit decodes the target spatial picture based on the target key frame and the position information, thereby providing a decoding device suitable for spatial pictures. During the decoding process, the target longitude and latitude corresponding to the target spatial picture expected by the user are mapped to the corresponding position in the encoded file to decode the data at the corresponding position, and all the key frames in the encoded file are preloaded as external reference frames of the predicted frames in the encoded file, thereby avoiding time loss caused by repeated decoding of key frames during the decoding process, and improving the spatial decoding efficiency while ensuring the flexibility of the spatial decoding process.

[0165] Reference below Fig.11 , which shows a device suitable for implementing the embodiments of the present application (eg Figure 1 A schematic diagram of the structure of a computer system 1100 of the devices 101, 102, 103, 105 shown. Fig.11 The device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0166] like Fig.11 As shown, the computer system 1100 includes a processor (e.g., CPU, central processing unit) 1101, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage part 1108 to a random access memory (RAM) 1103. Various programs and data required for the operation of the system 1100 are also stored in the RAM 1103. The processor 1101, ROM 1102, and RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0167] The following components are connected to the I / O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1108 including a hard disk, etc.; and a communication section 1109 including a network interface card such as a LAN card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the I / O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed, so that a computer program read therefrom is installed into the storage section 1108 as needed.

[0168] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication part 1109, and / or installed from a removable medium 1111. When the computer program is executed by the processor 1101, the above-mentioned functions defined in the method of the present application are executed.

[0169] It should be noted that the computer-readable medium of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0170] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the client computer, partially on the client computer, as a separate software package, partially on the client computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the client computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0171] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the device, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0172] The units involved in the embodiments described in the present application may be implemented by software or by hardware. The described units may also be provided in a processor, for example, may be described as: a processor comprising a first determination unit, a second determination unit, a third determination unit and a decoding unit. Among them, the names of these units do not constitute a limitation on the units themselves in certain circumstances, for example, the third determination unit may also be described as "a unit for determining a target key frame corresponding to a target picture group from a preloaded key frame sequence".

[0173] As another aspect, the present application also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the device, the computer device: determines the target longitude and latitude corresponding to the target space picture expected by the user according to the acquired operation information; determines the position information of the target space picture in the encoded file and the target picture group to which the target space picture belongs according to the target longitude and latitude; determines the target key frame corresponding to the target picture group from the preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoded file; and decodes the target space picture according to the target key frame and the position information.

[0174] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.

Claims

1. A decoding method for a space image, comprising: Determine the target longitude and latitude corresponding to the target space image desired by the user according to the acquired operation information; According to the target longitude and latitude, determine the position information of the target spatial image in the encoding file and the target image group to which the target spatial image belongs, wherein the encoding file is obtained based on spatial encoding of a spatial image matrix, the spatial image matrix uses the longitude of the sampling point corresponding to the spatial image as the horizontal axis coordinate, and the latitude of the sampling point corresponding to the spatial image as the vertical axis coordinate, and arranges multiple spatial images in the order of longitude from small to large and latitude from small to large to generate, the sampling points are set around the target object represented by the spatial image, the image group is obtained based on dividing the spatial image matrix into sub-matrices, the size corresponding to the image group is positively correlated with the density of the sampling points, and the density of the sampling points is positively correlated with the latitude of the sampling points; Determining a target key frame corresponding to the target picture group from a preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoding file; The target space picture is obtained by decoding according to the target key frame and the position information.

2. The method according to claim 1, wherein: The step of determining, according to the target longitude and latitude, the position information of the target space picture in the encoded file and the target picture group to which the target space picture belongs includes: Determine a target picture group identifier of a target picture group to which the target spatial picture belongs and a target picture identifier of the target spatial picture according to the target longitude and latitude and key frame longitude and latitude of key frames in each picture group in the encoded file; According to the target picture group identifier and the target picture identifier, position information of the target spatial picture in the encoded file and the target picture group to which the target spatial picture belongs are determined.

3. The method according to claim 2, wherein: The step of determining the target picture group identifier of the target picture group to which the target spatial picture belongs and the target picture identifier of the target spatial picture according to the target longitude and latitude and the key frame longitude and latitude of the key frames in each picture group in the encoded file comprises: The target picture group is determined by taking the picture group to which the key frame corresponding to the key frame longitude and latitude closest to the target longitude and latitude in the key frame in each picture group in the encoded file belongs as the target picture group, and determining the target picture group identifier; The target picture identifier is determined according to an offset between the target longitude and latitude and a key frame longitude and latitude corresponding to a key frame in the target picture group.

4. The method according to claim 2 or 3, wherein: The step of determining the target key frame corresponding to the target picture group from the preloaded key frame sequence includes: According to the target picture group identifier, a target key frame corresponding to the target picture group is determined from the key frame sequence.

5. The method according to claim 1, wherein: Before determining the target key frame corresponding to the target picture group from the preloaded key frame sequence, the method further includes: During the initialization process, the decoded key frames included in the encoding file are loaded to generate the key frame sequence.

6. The method according to claim 1, wherein: The decoding to obtain the target space picture according to the target key frame and the position information includes: Determining, according to the target picture identifier, whether the target spatial picture is a key frame in the target picture group or a predicted frame in the target picture group; In response to determining that the target spatial picture is a predicted frame in the target picture group, the predicted frame corresponding to the target picture identifier is decoded according to the target key frame and the position information to obtain the target spatial picture.

7. The method according to claim 6, wherein: The decoding to obtain the target space picture according to the target key frame and the position information further includes: In response to determining that the target spatial picture is a key frame in the target picture group, the target key frame is used as the target spatial picture.

8. A decoding device for spatial images, comprising: A first determining unit is configured to determine the target longitude and latitude corresponding to the target space picture desired by the user according to the acquired operation information; A second determination unit is configured to determine, according to the target longitude and latitude, the position information of the target spatial image in the encoding file and the target image group to which the target spatial image belongs, wherein the encoding file is obtained based on spatial encoding of a spatial image matrix, the spatial image matrix uses the longitude of the sampling point corresponding to the spatial image as the horizontal axis coordinate, and the latitude of the sampling point corresponding to the spatial image as the vertical axis coordinate, and arranges multiple spatial images in the order of longitude from small to large and latitude from small to large to generate, the sampling points are set around the target object represented by the spatial image, the image group is obtained based on dividing the spatial image matrix into sub-matrices, the size corresponding to the image group is positively correlated with the density of the sampling points, and the density of the sampling points is positively correlated with the latitude of the sampling points; A third determining unit is configured to determine a target key frame corresponding to the target picture group from a preloaded key frame sequence, wherein the key frame sequence includes the key frames involved in the encoding file; The decoding unit is configured to decode and obtain the target space picture according to the target key frame and the position information.

9. A computer readable medium having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

Images