Multimedia transmission method and related equipment

Abstract

The invention discloses a multimedia transmission method and related equipment, which can realize multimedia transmission through satellites in an area which cannot be covered by a ground mobile communication network. For example, when a first device is in a network-free state, a first operation is received for triggering transmission of multimedia to a second device. The first device sends N multimedia data streams to the satellite, the N multimedia data streams are data streams obtained by compressing multimedia, N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, and the first threshold is smaller than or equal to the transmission bandwidth of the satellite; the total data volume of the N multimedia data streams does not exceed a second threshold.

Description

Technical Field

[0001] This application relates to the technical field of terminals, and in particular, to a multimedia transmission method and related devices. Background Art

[0002] The terrestrial mobile communication network provides convenient services for people's lives. However, in areas such as the ocean, forest, or desert, due to the difficulty of deploying terrestrial base stations, the coverage of the terrestrial mobile communication network is affected. Therefore, for groups such as ocean workers and wilderness explorers, once in danger, they will not be able to send a distress signal to the outside world because there is no network (because the terrestrial mobile communication network cannot cover), resulting in missing the rescue time. Summary of the Invention

[0003] Embodiments of this application provide a multimedia transmission method and related devices, which can realize the transmission of multimedia in areas where the terrestrial mobile communication network cannot cover.

[0004] In a first aspect, a multimedia transmission method is provided, which is applicable to a first device. For example, the first device may be a terminal device such as a mobile phone or a PC. The method includes: the first device is in a network - free state. The first device receives a first operation, and the first operation is used to trigger the transmission of multimedia to a second device. The first device sends N multimedia data streams to a satellite, where the N multimedia data streams are data streams obtained by compressing the multimedia. N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold.

[0005] In embodiments of this application, when the first device is in a network - free state, it can send multimedia, such as images, to other devices through a satellite. Moreover, the first device can compress the multimedia to obtain N multimedia data streams, and the data volume of each multimedia data stream does not exceed the transmission bandwidth of the satellite to ensure that each multimedia data stream can be sent successfully as much as possible. Moreover, embodiments of this application consider that if the number of multimedia data streams is too large (i.e., N is too large), it will take a long time to send the N multimedia data streams. To avoid too long a sending time, in embodiments of this application, the total data volume of the N multimedia data streams does not exceed a second threshold, so the number of N will not be too large, and the sending duration will not be too long, avoiding affecting the user experience.

[0006] In a possible design, the first multimedia data stream in the N multimedia data streams is sent carried in a first message. The first multimedia data stream is one or more data streams in the N multimedia data streams, and the first message further includes at least one of the following:

[0007] The first indication information is used to indicate the type of the multimedia;

[0008] The second indication information is used to indicate the size of the multimedia;

[0009] The third indication information is used to indicate the identifier of the first device;

[0010] The fourth indication information is used to indicate the identifier of the second device.

[0011] In the embodiments of the present application, the first message can indicate the multimedia type, size, etc. Therefore, the receiving end can know the received multimedia type, size, etc. through the first message, so as to improve the accuracy of decompressing the multimedia data stream at the receiving end to obtain the multimedia.

[0012] In a possible design, the first multimedia data stream may include: any one or more of the N multimedia data streams, or the first multimedia data stream sent among the N multimedia data streams, or the last multimedia data stream sent among the N multimedia data streams, or the multimedia data stream with the smallest data volume among the N multimedia data streams.

[0013] In a possible design, the multimedia includes a first image, and the N multimedia data streams respectively correspond to N feature information on the first image, and the sending order of the N multimedia data streams is determined according to the priority relationship of the N feature information.

[0014] In the embodiments of the present application, when the first device sends an image to the second device via satellite, it can preferentially send the multimedia data stream corresponding to the feature information 1 on the image, and then send the multimedia data stream corresponding to the feature information 2. The priority of the feature information 1 is higher than that of the feature information 2. In this way, the peer end first obtains the feature information 1 and can restore the content corresponding to the feature information 1 (such as the edge contour of the object on the image), and then receives the feature information 2 and restores the content corresponding to the feature information 2 (such as the details of the object on the image), realizing the gradual transmission of the image from blurred to clear.

[0015] In a possible design, the N multimedia data streams include a second multimedia data stream and a third multimedia data stream. When the following conditions are met, the sending time of the second multimedia data stream is earlier than that of the third multimedia data stream. The conditions include: the feature information corresponding to the second multimedia data stream is used to describe the edge contour of the object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of the object in the first image; or, the feature information corresponding to the second multimedia data stream is used to describe the first object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the second object in the first image, and the priority of the first object is higher than that of the second object.

[0016] In an embodiment of the present application, since the second multimedia data stream is preferentially sent, after the peer receives the second multimedia data stream, it can restore the approximate outline of the object in the image according to its characteristic information. In this way, even if the third multimedia data stream fails to be sent, the peer can still know the approximate content of the image. Of course, if the third multimedia data stream is successfully sent, the peer can add details to the image according to its characteristic information to improve the clarity of the image. Or, since the second multimedia data stream is preferentially sent, after the peer receives the second multimedia data stream, it can restore the first object in the image according to its characteristic information. In this way, even if the third multimedia data stream fails to be sent, the peer can still know that the image includes the first object. Of course, if the third multimedia data stream is successfully sent, the peer can restore the second object according to its characteristic information to improve the integrity of the image.

[0017] In a possible design, the second multimedia data stream or the third multimedia data stream may be the first multimedia data stream.

[0018] In a possible design, the multimedia is the first image, and the N multimedia data streams are data streams obtained by compressing different regions on the first image with different compression ratios, so that the second image is obtained after the N multimedia data streams are decompressed, and the clarity of different regions on the second image is different.

[0019] It should be noted that if the image is large, a larger compression ratio needs to be used to compress the image to ensure that the image can be successfully sent. For example, the total data volume of the compressed multimedia data stream does not exceed the second threshold. It should be understood that once the compression ratio is large, the clarity of the image will be very low, affecting the viewing of the receiving end. In an embodiment of the present application, under the condition that the total data volume of the compressed multimedia data stream does not exceed the second threshold, differential compression can be performed on different regions of the image. For example, some regions have a small compression ratio to ensure the clarity of these regions, and the compression ratio of other regions is larger to reduce the transmission data volume. In this way, the clarity of different regions on the image received by the receiving end is different.

[0020] In a possible design, before receiving the first operation, the method further includes: receiving a second operation, where the second operation is used to set the clarity of different regions on the first image.

[0021] In an embodiment of the present application, when a user of a first device wants to send an image to a second device via a satellite, the user can set the clarity of different regions on the image. The first device differentially compresses different regions on the image according to the user's settings and sends them to the second device via the satellite. Therefore, the clarity of different regions on the image obtained by the second device is different. In this way, the user at the sending end can set the clarity of different regions according to their own needs. Suppose the user wants the other party to focus on a certain region, then the clarity of that region is set higher to ensure that the receiving party can clearly see the content in that region after receiving the image.

[0022] In a possible design, the second operation is used to set the clarity influence factor of different regions on the first image. The clarity influence factor can be understood as a parameter that can affect clarity. For example, the compression ratio affects clarity, so the second operation can be to set the compression ratio of different regions.

[0023] In a possible design, the method further includes: displaying the second image.

[0024] In an embodiment of the present application, when a user of a first device wants to send an image to a second device via a satellite, the user can set the clarity of different regions on the image, and the first device can display the clarity setting result (i.e., the second image) to facilitate the user to know the clarity setting result.

[0025] In a possible design, the N multimedia data streams are data streams obtained by compressing the target region and the non-target region on the first image using different compression ratios. The target region includes at least one of: a user-specified region, a region where a target object is located, and a region centered in position. The non-target region is other regions outside the target region.

[0026] In an embodiment of the present application, differential compression can be performed on the target region and the non-target region on the image while ensuring that the total data volume of the compressed multimedia data stream does not exceed a second threshold. For example, the clarity of the target region is higher than that of the non-target region. In this way, the receiving party can clearly see the content in the target region and avoid the content in the target region from failing to be conveyed due to excessive compression of the target region.

[0027] In a possible design, the method further includes: receiving a return message from the satellite, where the return message is used to indicate that the N multimedia data streams are successfully sent.

[0028] In an embodiment of the present application, after the first device sends N multimedia data streams to the satellite, it can receive a receipt from the satellite to indicate successful sending. The first device can output this receipt to prompt the user of successful sending and improve the user experience.

[0029] In a possible design, N multimedia data streams are sent to a satellite, including: sending M multimedia data streams to the satellite, where the M multimedia data streams are one or more of the N multimedia data streams, and M is a positive integer; when receiving the return message from the satellite, sending the remaining N - M multimedia data streams, where the return message is used to indicate that the M multimedia data streams are successfully sent.

[0030] In the embodiments of the present application, when the first device sends N multimedia data streams to the satellite, it can be sent in multiple times. Since it takes a certain amount of time to send all N multimedia data streams, in order to ensure communication between the first device and the satellite within this time period, the first device can first send a part of the multimedia data streams, and then wait for the satellite's receipt. If the receipt is received, it means that communication with the satellite is maintained, and then other multimedia data streams can be sent, avoiding the waste of power consumption caused by the first device continuing to send multimedia data streams to the satellite while the communication between the first device and the satellite has been interrupted.

[0031] In a second aspect, a multimedia transmission method is further provided, and this method is applicable to a second device. Exemplarily, the second device can be a terminal device such as a mobile phone or a PC. The method includes: the second device receives N multimedia data streams sent by the satellite, where N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold. The second device obtains multimedia based on the N multimedia data streams.

[0032] In a possible design, the first multimedia data stream among the N multimedia data streams is carried in a first message, where the first multimedia data stream is one or more data streams among the N multimedia data streams, and the first message further includes at least one of the following:

[0033] First indication information, used to indicate the type of the multimedia;

[0034] Second indication information, used to indicate the size of the multimedia;

[0035] Third indication information, used to indicate the identifier of the first device;

[0036] Fourth indication information, used to indicate the identifier of the second device.

[0037] In a possible design, the first multimedia data stream may include: any one or more of the N multimedia data streams, or the first received multimedia data stream among the N multimedia data streams, or the last received multimedia data stream among the N multimedia data streams, or the multimedia data stream with the smallest data volume among the N multimedia data streams.

[0038] In a possible design, the multimedia is a first image, and the method further includes: displaying the first image, where the clarity of different regions on the first image is different.

[0039] In a possible design, obtaining multimedia based on the N multimedia data streams includes: obtaining a first image based on a second multimedia data stream among the N multimedia data streams, where the first image includes the edge contour of an object; obtaining a second image based on a third multimedia data stream among the N multimedia data streams and the first image, where the second image includes details of the object, and the reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

[0040] In the embodiments of the present application, since the second multimedia data stream is received first, the second device can restore the approximate contour of the object in the image according to its characteristic information. In this way, even if the third multimedia data stream is not received, the general content of the image can be known. Of course, if the third multimedia data stream is received, details can be added to the image according to its characteristic information to improve the clarity of the image.

[0041] In a possible design, obtaining multimedia based on the N multimedia data streams includes: obtaining a first image based on a second multimedia data stream among the N multimedia data streams, where the first image includes a first object; obtaining a second image based on a third multimedia data stream among the N multimedia data streams and the first image, where the second image includes the first object and a second object, and the reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

[0042] In the embodiments of the present application, since the second multimedia data stream is sent first, after the second device receives the second multimedia data stream, it can restore the first object in the image according to its characteristic information. In this way, even if the third multimedia data stream is not received, it can be known that the image includes the first object. Of course, if the third multimedia data stream is received, the second object can be restored according to its characteristic information to improve the integrity of the image.

[0043] In a third aspect, a communication system is further provided, including: a first device, a second device, and a satellite;

[0044] The first device is configured to execute the method steps as described in the first aspect above;

[0045] The second device is configured to execute the method steps as described in the second aspect above.

[0046] In a fourth aspect, an electronic device is further provided, including:

[0047] A processor, a memory, and one or more programs;

[0048] Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to execute the method provided in the first aspect or the second aspect as described above.

[0049] In a fifth aspect, a computer-readable storage medium is further provided. The computer-readable storage medium is used to store a computer program, and when the computer program runs on a computer, it causes the computer to execute the method provided in the first aspect or the second aspect as described above.

[0050] In a sixth aspect, a computer program product is further provided, including a computer program that, when running on a computer, causes the computer to execute the method provided in the first aspect or the second aspect as described above.

[0051] In a seventh aspect, a chip is further provided. The chip is coupled to a memory in an electronic device and is used to call a computer program stored in the memory and execute the technical solution provided in the first aspect or the second aspect of the embodiments of the present application. In the embodiments of the present application, "coupling" means that two components are directly or indirectly combined with each other.

[0052] For the technical effects that can be achieved by the second aspect to the seventh aspect above, please refer to the description of the technical effects that can be achieved by the corresponding design solutions in the first aspect above. The present application will not repeat them here. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 It is a schematic diagram of a communication system provided by an embodiment of the present application;

[0054] Figure 2A And Figure 2B It is a schematic diagram of mobile phone A sending an image to mobile phone B via a satellite provided by an embodiment of the present application;

[0055] Figure 3 It is a schematic flowchart of a multimedia transmission method provided by an embodiment of the present application;

[0056] Figure 4 It is another schematic diagram of a communication system provided by an embodiment of the present application;

[0057] Figures 5A to 5C It is a schematic diagram of a message sent by mobile phone A provided by an embodiment of the present application;

[0058] Figure 6 It is a schematic diagram of mobile phone B receiving an image provided by an embodiment of the present application;

[0059] Figure 7A Schematic diagram of mobile phone A provided by an embodiment of the present application for dividing an image into regions;

[0060] Figure 7B Schematic diagram of mobile phone A provided by an embodiment of the present application for sending images with different clarity levels to mobile phone B;

[0061] Figure 7C Schematic diagram of mobile phone A provided by an embodiment of the present application for setting the clarity of different regions on an image;

[0062] Figure 8 Schematic diagram of an electronic device provided by an embodiment of the present application;

[0063] Figure 9 Another schematic diagram of an electronic device provided by an embodiment of the present application. Detailed implementation manners

[0064] Hereinafter, some terms in the embodiments of the present application will be explained to facilitate understanding by those skilled in the art.

[0065] (1) At least one involved in the embodiments of the present application includes one or more; among them, multiple means greater than or equal to two. In addition, it should be understood that in the description of this specification, terms such as "first", "second", "third", etc. are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order. For example, the first device and the second device do not represent the importance degree of the two or the order of the two, but are only for distinguishing descriptions. In the embodiments of the present application, "and / or" only describes the association relationship and indicates that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in this article generally represents an "or" relationship between the associated objects before and after.

[0066] (2) The orientation terms mentioned in the embodiments of the present application, such as "up", "down", "left", "right", "inside", "outside", etc., are only with reference to the direction of the accompanying drawings. Therefore, the orientation terms used are for better and clearer explanation and understanding of the embodiments of the present application, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus cannot be understood as a limitation to the embodiments of the present application.

[0067] (3) As used in the embodiments of the present application, references to "one embodiment", "in some examples", or "some embodiments" etc. mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of this specification. Thus, statements such as "in some examples", "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments" etc. that appear in different places in this specification do not necessarily all refer to the same embodiment, but rather mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "comprising", "including", "having" and their variants all mean "including but not limited to", unless otherwise specifically emphasized.

[0068] (4) The multimedia involved in the embodiments of the present application may include: various media such as images, videos, audios, animated gifs, emoticons, etc.

[0069] As mentioned above, in areas such as the ocean, forest or desert, due to the difficulty of deploying ground base stations, the ground mobile communication network cannot cover these areas. For this reason, one solution is that in these areas (i.e., areas where the ground mobile communication network cannot cover), communication can be carried out through non-terrestrial networks (NTN). Exemplarily, NTN may include satellites, high-altitude platforms, drones, ships, vehicles, etc. Taking satellites as an example, that is, users in areas such as the ocean, forest or desert can communicate with the outside world through satellites, which is very helpful for groups such as ocean workers and wilderness explorers.

[0070] For example, please refer to Figure 1 , which is a schematic diagram of a communication system provided by an embodiment of the present application. As Figure 1 , the communication system includes a first device, a second device and a satellite. The first device and the second device can communicate through the satellite. It should be noted that the embodiments of the present application do not limit the type of the satellite. For example, the satellite can be a low earth orbit (LEO) satellite. Of course, it can also be a high earth orbit (HEO) satellite. Exemplarily, the satellite can be a Beidou satellite or other satellites.

[0071] It should be noted that Figure 1In the following, both the first device and the second device are taken as mobile phones as an example. For example, the first device is mobile phone A and the second device is mobile phone B. It can be understood that in addition to mobile phones, the first device and the second device can also be other types of devices. For example, the first device can also be a Personal Computer (PC). Optionally, the PC can include tablet computers, laptop computers, desktop computers, etc. Or, the first device can also be wearable devices such as watches and bracelets; or, it can also be smart home devices such as televisions and refrigerators; or, it can also be a means of transportation, such as various types of vehicles, trains, aircraft, etc.; or, it can also be in-vehicle devices. For example, the in-vehicle device can be an intelligent cockpit, each system in the intelligent cockpit, such as the In-Vehicle Infotainment (IVI) or other in-vehicle devices, such as the Vehicle Domain Controller (VDC), Cockpit Domain Controller (CDC), ADAS / AD Domain Controller (ADC), Mobile Data Center (MDC), and so on. Or, the first device can also be a Virtual Reality (VR) device, Augmented Reality (AR) device, Mixed Reality (MR) device, etc. Similarly, the second device can also be a PC; or, it can also be wearable devices such as watches and bracelets; or, it can also be smart home devices such as televisions and refrigerators; or, it can also be a means of transportation; or, it can also be in-vehicle devices; or, it can also be VR devices, AR devices, MR devices, etc. In short, the embodiments of the present application do not limit the types of the first device and the second device. The first device and the second device can be devices of the same type. For example, both the first device and the second device are mobile phones; or, the first device and the second device can also be devices of different types. For example, the first device is a mobile phone and the second device is a PC. In this article, the case where both the first device and the second device are mobile phones is mainly used for illustration.

[0072] In addition, although Figure 1Only three devices are shown, namely the first device, the second device, and the satellite. In fact, more devices can also be included. For example, a ground station, a server, etc. can also be included between the satellite and the second device. For example, the first device sends information to the satellite, and the information includes the recipient identifier (e.g., the recipient's phone number). After receiving the information, the satellite sends the information to the ground station. The ground station determines the corresponding server according to the recipient identifier in the information, and then sends the information to the server. For example, if the recipient number is a Chengdu number 185XXXXXXXX, the ground station can send the information to the server in Chengdu, and the server sends the information to the second device, and the number of the second device is the recipient's number.

[0073] Continuing below with Figure 1 as an example, and taking Figure 1 the example where mobile phone A sends information to mobile phone B via a satellite, the communication process between mobile phone A and mobile phone B will be described.

[0074] In some examples, when mobile phone A is in a no-network state, it can send information to the outside world via a satellite. Optionally, the no-network state can include: mobile phone A is not connected to any network (e.g., not connected to wifi, 4G, or 5G mobile data network), and the SIM card of mobile phone A has no signal. Optionally, when mobile phone A is in a no-network state, a prompt message can be displayed on the display screen. For example, "No service" can be displayed in the status bar. Of course, in some other examples, when mobile phone A is in a networked state, it can also send information to the outside world via a satellite, which is not limited in the embodiments of the present application.

[0075] In some embodiments, the transmission resources (e.g., bandwidth) provided by the satellite are very small. To ensure that the information can be sent successfully, mobile phone A can only send a small amount of information. For example, the data volume of text information (e.g., text messages) is small, so mobile phone A can send text information to mobile phone B via the satellite. For example, mobile phone A sends the text "Danger ahead" to mobile phone B via the satellite. However, in actual use, the editing process of text information is relatively cumbersome, and text information cannot accurately and intuitively describe the current actual situation. For example, it is impossible to accurately describe the special environmental characteristics in the wild, the characteristics of insects in the forest, etc. through text information.

[0076] To this end, an embodiment of the present application provides a multimedia transmission method. In this method, mobile phone A can send multimedia to mobile phone B via satellite. Optionally, the multimedia may include images, videos, audio, animated images, emoticons, etc. Therefore, through the technical solution of the embodiment of the present application, on the one hand, due to the need for not too many text editing operations, the convenience is improved. On the other hand, the current actual situation can be accurately and intuitively described through multimedia. As described above, the bandwidth of the satellite transmission channel is very small, while the data volume of multimedia is large. To ensure the successful transmission of multimedia, in the embodiment of the present application, mobile phone A can compress the multimedia to generate a multimedia data stream. The data volume of the multimedia data stream obtained after compression is small and can be sent to mobile phone B via satellite.

[0077] In the following, taking the multimedia as an image as an example, in combination with Figure 2A and Figure 2B illustrate the operation process of mobile phone A sending an image to mobile phone B via satellite.

[0078] As Figure 2A (a), mobile phone A displays interface 110. In interface 110, "No service" is displayed in the status bar, which is used to indicate that mobile phone A is currently in a network-free state, as can be seen from the previous description. Interface 110 can be the interface of an instant messaging application (for example, the Huawei Changlian application) in mobile phone A. Interface 110 may include an option for satellite messages. When mobile phone A receives an operation (for example, a click operation) on the option for satellite messages, interface 120 as shown in Figure 2A (b) can be displayed. Interface 120 includes a button for creating a new message. When mobile phone A receives an operation on the button for creating a new message, interface 130 as shown in Figure 2A (c) can be displayed. The user of mobile phone A can select the recipient in interface 130. For example, the selected recipient is user B. The user of mobile phone A can also edit or select the content to be sent in interface 130. For example, Figure 2A in (c), when mobile phone A receives the operation of the user clicking the button , an album button is displayed. When mobile phone A receives an operation on the album button, interface 140 as shown in Figure 2A (d) can be displayed. Interface 140 includes thumbnails (or preview images) of each image in the gallery. Assuming that mobile phone A detects that the first thumbnail is selected (for example, clicked and selected), and mobile phone A receives an operation on the send button, interface 150 as shown in Figure 2A (e) can be displayed. Interface 150 includes a prompt message: Please adjust the mobile phone direction to align with the satellite. The user can adjust the mobile phone direction to align with the satellite. When the mobile phone detects alignment with the satellite, interface as shown in Figure 2AThe interface 160 shown in (f). The interface 160 includes a prompt message: Sending, please stay still. In the embodiment of the present application, mobile phone A can compress the selected image to generate a multimedia data stream. Since the data volume of the multimedia data stream is small, mobile phone A can send the multimedia data stream to mobile phone B via satellite. After successful sending, mobile phone A can display an interface as shown in Figure 2A (g). The interface 170 includes a prompt message: Sent. Optionally, the interface 170 can also display a prompt message for receiving and sending satellite receipts. After that, the mobile phone can display an interface as shown in Figure 2A (h). The interface 180 includes the content sent to user B.

[0079] Figure 2A In (d), taking the user selecting the first image as an example, it can be understood that the user may also select other images, such as the second, the third, and so on. The data volume sizes of the images selected by the user are not necessarily the same. The user may select an image of 10M or an image of 20M. In the embodiment of the present application, regardless of the data volume of the image selected by the user, mobile phone A can compress the image into a multimedia data stream with a data volume less than or equal to the target value (for example, 800B or 1KB) (the specific implementation process will be described later) to ensure that the image can be successfully sent to the peer via satellite.

[0080] As shown in Figure 2B (a), it is the interface 190 of an instant messaging application (such as the Huawei Changlian application) in mobile phone B. The interface 190 displays an option for satellite messages. Optionally, a prompt message can also be displayed inside the interface 190 to prompt for new satellite messages, such as symbol ①. When mobile phone B receives an operation on the option for satellite messages, it can display an interface as shown in Figure 2B (b), which is the interface 1100. The interface 1100 includes a thumbnail (or preview image) of the image sent by mobile phone A. When mobile phone B receives an operation on the thumbnail, it can display an interface as shown in Figure 2B (c), which is the interface 1200. The interface 1200 includes the image sent by mobile phone A.

[0081] It should be noted that Figure 2A and Figure 2B take mobile phone A sending an image to mobile phone B via satellite as an example. Of course, mobile phone A can also send other multimedia such as videos, animated pictures, and emoticons to mobile phone B via satellite. The specific operation processes are similar and will not be exemplified one by one.

[0082] The following describes the implementation principle of mobile phone A sending an image to mobile phone B via satellite. It should be noted that although the following takes sending an image as an example, the implementation principles for other multimedia such as videos, animated pictures, and emoticons are the same.

[0083] Please refer to Figure 3 , which is a schematic flowchart of a multimedia transmission method provided by an embodiment of this application. This method can be applicable to Figure 1 communication systems, and can also be applicable to Figure 2A and Figure 2B scenarios. As Figure 3 , the process may include:

[0084] S300, mobile phone A is currently in a network - free state. Regarding the network - free state, please refer to the previous description.

[0085] S301, mobile phone A receives a first operation, and the first operation is used to trigger the sending of an image to mobile phone B. Taking Figure 2A (d) as an example, the first operation may be an operation on the sending button (for example, a click operation).

[0086] S302, mobile phone A determines the target file size.

[0087] Exemplarily, the target file size may be 1KB, 800B, 600B, etc., and the specific value is not limited in the embodiments of this application. The target file size is used to indicate that the multimedia to be sent to the satellite needs to be compressed to be less than or equal to the target file size.

[0088] In some embodiments, the target file size is pre - configured. For example, mobile phone A stores the target file size when it leaves the factory. Or, the target file size is specified in the communication protocol between mobile phone A and the satellite. Or, the target file size can also be indicated by the satellite to mobile phone A. For example, the satellite sends configuration information to mobile phone A, and the configuration information includes the target file size.

[0089] In some examples, for different types of multimedia, the target file size may be different. For example, when the multimedia is an image, the target file size is 800B; when the multimedia is a video, the target file size is 1KB.

[0090] S303, mobile phone A compresses the image to generate a multimedia data stream, and the data volume of the multimedia data stream is less than or equal to the target file size.

[0091] Optionally, there are multiple image compression methods. For example, compression can be performed through an encoding method. Optionally, the encoding method may include lossy encoding, lossless encoding, orthogonal transform encoding, etc., which are not limited in the embodiments of this application. Or, compression can also be achieved through feature extraction. Optionally, feature extraction can be implemented through a convolutional neural network, which is not elaborated in the embodiments of this application. Exemplarily, please refer to Figure 4, Mobile phone A includes a compression framework, which is used to compress multimedia (such as images) to a target file size. For example, the compression framework includes a convolutional neural network, an encoding module, and a control module. When an image is input into the compression framework, the convolutional neural network extracts feature information from the image, and the extracted feature information is encoded by the encoding module. The encoding module can encode the feature information into a multimedia data stream according to the target file size provided by the control module, and the data volume of the multimedia data stream is less than or equal to the target file size. That is to say, no matter how large the data volume of the multimedia input into the compression framework is, the data volume of the multimedia data stream output after passing through the compression framework is less than or equal to the target file size (for example, 800B).

[0092] S304, Mobile phone A sends the multimedia data stream to the satellite.

[0093] In some examples, mobile phone A can send the entire multimedia data stream to the satellite at one time. For example, when the bandwidth of the satellite is sufficient, the entire multimedia data stream can be sent to the satellite.

[0094] In other examples, the multimedia data stream can be sent in multiple times. For example, the multimedia data stream can be split into N data packets, where N is an integer greater than or equal to 2, and each data packet includes a segment of the data stream in the multimedia data stream. The N data packets are sent in N times. Optionally, the number of data packets N into which the multimedia data stream is split can be determined according to the transmission bandwidth of the satellite. For example, if the total amount of the multimedia data stream is 800B and the transmission bandwidth is 100B, then it is split into 8 data packets.

[0095] In some examples, the sending order of the 8 data packets can be determined according to the priority relationship of the 8 data packets. For example, each data packet corresponds to different feature information in the image, and the priority relationship of the data packets can be determined according to the priority of the feature information corresponding to the data packets. For example, among the 8 data packets, data packets 1 to 4 correspond to feature information 1 in the image, and data packets 5 to 8 correspond to feature information 2 in the image. If the priority of feature information 1 is higher than that of feature information 2, then data packets 1 to 4 are sent first (the sending order of the 4 data packets is not limited), and data packets 5 to 8 are sent later (the sending order of the 4 data packets is not limited).

[0096] Optionally, the priority of feature information 1 is higher than that of feature information 2, which may include: feature information 1 is used to describe the edge contour of an object in the image, and feature information 2 is used to describe the details of the object in the image. The details may include the color, brightness, etc. of the object. In this way, since data packets 1 to 4 are sent first, after the peer end (i.e., mobile phone B) receives data packets 1 to 4, it can restore the approximate contour of the object in the image according to feature information 1. In this case, even if the transmission of data packets 5 to 4 fails, the peer end (i.e., mobile phone B) can still know the approximate content of the image. Of course, if the transmission of data packets 5 to 4 is successful, the peer end (i.e., mobile phone B) can add details to the image according to feature information 2 to improve the clarity of the image.

[0097] Optionally, the priority of feature information 1 is higher than that of feature information 2, which may include: feature information 1 is used to describe object 1 in the image, and feature information 2 is used to describe object 2 in the image, and the priority of object 1 is higher than that of object 2. In this way, since data packets 1 to 4 are sent first, after the peer end (i.e., mobile phone B) receives data packets 1 to 4, it can restore object 1 in the image according to these four data packets. In this case, even if the transmission of data packets 5 to 4 fails, the peer end (i.e., mobile phone B) can still know that object 1 is included in the image. Of course, if the transmission of data packets 5 to 4 is successful, the peer end (i.e., mobile phone B) can restore object 2 according to these four data packets to improve the integrity of the image. Optionally, the priority of object 1 being higher than that of object 2 may include at least one of the following: object 1 is a foreground object and object 2 is a background object; or, object 1 is a person and object 2 is not a person; or, the area occupied by object 1 in the image is larger than the area occupied by object 2 in the image; or, the position of object 1 in the image is centered and the position of object 2 in the image is close to the edge, etc.

[0098] In the above example, the multimedia data stream is split into 8 data packets and sent separately. In some examples, it takes a certain amount of time to send 8 data packets. To ensure that mobile phone A maintains communication with the satellite within this time period, every 4 data packets are taken as a group. After the satellite receives a group of data packets, it can return a receipt to mobile phone A to indicate that mobile phone A and the satellite are currently in a communication state. For example, after mobile phone A sends a group of data packets, it can wait for the receipt from the satellite. If it receives the receipt, it continues to send the next group of data packets. If it does not receive the receipt, it determines that the communication with the satellite is interrupted and may not need to continue sending the next group of data packets or resend the previous group of data packets. It should be noted that taking 4 data packets as a group is used as an example above. It can also be more or fewer data packets as a group, and the number of data packets in each group can be pre-configured, for example, it can be specified by the protocol or indicated by the base station. The embodiments of the present application do not make any limitations.

[0099] S305, the satellite sends a multimedia data stream to mobile phone B.

[0100] S306, the satellite sends a receipt to mobile phone A to indicate that the multimedia data stream has been successfully sent.

[0101] Optionally, S306 may or may not be executed, which is not limited in the embodiments of the present application.

[0102] S307, mobile phone B decompresses the multimedia data stream to obtain multimedia.

[0103] For example, please refer to Figure 4 , mobile phone B includes a decompression module for decompressing the multimedia data stream. The decompression module includes a deconvolution neural network and a decoding module. The decoding module is used to decode the multimedia data stream to obtain the feature information of the image, and then processes the feature information through the deconvolution neural network to obtain the image.

[0104] S308, mobile phone B displays the image.

[0105] Optionally, the execution order of S306, S307, and S308 is not limited in the embodiments of the present application.

[0106] As mentioned above, the multimedia data stream can be sent all at once or in multiple times. Taking sending all at once as an example, the multimedia data stream can be carried in one message. Taking Message 1 as an example, optionally, in addition to the multimedia data stream, Message 1 may further include at least one of the following information:

[0107] (1) The first indication information, which is used to indicate the type of the multimedia. For example, when the first indication information is 00, it is used to indicate that the multimedia is an image; when the first indication information is 01, it is used to indicate that the multimedia is a video; when the first indication information is 10, it is used to indicate that the multimedia is an emoji.

[0108] (2) The second indication information, which is used to indicate the size of the multimedia. The size may include dimensions and / or length. Taking the multimedia as an image as an example, the size of the image may include the dimensions of the image, such as the height H and width W of the image. Taking the multimedia as a video as an example, the size of the video may include the dimensions of the video, such as the height H and width W of the image, and may also include the length of the video, such as the duration of the video. Taking the multimedia as an audio as an example, the size of the audio may include the length of the audio, such as the duration of the audio.

[0109] (3) The third indication information, which is used to indicate the identifier of the receiving party (i.e., mobile phone B). Optionally, the receiving party identifier may include the number of the receiving party (for example, the phone number). Optionally, the receiving party identifier may further include the number of the receiving parties. Taking Figure 2A (c) above as an example, user A may Figure 2ASelect one or more recipients in the interface of (c). Assume that one recipient is selected, then the number of recipients is 1, and the number is the phone number of this recipient.

[0110] (4) The fourth indication information is used to indicate the identity of the sender (i.e., mobile phone A). Optionally, the sender identity may include the number of the sender (e.g., phone number).

[0111] As an example, please refer to Figure 5A , which is a schematic diagram of Message 1. As Figure 5A , Message 1 includes three fields. The first field occupies X bits and includes the third indication information. As described above, the third indication information is used to indicate the identity of the recipient. The second field occupies Y bits and includes the first indication information. As described above, the first indication information is used to indicate the multimedia type. The third field occupies Z bits and includes the multimedia data stream. It should be noted that in actual applications, Message 1 may include more or fewer fields than Figure 5A . The embodiments of this application do not make limitations. In addition, Figure 5A takes the example that the recipient identity in Message 1 is in the front field, the multimedia type is in the middle field, and the multimedia data stream is in the back field. In actual applications, there may also be other layouts. For example, the recipient identity is in the front field, the multimedia data stream is in the middle field, and the multimedia type is in the back field, and so on.

[0112] Considering that the multimedia sent by mobile phone A to the satellite can also be emoji, animated pictures, etc. Taking emoji as an example, in order to improve the transmission efficiency, a possible situation is that some emoji are pre-stored in the satellite. If mobile phone A needs to send a certain emoji to the satellite, it only needs to send the identifier of the emoji to the satellite, and there is no need to send the multimedia of the emoji, and the transmission volume is greatly reduced. Therefore, as another example, please refer to Figure 5B , which is another schematic diagram of Message 1. The difference from Figure 5A is that Figure 5B in Message 1 includes a reserved field of P bits. The reserved field is used when sending special multimedia (e.g., emoji or animated pictures). Taking the previous Figure 2A (c) as an example, Figure 2A in the interface of (c), emoji can be displayed. These emoji can be pre-stored in the satellite. If the user selects one of the emoji, mobile phone A can send the identifier of the emoji to the satellite. In this case, Figure 5B the multimedia type in the second field of Message 1 in

[0113] Taking the example where a multimedia data stream is split into N data packets and sent in N parts, each data packet is carried and sent in an independent message, that is, N data packets are sent through N messages. Taking N = 8 as an example, that is, the multimedia data stream is split into 8 data packets. Please refer to Figure 5C , mobile phone A sends 8 messages to the satellite in sequence, namely message 1 to message 8. Among them, data packet 1 is included in message 1, data packet 2 is included in message 2, and so on. As Figure 5C , since the receiving party identifier, multimedia type and other indication information are included in message 1, these indication information may not be included in messages 2 to 8 to reduce the transmission volume.

[0114] In the previous text Figure 2A (d), the user selects image 1000, mobile phone A compresses the image 1000 into a multimedia data stream and sends it to mobile phone B, and mobile phone B obtains image 1300 through decompression, as Figure 2B (c). Figure 2B (c), the clarity of each area in image 1300 is the same. This is because, Figure 2A (d), when mobile phone A receives an operation on the send button, it compresses each area on image 1000 with the same compression ratio to obtain a multimedia data stream. Therefore, the clarity of each area in the image 1300 obtained by mobile phone B through decompressing the multimedia data stream is the same.

[0115] In some other examples, in the previous text Figure 2A (d), when mobile phone A receives an operation on the send button, it compresses each area on image 1000 with different compression ratios to obtain a multimedia data stream, so that the clarity of each area in the image 1300 obtained by mobile phone B through decompressing the multimedia data stream is different. For example, please refer to Figure 6 (a), which is the interface of an instant messaging application (such as Huawei Changlian) in mobile phone B. An option for satellite messages is displayed in this interface. When mobile phone B receives an operation on the option for satellite messages, it can display an interface such as Figure 6 (b). This interface includes a thumbnail (or preview image) of the image sent by mobile phone A. When mobile phone B receives an operation on the thumbnail, it can display an interface such as Figure 6 (c). This interface includes image 1300 sent by mobile phone A. The clarity of different areas in image 1300 is different.

[0116] As mentioned in the above example, Figure 2AIn (d), when mobile phone A receives an operation on the send button, it compresses each region on image 1000 using different compression ratios to obtain a multimedia data stream. It can be understood that before compressing each region on image 1000 using different compression ratios, image 1000 can be divided into different regions first. Optionally, the region division can be automatically performed by mobile phone A or manually by the user.

[0117] Taking automatic division as an example. That is to say, Figure 2A In (d), after mobile phone A receives an operation on the send button, it automatically divides image 1000 into different regions, and then compresses different regions using different compression ratios and sends them to mobile phone B. For example, mobile phone A can automatically identify the target object on image 1000, and then divide the region where the target object is located and the regions where other objects are located into different regions. The target object can be an object centered on the image 1000, an object with a larger area, an object with a higher priority, etc. Optionally, the priority relationship of different objects can be stored in mobile phone A, and the priority relationship includes, for example, person > animal > plant. When mobile phone A determines that there are multiple objects in the image, it can determine which object has the highest priority according to this priority relationship.

[0118] Taking manual division by the user as an example. Continuing with the previous Figure 2A (d) as an example, when mobile phone A receives an operation on the first thumbnail (for example, a double-click operation), it can display an interface such as Figure 7A (a), and this interface includes image 1000. The user can manually divide regions on image 1000. For example, Figure 7A In (a), after mobile phone A receives a circle-drawing operation (represented by a dotted line in the figure), it divides the region inside the circle and the region outside the circle into different regions. Optionally, if the mobile phone receives an operation on the confirm button, it can return to the interface of Figure 2A (d). In this interface, after the user clicks the send button, the mobile phone compresses the regions divided by the user using different compression ratios and then sends them to mobile phone B. Figure 7A In (a), if the mobile phone receives an operation on the return button, it can re-divide the regions.

[0119] Or, continuing with the previous Figure 2A (d) as an example, when mobile phone A receives an operation on the first thumbnail (for example, a double-click operation), it can display an interface such as Figure 7A(b)'s interface, which includes image 1000, and there is a dotted line box on image 1000 (i.e., the dotted line box appears automatically). The area inside the dotted line box and the area outside the dotted line box are divided into different areas. Optionally, the dotted line box can be located in the middle position or any position of the image. Or, mobile phone A can identify the target object and then display the dotted line box at the position where the target object is located. For the identification of the target object, please refer to the previous text. It can be understood that considering that after the dotted line box appears automatically, the area enclosed by the dotted line box may not meet the user's requirements. Therefore, the user can also adjust the position, area, etc. of the dotted line box to re-divide the area.

[0120] Continue with the previous text Figure 2A (d) as an example, when mobile phone A receives an operation (such as a double-click operation) on the first thumbnail, it can display an interface such as Figure 7A (c), which includes image 1000, and the area where the target object (such as a tree) is located on image 1000 is filled with diagonal lines (or it can also be filled with colors or others), indicating that the target object is compressed with a different compression ratio from other objects. Of course, the user can replace the target object. For example, Figure 7A In (c), when mobile phone A receives a click operation from the user on image 1000 and determines that the click operation is within the area where the object "sun" is located, the target object is replaced with "sun", and then the area where the sun is located is filled with diagonal lines, indicating that the sun is compressed with a different compression ratio from other objects.

[0121] The above are several ways to divide the area of the image. It can be understood that there can be other division methods, and the embodiments of the present application will not list them one by one.

[0122] Take Figure 7A (b) as an example, mobile phone A divides image 1000 into two areas. In the embodiments of the present application, mobile phone A can perform differential compression on these two areas to obtain a multimedia data stream, so that mobile phone B can obtain an image with different clarity in different areas by decompressing the multimedia data stream. The following describes Figure 7A the differential compression process of the two areas in (b).

[0123] For example, please refer to Figure 7B , image 1000 is divided into two image blocks, image block 1 and image block 2. Mobile phone A compresses image block 1 with compression ratio 1 to obtain multimedia data stream 1. Mobile phone A compresses image block 2 with compression ratio 2 to obtain multimedia data stream 2. Compression ratio 2 is different from compression ratio 1. For example, compression ratio 2 is higher than compression ratio 1. Moreover, the total data volume of multimedia data stream 1 and multimedia data stream 2 is less than or equal to the target file size, such as 800B.

[0124] Continue as Figure 7BAfter receiving Multimedia Data Stream 1 and Multimedia Data Stream 2, mobile phone B can decompress Multimedia Data Stream 1 and Multimedia Data Stream 2 respectively to obtain two image blocks, namely Image Block 1 and Image Block 2. Mobile phone B combines these two image blocks into one image, and the clarity of different regions on this image is different. It can be understood that when mobile phone B combines two image blocks into one image, it needs to use the positional relationship between these two image blocks. A possible way is that mobile phone A sends the positional relationship between these two image blocks to mobile phone B. Optionally, the positional relationship may be located in any field in Message 1 in the foregoing text, and the embodiments of the present application do not make limitations.

[0125] In the above embodiments, different regions are compressed using different compression ratios. For example, Figure 7B in, Image Block 1 is compressed using Compression Ratio 1, and Image Block 2 is compressed using Compression Ratio 2. In some examples, mobile phone A can set different compression ratios for different regions by itself, as long as it ensures that the clarity of different regions on the compressed image is different and the amount of image data after compression does not exceed the target file size. For example, Figure 7B in, mobile phone A can set a smaller compression ratio for Image Block 1 and a larger compression ratio for Image Block 2 by itself, so that Image Block 1 in the image obtained by mobile phone B is clearer.

[0126] In other examples, the compression ratios of different regions can be set manually by the user.

[0127] For example, continuing with the foregoing Figure 2A (d) as an example, when mobile phone A receives an operation on the first thumbnail (for example, a double-click operation), it can display an interface such as Figure 7C (a), and Image 1300 is displayed in this interface. Image 1300 is an image obtained by compressing all regions on Image 1000 using the same compression ratio, so the clarity of each region on Image 1300 is the same. A progress bar is also displayed on mobile phone A, and the progress bar includes an icon (for example, a black dot). By default, the icon is located in the middle of the progress bar, representing that the clarity of each region on the image is the same, that is, the compression ratio of each region is the same.

[0128] For ease of understanding, assume that the original file size of the original image, that is, Image 1000, is 20M in total, and the original file size of Image Block 1 is 5M, and the original file size of Image Block 2 is 15M.

[0129] Figure 7C (a), the compression ratio 1 of Image Block 1 can be 5M / X, where X represents the file size of Image Block 1 after compression.

[0130] Figure 7CIn (a), the compression rate 2 of image block 2 can be 15M / Y, where Y represents the file size of image block 2 after compression, and X + Y equals the target file size (e.g., 800B). Therefore, the total file size of the two compressed image blocks does not exceed the target file size.

[0131] Figure 7C In (a), when the user drags the icon to the left, as Figure 7C in (b), the compression rate 1 of image block 1 is increased, and the compression rate 2 of image block 2 is decreased. So, image block 1 is blurrier than image block 2.

[0132] Figure 7C In (b), the compression rate 1 of image block 1 can be 5M / X', where X' represents the file size of image block 1 after compression. Compared with Figure 7C (a), X' is less than X. It can be understood that the total target file size is 800B, but the file size X allocated for image block 1 is reduced. So, the compression rate 1 increases, and thus image block 1 is Figure 7C blurrier than (a).

[0133] Figure 7C In (b), the compression rate 2 of image block 2 can be 15M / Y', where Y' represents the file size of image block 2 after compression. Compared with Figure 7C (a), Y' is greater than Y. This is because the total target file size is 800B, and the file size X allocated for image block 1 is reduced. Then, the file size Y allocated for image block 2 becomes larger. So, the compression rate 2 decreases, and thus image block 2 is Figure 7C clearer than (a). X' + Y' equals the target file size (e.g., 800B), that is, the file size of the two compressed image blocks does not exceed the target file size.

[0134] It can be understood that Figure 7C in (b), if the mobile phone receives an operation on the confirmation button, it can return to the Figure 2A interface of (d). In this interface, after the user clicks the send button, the mobile phone compresses the area divided by the user with different compression rates and then sends it to mobile phone B. In this way, on the image obtained by mobile phone B, image block 1 is blurred and image block 2 is clear.

[0135] Figure 7C In (a), when the user drags the icon to the right, as Figure 7C in (c), the compression rate 1 of image block 1 is decreased, and the compression rate 2 of image block 2 is increased. So, image block 1 is clear and image block 2 is blurred.

[0136] Figure 7C In (c), the compression rate 1 of image block 1 can be 5M / X'', where X'' represents the file size of image block 1 after compression. Compared withFigure 7C Compared with (a), X” is greater than X. It can be understood that the total size of the target file is 800B. The file size X allocated to Image Block 1 has increased, so Compression Rate 1 has decreased. Therefore, Image Block 1 is clearer than Figure 7C (a).

[0137] Figure 7C In (c), Compression Rate 2 of Image Block 2 can be 15M / Y”, where Y” represents the file size after Image Block 2 is compressed. Compared with Figure 7C (a), Y” is less than Y. This is because the total size of the target file is 800B. The file size X allocated to Image Block 1 has increased, so the file size Y for Image Block 2 has decreased. Therefore, Compression Rate 2 has increased, and Image Block 2 is blurrier than Figure 7C (a). X” + Y” is equal to the target file size (e.g., 800B), that is, the file sizes of the two compressed image blocks do not exceed the target file size.

[0138] It can be understood that Figure 7C in (c), if the mobile phone receives an operation on the confirmation button, it can return to Figure 2A the interface of (d). In this interface, after the user clicks the send button, the mobile phone compresses the area divided by the user with different compression rates and then sends it to Mobile Phone B. In this way, on the image obtained by Mobile Phone B, Image Block 1 is clear and Image Block 2 is blurred.

[0139] In the above embodiments, Compression Rate 1 of Image Block 1 is described by the ratio of the original file size of Image Block 1 to the file size after Image Block 1 is compressed. Compression Rate 2 of Image Block 2 is described by the ratio of the original file size of Image Block 2 to the file size after Image Block 2 is compressed. In some other examples, Compression Rate 1 of Image Block 1 can also be described by the ratio of the original resolution of Image Block 1 to the resolution after Image Block 1 is compressed. Similarly, Compression Rate 2 of Image Block 2 can also be described by the ratio of the original resolution of Image Block 2 to the resolution after Image Block 2 is compressed.

[0140] For ease of understanding, assume that the original resolution of the original image, i.e., Image 1000, is H*W, where the original resolution of Image Block 1 is H1*W1 and the original resolution of Image Block 2 is H2*W2.

[0141] Figure 7C In (a), Compression Rate 1 of Image Block 1 can include:

[0142]

[0143]

[0144] Among them, H1 and W1 are the original height and width of image block 1. H1' and W1' are the compressed height and width of image block 1. H1 / H1' represents the compression ratio of image block 1 in height, and W1 / W1' represents the compression ratio of image block 1 in width. H3 and W3 are the target sizes, such as 240*180, which can be determined in advance. a = file size a / target file size, where file size a is the file size after image block 1 is compressed.

[0145] Figure 7C In (b), the compression ratio 2 of image block 2 can satisfy:

[0146]

[0147]

[0148] Among them, H2 and W2 are the original height and width of image block 2. H2' and W2' are the compressed height and width of image block 2. H2 / H2' represents the compression ratio of image block 2 in height, and W2 / W2' represents the compression ratio of image block 2 in width. H3 and W3 are the target sizes, such as 240*180. b = file size b / target file size, where file size b is the file size after image block 2 is compressed. File size a + file size b is equal to the target file size.

[0149] Figure 7C In (a), when the user drags the icon to the left, the compression ratio 1 of image block 1 increases, and the compression ratio 2 of image block 2 decreases. Therefore, during the process of the icon moving to the left, image block 1 gradually blurs, and image block 2 gradually becomes clear, as shown in Figure 7C (b). The implementation principle includes the following (1) and (2).

[0150] (1), Figure 7C In (b), the compression ratio 1 of image block 1 satisfies:

[0151]

[0152]

[0153] Compared with Figure 7C (a), a' is less than a. That is, the total target file size is 800B, but the file size allocated for image block 1 is reduced. Therefore, a' decreases, so the compression ratio 1 increases. For example, the compression ratio H1 / H1' of image block 1 in height and the compression ratio W1 / W1' in width both increase. Therefore, H1' and W1' decrease, and the resolution of image block 1 is lower than that in Figure 7C (a), that is, the clarity decreases.

[0154] (2), Figure 7CIn (b), the compression rate 2 of image block 2 can satisfy:

[0155]

[0156]

[0157] Compared with Figure 7C (a), b' is greater than b, that is, the total target file size is 800B. Since the file size allocated to image block 1 is reduced, the file size allocated to image block 2 is increased, so b' increases, and thus the compression rate 2 decreases. For example, the compression rate H2 / H2' of image block 2 in height and the compression rate W2 / W2' in width both decrease, so H2' and W2' increase, that is, the resolution of image block 2 is improved compared to Figure 7C (a), that is, the clarity is improved.

[0158] Figure 7C In (a), when the user drags the icon to the right, the compression rate 1 of image block 1 decreases, and the compression rate 2 of image block 2 increases. So during the process of the icon moving to the right, image block 1 gradually becomes clear and image block 2 gradually becomes blurred, as shown in Figure 7C (c). The implementation principle includes (3) and (4) as follows.

[0159] (3), Figure 7C In (c), the compression rate 1 of image block 1 satisfies:

[0160]

[0161]

[0162] Compared with Figure 7C (a), a” is greater than a, that is, the total target file size is 800B. However, the file size allocated to image block 1 is increased, so a” increases, and thus the compression rate 1 decreases. For example, the compression rate H1 / H1' of image block 1 in height and the compression rate W1 / W1' in width both decrease, so H1' and W1' increase, and the resolution of image block 1 is improved compared to Figure 7C (a), that is, the clarity is improved.

[0163] (4), Figure 7C In (c), the compression rate 2 of image block 2 can satisfy:

[0164]

[0165]

[0166] Compared with Figure 7C(a) Compared with b, b, is less than b. That is, the total size of the target file is 800B. Since the file size allocated to image block 1 has increased, the file size allocated to image block 2 has decreased. Therefore, b, has decreased, and the compression ratio 2 has increased. For example, the compression ratio of image block 2 in height, H2 / H2,, and in width, W2 / W2, have both increased. So, H2, and W2, have become smaller, that is, image block 2 has a lower Figure 7C (a) resolution than before, that is, the clarity has decreased.

[0167] It should be noted that Figure 7C is an example of manually setting the compression ratio of different regions on an image. In practical applications, the compression ratio of different regions can also be manually set in other ways, which is not limited in the embodiments of this application.

[0168] Please refer to Figure 8 , which is a schematic structural diagram of an electronic device provided by an embodiment of this application. The electronic device can be the first device (for example, mobile phone A) or the second device (for example, mobile phone B) mentioned above. As Figure 8 shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0169] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the electronic device. The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may store the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0170] In some embodiments, the processor 110 may execute the shortcut display method provided in the embodiments of the present application. For example, the processor 110 may display a first interface through the display screen 194. The first interface includes N regions, where N is a positive integer. The N regions respectively correspond to N applications in the electronic device. At least one shortcut of a first application is included in the first region among the N regions. The first region is any one of the N regions. The first application is the application corresponding to the first region among the N applications. The at least one shortcut is used to open at least one function or interface of the first application. Among them, the shortcuts in the first region are independent and irrelevant to the shortcuts in other regions (the regions other than the first region among the N regions).

[0171] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0172] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193, etc. through different I2C bus interfaces. For example: The processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface to implement the touch function of the electronic device 100.

[0173] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 may be coupled to the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface to implement the function of answering a phone call through a Bluetooth headset.

[0174] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through the PCM bus interface. In some embodiments, the audio module 170 may also transmit an audio signal to the wireless communication module 160 through the PCM interface to implement the function of answering a phone call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0175] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to implement the function of playing music through the Bluetooth headset.

[0176] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

[0177] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0178] The USB interface 130 is an interface that conforms to the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect a headset to play audio through the headset. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0179] It can be understood that the interface connection relationship between the modules schematically shown in the embodiments of the present invention is only for schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0180] The wireless communication function of the electronic device can be implemented through Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Modulation and Demodulation Processor, Baseband Processor, etc. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0181] Mobile Communication Module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device. Mobile Communication Module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. Mobile Communication Module 150 can receive electromagnetic waves through Antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the Modulation and Demodulation Processor for demodulation. Mobile Communication Module 150 can also amplify the signal modulated by the Modulation and Demodulation Processor, and convert it into electromagnetic waves through Antenna 1 and radiate it out. In some embodiments, at least some functional modules of Mobile Communication Module 150 can be disposed in Processor 110. In some embodiments, at least some functional modules of Mobile Communication Module 150 and at least some modules of Processor 110 can be disposed in the same device.

[0182] Wireless Communication Module 160 can provide solutions for wireless communications applied to the electronic device, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. Wireless Communication Module 160 can be one or more devices integrating at least one communication processing module. Wireless Communication Module 160 receives electromagnetic waves through Antenna 2, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to Processor 110. Wireless Communication Module 160 can also receive the signal to be transmitted from Processor 110, frequency-modulate and amplify it, and convert it into electromagnetic waves through Antenna 2 and radiate it out.

[0183] In some embodiments, antenna 1 of the electronic device is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, enabling the electronic device to communicate with the network and other devices through wireless communication technologies.

[0184] The display screen 194 is used to display the display interface of applications, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0185] The electronic device 100 can implement the shooting function through the ISP, camera 193, video codec, GPU, display screen 194, and application processor, etc. Among them, the ISP is used to process the data fed back by the camera 193.

[0186] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the operating system and software codes of at least one application program, etc. The data storage area can store the data generated during the use of the electronic device (such as images, videos, etc.). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash memory, etc.

[0187] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, save files such as pictures and videos in the external memory card.

[0188] The electronic device can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor, etc. Such as music playback, recording, etc.

[0189] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110.

[0190] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to external speaker scenarios such as hands-free calls through one or more speakers 170A.

[0191] The receiver 170B, also called a "earpiece", may be one or more and is used to convert an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the voice can be received by placing the receiver 170B close to the ear.

[0192] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0193] The earphone jack 170D is used to connect a wired earphone.

[0194] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .

[0195] The gyro sensor 180B can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting.

[0196] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0197] The magnetic sensor 180D includes a Hall sensor, and the electronic device can use the magnetic sensor 180D to detect the opening and closing of the flip leather case.

[0198] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device in various directions (generally three axes), and can detect the magnitude and direction of gravity when the electronic device is stationary.

[0199] Distance sensor 180F, used to measure distance. Electronic devices can measure distance through infrared or laser.

[0200] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device emits infrared light outward through the light emitting diode. The electronic device uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device. When insufficient reflected light is detected, the electronic device can determine that there is no object near the electronic device.

[0201] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness.

[0202] The fingerprint sensor 180H is used to collect fingerprints.

[0203] The temperature sensor 180J is used to detect temperature.

[0204] The touch sensor 180K, also known as the "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event.

[0205] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals of the vibrating bone mass of the human vocal part.

[0206] The keys 190 include a power-on key, volume keys, etc. The keys 190 can be mechanical keys. They can also be touch keys. The electronic device can receive key inputs and generate key signal inputs related to the user settings and function controls of the electronic device. The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be in contact with and separated from the electronic device by being inserted into or removed from the SIM card interface 195.

[0207] It can be understood that Figure 8 the components shown do not specifically limit the electronic device. The electronic device in the embodiments of the present invention can include more or fewer components than Figure 8 those in. In addition, Figure 8 the combination / connection relationship between the components in

[0208] Figure 9 is a schematic structural diagram of the electronic device 900 provided by the embodiments of the present application. The electronic device 900 can be the first device (for example, mobile phone A) or the second device (for example, mobile phone B) in the foregoing. As Figure 9As shown in the figure, the electronic device 900 may include: one or more processors 901; one or more memories 902; a communication interface 903, and one or more computer programs 904. Each of the above components may be connected through one or more communication buses 905. The one or more computer programs 904 are stored in the memory 902 and configured to be executed by the one or more processors 901. The one or more computer programs 904 include instructions. For example, when the electronic device 900 is the first device in the foregoing text, the instructions may be used to execute the relevant steps of the first device in the corresponding foregoing embodiments, such as executing Figure 3 the relevant steps of the first device in the figure. For another example, when the electronic device 900 is the second device in the foregoing text, the instructions may be used to execute the relevant steps of the second device in the corresponding foregoing embodiments, such as executing Figure 3 the relevant steps of the second device in the figure. The communication interface 903 is used to implement communication between the electronic device 900 and other devices. For example, the communication interface may be a transceiver.

[0209] In the foregoing embodiments provided in the present application, the method provided in the embodiments of the present application is introduced from the perspective of the electronic device (such as a mobile phone) as the execution subject. To implement each function in the method provided in the foregoing embodiments of the present application, the electronic device may include a hardware structure and / or a software module, and implement each of the above functions in the form of a hardware structure, a software module, or a combination of a hardware structure and a software module. Whether a certain function among the above functions is executed in the form of a hardware structure, a software module, or a combination of a hardware structure and a software module depends on the specific application and design constraints of the technical solution.

[0210] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)), etc. Without conflict, the solutions of the above embodiments can be combined and used.

[0211] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, system, or computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0212] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, and the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate a device for implementing the specified functions in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0213] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce a manufacture including an instruction device that implements the functions specified in one or more of the processes Figure 1 one or more processes and / or blocks Figure 1 specified in the block or blocks.

[0214] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, so that the instructions executed on the computer or other programmable apparatus provide steps for implementing the functions specified in one or more of the processes Figure 1 one or more processes and / or blocks Figure 1 specified in the block or blocks.

[0215] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to cover these changes and modifications.

Claims

1. A multimedia transmission method, characterized in that, Applicable to a first device, the first device being in a network - free state, the method includes: Receiving a first operation, the first operation being used to trigger sending multimedia to a second device; Sending N multimedia data streams to a satellite, the N multimedia data streams being data streams obtained by compressing the multimedia, N being a positive integer, the data volume of each data stream in the N multimedia data streams not exceeding a first threshold, the first threshold being less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams not exceeding a second threshold.

2. The method according to claim 1, characterized in that, The first multimedia data stream among the N multimedia data streams is carried and sent in a first message, the first multimedia data stream being one or more data streams among the N multimedia data streams, and the first message further includes at least one of the following: First indication information, used to indicate the type of the multimedia; Second indication information, used to indicate the size of the multimedia; Third indication information, used to indicate the identifier of the first device; Fourth indication information, used to indicate the identifier of the second device.

3. The method according to claim 1 or 2, characterized in that, The multimedia includes a first image, the N multimedia data streams respectively correspond to N feature information on the first image, and the sending order of the N multimedia data streams is determined according to the priority relationship of the N feature information.

4. The method according to claim 3, wherein Among the N multimedia data streams, there are a second multimedia data stream and a third multimedia data stream. When the following conditions are met, the sending time of the second multimedia data stream is earlier than that of the third multimedia data stream, and the conditions include: The feature information corresponding to the second multimedia data stream is used to describe the edge contour of an object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of the object in the first image; or, The feature information corresponding to the second multimedia data stream is used to describe a first object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe a second object in the first image, and the priority of the first object is higher than that of the second object.

5. The method according to any one of claims 1-4, characterized in that, The multimedia is a first image, and the N multimedia data streams are data streams obtained by compressing different regions of the first image with different compression ratios, so that the second image is obtained after decompressing the N multimedia data streams, and the clarity of different regions on the second image is different.

6. The method according to claim 5, wherein Before receiving the first operation, the method further includes: Receiving a second operation, the second operation being used to set the clarity of different regions on the first image.

7. The method according to claim 5 or 6, characterized in that, The method further includes: Displaying the second image.

8. The method according to claim 6, wherein The N multimedia data streams are data streams obtained by compressing the target region and non - target region on the first image with different compression ratios, the target region includes at least one of: a user - specified region, a region where a target object is located, and a region centered, and the non - target region is other regions other than the target region.

9. The method according to any one of claims 1-8, characterized in that, The method further includes: Receiving a return message from the satellite, the return message being used to indicate that the N multimedia data streams are sent successfully.

10. The method according to any one of claims 1-8, characterized in that, Sending N multimedia data streams to a satellite includes: Send M multimedia data streams to the satellite, where the M multimedia data streams are one or more of the N multimedia data streams, and M is a positive integer; When receiving the return message from the satellite, send the remaining N - M multimedia data streams to the satellite, where the return message is used to indicate that the M multimedia data streams are successfully sent.

11. A multimedia transmission method, characterized in that, Applicable to a second device, the method includes: Receive N multimedia data streams sent by the satellite, where N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold; Obtain multimedia based on the N multimedia data streams.

12. The method according to claim 11, wherein The first multimedia data stream in the N multimedia data streams is carried in a first message, where the first multimedia data stream is one or more data streams in the N multimedia data streams, and the first message further includes at least one of the following: First indication information for indicating the type of the multimedia; Second indication information for indicating the size of the multimedia; Third indication information for indicating the identifier of the first device; Fourth indication information for indicating the identifier of the second device.

13. The method according to claim 11 or 12, characterized in that, The multimedia is a first image, and the method further includes: Display the first image, where the clarity of different regions on the first image is different.

14. The method according to claim 11 or 12, characterized in that Obtaining multimedia based on the N multimedia data streams includes: Obtain a first image based on a second multimedia data stream in the N multimedia data streams, where the first image includes the edge contour of an object; Obtain a second image based on a third multimedia data stream in the N multimedia data streams and the first image, where the second image includes the details of the object, and the reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

15. The method according to claim 11 or 12, characterized in that, Obtaining multimedia based on the N multimedia data streams includes: Obtain a first image based on a second multimedia data stream in the N multimedia data streams, where the first image includes a first object; Obtain a second image based on a third multimedia data stream in the N multimedia data streams and the first image, where the second image includes the first object and a second object, and the reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

16. An electronic device, characterized in that, Includes: A processor, a memory, and one or more programs; Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to execute the method steps described in any one of claims 1 - 15.

17. A communication system, characterized in that, Includes: A first device, a second device, and a satellite, The first device is configured to execute the method steps described in any one of claims 1 - 10; The second device is configured to execute the method steps described in any one of claims 11 - 15.

18. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, which, when run on a computer, causes the computer to execute the method according to any one of claims 1 to 15.

Images