Multimedia transmission method and related equipment

Abstract

The invention discloses a multimedia transmission method and related equipment, which can realize multimedia transmission through satellites in an area which cannot be covered by a ground mobile communication network. For example, when a first device is in a network-free state, a first operation is received for triggering transmission of multimedia to a second device. The first device sends N multimedia data streams to the satellite, the N multimedia data streams are data streams obtained by compressing multimedia, N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, and the first threshold is smaller than or equal to the transmission bandwidth of the satellite; the total data volume of the N multimedia data streams does not exceed a second threshold.

Description

[0001] This application is a divisional application. The application number of the original application is 202410081118.5, and the original application date is January 19, 2024. The entire content of the original application is incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technologies, and in particular, to a multimedia transmission method and related devices. Background Art

[0003] Terrestrial mobile communication networks provide convenient services for people's lives. However, in areas such as the ocean, forests, or deserts, due to the difficulty of deploying terrestrial base stations, the coverage of terrestrial mobile communication networks is affected. Therefore, for groups such as ocean workers and wilderness explorers, once they encounter danger, they will be unable to send distress signals to the outside world due to no network (because terrestrial mobile communication networks cannot cover), resulting in missing the rescue time. Summary of the Invention

[0004] Embodiments of this application provide a multimedia transmission method and related devices, which can achieve the transmission of multimedia in areas where terrestrial mobile communication networks cannot cover.

[0005] In a first aspect, a multimedia transmission method is provided, which is applicable to a first device. For example, the first device may be a terminal device such as a mobile phone or a PC. The method includes: The first device is in a network - free state. The first device receives a first operation, and the first operation is used to trigger the sending of multimedia to a second device. The first device sends N multimedia data streams to a satellite. The N multimedia data streams are data streams obtained by compressing the multimedia. N is a positive integer, and the data volume of each data stream in the N multimedia data streams does not exceed a first threshold. The first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold.

[0006] In embodiments of this application, when the first device is in a network - free state, it can send multimedia, such as images, to other devices via a satellite. Moreover, the first device can compress the multimedia to obtain N multimedia data streams, and the data volume of each multimedia data stream does not exceed the transmission bandwidth of the satellite to ensure that each multimedia data stream can be sent successfully as much as possible. Moreover, embodiments of this application consider that if the number of multimedia data streams is too large (i.e., N is too large), it will take a long time to send the N multimedia data streams. To avoid too long a sending time, in embodiments of this application, the total data volume of the N multimedia data streams does not exceed a second threshold, so the number of N is not too large, and the sending duration is not too long, thus avoiding affecting the user experience.

[0007] In a possible design, the first multimedia data stream among the N multimedia data streams is sent in a first message. The first multimedia data stream is one or more of the N multimedia data streams. The first message further includes at least one of the following:

[0008] First indication information for indicating the type of the multimedia;

[0009] Second indication information for indicating the size of the multimedia;

[0010] Third indication information for indicating the identifier of the first device;

[0011] Fourth indication information for indicating the identifier of the second device.

[0012] In the embodiments of the present application, the first message can indicate the multimedia type, size, etc. Therefore, the receiving end can know the received multimedia type, size, etc. through the first message, so as to improve the accuracy of decompressing the multimedia data stream to obtain the multimedia at the receiving end.

[0013] In a possible design, the first multimedia data stream may include: any one or more of the N multimedia data streams, or the first multimedia data stream sent first among the N multimedia data streams, or the last multimedia data stream sent among the N multimedia data streams, or the multimedia data stream with the smallest data volume among the N multimedia data streams.

[0014] In a possible design, the multimedia includes a first image. The N multimedia data streams respectively correspond to N feature information on the first image. The sending order of the N multimedia data streams is determined according to the priority relationship of the N feature information.

[0015] In the embodiments of the present application, when the first device sends an image to the second device via satellite, it can first send the multimedia data stream corresponding to the feature information 1 on the image, and then send the multimedia data stream corresponding to the feature information 2. The priority of the feature information 1 is higher than that of the feature information 2. In this way, the peer first obtains the feature information 1 and can restore the content corresponding to the feature information 1 (such as the edge contour of an object on the image), and then receives the feature information 2 and restores the content corresponding to the feature information 2 (such as the details of an object on the image), realizing a gradual transmission of the image from blurred to clear.

[0016] In a possible design, the N multimedia data streams include a second multimedia data stream and a third multimedia data stream. When the following conditions are met, the transmission time of the second multimedia data stream is earlier than that of the third multimedia data stream. The conditions include: the feature information corresponding to the second multimedia data stream is used to describe the edge contour of the object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of the object in the first image; or, the feature information corresponding to the second multimedia data stream is used to describe the first object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the second object in the first image, and the priority of the first object is higher than that of the second object.

[0017] In the embodiments of the present application, since the second multimedia data stream is transmitted first, after the peer receives the second multimedia data stream, it can restore the general contour of the object in the image according to its feature information. In this way, even if the transmission of the third multimedia data stream fails, the peer can still know the general content of the image. Of course, if the transmission of the third multimedia data stream is successful, the peer can add details to the image according to its feature information to improve the clarity of the image. Or, since the second multimedia data stream is transmitted first, after the peer receives the second multimedia data stream, it can restore the first object in the image according to its feature information. In this way, even if the transmission of the third multimedia data stream fails, the peer can still know that the first object is included in the image. Of course, if the transmission of the third multimedia data stream is successful, the peer can restore the second object according to its feature information to improve the integrity of the image.

[0018] In a possible design, the second multimedia data stream or the third multimedia data stream may be the first multimedia data stream.

[0019] In a possible design, the multimedia is the first image, and the N multimedia data streams are data streams obtained by compressing different regions of the first image with different compression ratios, so that the second image is obtained after decompressing the N multimedia data streams, and the clarity of different regions on the second image is different.

[0020] It should be noted that if the image is large, a larger compression ratio is required to compress the image to ensure that the image can be transmitted successfully. For example, the total data volume of the compressed multimedia data stream does not exceed the second threshold. It should be understood that once the compression ratio is large, the clarity of the image will be very low, affecting the viewing of the receiving end. In the embodiments of the present application, under the condition that the total data volume of the compressed multimedia data stream does not exceed the second threshold, differential compression can be performed on different regions of the image. For example, some regions have a small compression ratio to ensure the clarity of these regions, and the compression ratio of other regions is larger to reduce the transmission data volume. In this way, the clarity of different regions on the image received by the receiving end is different.

[0021] In a possible design, before receiving the first operation, the method further includes: receiving a second operation for setting the clarity of different regions on the first image.

[0022] In the embodiments of the present application, when a user of a first device wants to send an image to a second device via a satellite, the user can set the clarity of different regions on the image. The first device performs differential compression on different regions of the image according to the user settings and sends it to the second device via the satellite. Therefore, the clarity of different regions on the image obtained by the second device is different. In this way, the user at the sending end can set the clarity of different regions according to their own needs. Suppose the user wants the other party to focus on a certain region, then the clarity of that region is set higher to ensure that after the receiving party receives the image, the content in that region can be seen clearly.

[0023] In a possible design, the second operation is used to set the clarity influence factor of different regions on the first image. The clarity influence factor can be understood as a parameter that can affect clarity. For example, the compression ratio affects clarity, then the second operation can be to set the compression ratio of different regions.

[0024] In a possible design, the method further includes: displaying the second image.

[0025] In the embodiments of the present application, when a user of a first device wants to send an image to a second device via a satellite, the user can set the clarity of different regions on the image, and the first device can display the clarity setting result (i.e., the second image) to facilitate the user to know the clarity setting result.

[0026] In a possible design, the N multimedia data streams are data streams obtained by compressing the target region and the non-target region on the first image using different compression ratios. The target region includes at least one of a user-specified region, a region where a target object is located, and a region centered. The non-target region is other regions outside the target region.

[0027] In the embodiments of the present application, differential compression can be performed on the target region and the non-target region on the image while ensuring that the total data volume of the compressed multimedia data stream does not exceed a second threshold. For example, the clarity of the target region is higher than that of the non-target region. In this way, the receiving party can clearly see the content in the target region and avoid the content in the target region from failing to be conveyed due to excessive compression of the target region.

[0028] In a possible design, the method further includes: receiving a return message from the satellite, where the return message is used to indicate that the N multimedia data streams are successfully sent.

[0029] In an embodiment of the present application, after the first device sends N multimedia data streams to the satellite, it can receive a receipt from the satellite to indicate successful transmission. The first device can output this receipt to prompt the user that the transmission is successful, enhancing the user experience.

[0030] In a possible design, sending N multimedia data streams to the satellite includes: sending M multimedia data streams to the satellite, where the M multimedia data streams are one or more of the N multimedia data streams, and M is a positive integer; when receiving the return message from the satellite, sending the remaining N - M multimedia data streams, and the return message is used to indicate that the M multimedia data streams are successfully sent.

[0031] In an embodiment of the present application, when the first device sends N multimedia data streams to the satellite, it can be sent in multiple times. Since it takes a certain amount of time to send N multimedia data streams, in order to ensure communication between the first device and the satellite during this period, the first device can first send a part of the multimedia data streams, and then wait for the satellite receipt. If the receipt is received, it means that communication with the satellite is maintained, and then other multimedia data streams can be sent, avoiding power consumption waste caused by the first device continuing to send multimedia data streams to the satellite when the communication between the first device and the satellite has been interrupted.

[0032] In a second aspect, a multimedia transmission method is further provided, and this method is applicable to a second device. Exemplarily, the second device can be a terminal device such as a mobile phone or a PC. The method includes: the second device receives N multimedia data streams sent by the satellite, where N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold. The second device obtains multimedia based on the N multimedia data streams.

[0033] In a possible design, the first multimedia data stream among the N multimedia data streams is carried in a first message, the first multimedia data stream is one or more data streams among the N multimedia data streams, and the first message further includes at least one of the following:

[0034] First indication information, used to indicate the type of the multimedia;

[0035] Second indication information, used to indicate the size of the multimedia;

[0036] Third indication information, used to indicate the identifier of the first device;

[0037] Fourth indication information, used to indicate the identifier of the second device.

[0038] In a possible design, the first multimedia data stream may include any one or more of the N multimedia data streams, or the first received multimedia data stream among the N multimedia data streams, or the last received multimedia data stream among the N multimedia data streams, or the multimedia data stream with the smallest data volume among the N multimedia data streams.

[0039] In a possible design, the multimedia is a first image, and the method further includes: displaying the first image, where the clarity of different regions on the first image is different.

[0040] In a possible design, obtaining multimedia based on the N multimedia data streams includes: obtaining a first image based on a second multimedia data stream among the N multimedia data streams, where the first image includes the edge contour of an object; and obtaining a second image based on a third multimedia data stream among the N multimedia data streams and the first image, where the second image includes details of the object, and the reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

[0041] In the embodiments of the present application, since the second multimedia data stream is received first, the second device can restore the approximate contour of the object in the image according to its characteristic information. In this way, even if the third multimedia data stream is not received, the general content of the image can be known. Of course, if the third multimedia data stream is received, details can be added to the image according to its characteristic information to improve the clarity of the image.

[0042] In a possible design, obtaining multimedia based on the N multimedia data streams includes: obtaining a first image based on a second multimedia data stream among the N multimedia data streams, where the first image includes a first object; and obtaining a second image based on a third multimedia data stream among the N multimedia data streams and the first image, where the second image includes the first object and a second object, and the reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

[0043] In the embodiments of the present application, since the second multimedia data stream is sent first, after receiving the second multimedia data stream, the second device can restore the first object in the image according to its characteristic information. In this way, even if the third multimedia data stream is not received, it can be known that the image includes the first object. Of course, if the third multimedia data stream is received, the second object can be restored according to its characteristic information to improve the integrity of the image.

[0044] In a third aspect, a communication system is further provided, including: a first device, a second device, and a satellite;

[0045] A first device for performing the method steps described in the first aspect above;

[0046] A second device for performing the method steps described in the second aspect above.

[0047] In a fourth aspect, an electronic device is further provided, including:

[0048] A processor, a memory, and one or more programs;

[0049] Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the method provided in the first aspect or the second aspect above.

[0050] In a fifth aspect, a computer-readable storage medium is further provided, and the computer-readable storage medium is used to store a computer program, and when the computer program runs on a computer, the computer is caused to perform the method provided in the first aspect or the second aspect above.

[0051] In a sixth aspect, a computer program product is further provided, including a computer program, and when the computer program runs on a computer, the computer is caused to perform the method provided in the first aspect or the second aspect above.

[0052] In a seventh aspect, a chip is further provided, and the chip is coupled to a memory in an electronic device for calling a computer program stored in the memory and executing the technical solution provided in the first aspect or the second aspect of the embodiments of the present application. In the embodiments of the present application, "coupling" means that two components are directly or indirectly combined with each other.

[0053] For the technical effects that can be achieved in the second aspect to the seventh aspect above, please refer to the description of the technical effects that can be achieved in the corresponding design solutions in the first aspect above, and the present application will not repeat them here. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 A schematic diagram of a communication system provided in an embodiment of the present application;

[0055] Figure 2A And Figure 2B A schematic diagram of mobile phone A sending an image to mobile phone B via a satellite provided in an embodiment of the present application;

[0056] Figure 3 A schematic flow diagram of a multimedia transmission method provided in an embodiment of the present application;

[0057] Figure 4 Another schematic diagram of a communication system provided in an embodiment of the present application;

[0058] Figures 5A to 5C Schematic diagram of a message sent by mobile phone A provided in an embodiment of the present application;

[0059] Figure 6 Schematic diagram of an image received by mobile phone B provided in an embodiment of the present application;

[0060] Figure 7A Schematic diagram of mobile phone A dividing an image into regions provided in an embodiment of the present application;

[0061] Figure 7B Schematic diagram of mobile phone A sending images with different clarity levels to mobile phone B provided in an embodiment of the present application;

[0062] Figure 7C Schematic diagram of mobile phone A setting the clarity of different regions on an image provided in an embodiment of the present application;

[0063] Figure 8 Schematic diagram of an electronic device provided in an embodiment of the present application;

[0064] Figure 9 Another schematic diagram of an electronic device provided in an embodiment of the present application. Detailed implementation manners

[0065] Hereinafter, some terms in the embodiments of the present application will be explained to facilitate the understanding of those skilled in the art.

[0066] (1) At least one involved in the embodiments of the present application includes one or more; among them, multiple means greater than or equal to two. In addition, it should be understood that in the description of this specification, terms such as "first", "second", "third", etc. are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying order. For example, the first device and the second device do not represent the importance level of the two or the order of the two, but are only for distinguishing descriptions. In the embodiments of the present application, "and / or" only describes the association relationship and indicates that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in this article generally represents an "or" relationship between the associated objects before and after.

[0067] (2) The orientation terms mentioned in the embodiments of the present application, such as "up", "down", "left", "right", "inside", "outside", etc., are only references to the directions in the drawings. Therefore, the orientation terms used are for better and clearer explanation and understanding of the embodiments of the present application, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the embodiments of the present application.

[0068] (3) As described in the embodiments of the present application, references to "one embodiment", "in some examples", or "some embodiments", etc. mean that specific features, structures, or characteristics described in connection with that embodiment are included in one or more embodiments of this specification. Thus, statements such as "in some examples", "in one embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification do not necessarily all refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "comprising", "including", "having", and their variants all mean "including but not limited to", unless otherwise specifically emphasized.

[0069] (4) The multimedia involved in the embodiments of the present application may include various media such as images, videos, audios, gifs, emoji, etc.

[0070] As mentioned above, in areas such as the ocean, forest, or desert, due to the difficulty in deploying ground base stations, the ground mobile communication network cannot cover these areas. Therefore, one solution is that in these areas (i.e., areas where the ground mobile communication network cannot cover), communication can be carried out through non-terrestrial networks (NTN). Exemplarily, NTN may include satellites, high-altitude platforms, drones, ships, vehicles, etc. Taking satellites as an example, that is, users in areas such as the ocean, forest, or desert can communicate with the outside world through satellites, which is very helpful for groups such as ocean workers and outdoor explorers.

[0071] For example, please refer to Figure 1 which is a schematic diagram of a communication system provided by an embodiment of the present application. As Figure 1 shown, the communication system includes a first device, a second device, and a satellite. The first device and the second device can communicate through the satellite. It should be noted that the embodiments of the present application do not limit the type of the satellite. For example, the satellite can be a low earth orbit (LEO) satellite. Of course, it can also be a high earth orbit (HEO) satellite. Exemplarily, the satellite can be a Beidou satellite or other satellites.

[0072] It should be noted that Figure 1In the following, both the first device and the second device are taken as mobile phones as an example. For example, the first device is mobile phone A and the second device is mobile phone B. It can be understood that, in addition to mobile phones, the first device and the second device can also be other types of devices. For example, the first device can also be a Personal Computer (PC). Optionally, the PC can include tablet computers, laptop computers, desktop computers, etc. Or, the first device can also be a wearable device such as a watch or a bracelet; or, it can also be a smart home device such as a television or a refrigerator; or, it can also be a means of transportation, such as various types of vehicles, trains, aircraft, etc.; or, it can also be an in-vehicle device. For example, the in-vehicle device can be an intelligent cockpit, each system in the intelligent cockpit, such as the In-Vehicle Infotainment (IVI) system or other in-vehicle devices, such as the Vehicle Domain Controller (VDC), Cockpit Domain Controller (CDC), ADAS / AD Domain Controller (ADC), Mobile Data Center (MDC), and so on. Or, the first device can also be a Virtual Reality (VR) device, Augmented Reality (AR) device, Mixed Reality (MR) device, etc. Similarly, the second device can also be a PC; or, it can also be a wearable device such as a watch or a bracelet; or, it can also be a smart home device such as a television or a refrigerator; or, it can also be a means of transportation; or, it can also be an in-vehicle device; or, it can also be a VR device, AR device, MR device, etc. In short, the embodiments of the present application do not limit the types of the first device and the second device. The first device and the second device can be devices of the same type. For example, both the first device and the second device are mobile phones; or, the first device and the second device can also be devices of different types. For example, the first device is a mobile phone and the second device is a PC. In this article, the case where both the first device and the second device are mobile phones is mainly used as an example for illustration.

[0073] In addition, although Figure 1Only three devices are shown, namely the first device, the second device, and the satellite. In fact, there may be more devices. For example, a ground station, a server, etc. may also be included between the satellite and the second device. For example, the first device sends information to the satellite, and the information includes the recipient identifier (e.g., the recipient's phone number). After receiving the information, the satellite sends the information to the ground station. The ground station determines the corresponding server according to the recipient identifier in the information, and then sends the information to the server. For example, if the recipient number is a Chengdu number 185XXXXXXXX, the ground station can send the information to the server in Chengdu, and the server sends the information to the second device, and the number of the second device is the recipient's number.

[0074] Continue below with Figure 1 as an example, and with Figure 1 the example of mobile phone A sending information to mobile phone B via a satellite, to illustrate the communication process between mobile phone A and mobile phone B.

[0075] In some examples, when mobile phone A is in a no-network state, it can send information to the outside world via a satellite. Optionally, the no-network state may include: mobile phone A is not connected to any network (e.g., not connected to wifi, 4G, or 5G mobile data network), and the SIM card of mobile phone A has no signal. Optionally, when mobile phone A is in a no-network state, a prompt message may be displayed on the display screen. For example, "No service" is displayed in the status bar. Of course, in some other examples, when mobile phone A is in a networked state, it can also send information to the outside world via a satellite, which is not limited in the embodiments of the present application.

[0076] In some embodiments, the transmission resources (e.g., bandwidth) provided by the satellite are very small. To ensure the successful transmission of information, mobile phone A can only send a small amount of information. For example, the data volume of text information (e.g., text messages) is small, so mobile phone A can send text information to mobile phone B via the satellite. For example, mobile phone A sends the text "There is danger ahead" to mobile phone B via the satellite. However, in actual use, the editing process of text information is rather cumbersome, and text information cannot accurately and intuitively describe the current actual situation. For example, it is impossible to accurately describe the special environmental features in the wild, the insect features in the forest, etc. through text information.

[0077] To this end, an embodiment of the present application provides a multimedia transmission method. In this method, mobile phone A can send multimedia to mobile phone B via a satellite. Optionally, the multimedia may include images, videos, audios, animated graphics, emoticons, etc. Therefore, through the technical solution of the embodiment of the present application, on the one hand, since not too many text editing operations are required, the convenience is improved. On the other hand, the current actual situation can be accurately and intuitively described through multimedia. As mentioned above, the bandwidth of the transmission channel of the satellite is very small, while the data volume of the multimedia is large. To ensure the successful sending of the multimedia, in the embodiment of the present application, mobile phone A can compress the multimedia to generate a multimedia data stream. The data volume of the multimedia data stream obtained after compression is small and can be sent to mobile phone B via the satellite.

[0078] In the following, taking the multimedia as an image as an example, in combination with Figure 2A and Figure 2B the operation process of mobile phone A sending an image to mobile phone B via the satellite will be described.

[0079] As Figure 2A (a), the display interface 110 of mobile phone A is shown. In the status bar of interface 110, "No service" is displayed, which is used to indicate that mobile phone A is currently in a network-free state. Refer to the previous description for details. Interface 110 can be the interface of an instant messaging application (for example, the Huawei Changlian application) in mobile phone A. Interface 110 may include an option for satellite messages. When mobile phone A receives an operation (such as a click operation) on the option for satellite messages, the interface 120 as shown in Figure 2A (b) can be displayed. The interface 120 includes a button for creating a new message. When mobile phone A receives an operation on the button for creating a new message, the interface 130 as shown in Figure 2A (c) can be displayed. The user of mobile phone A can select the recipient in interface 130. For example, the selected recipient is user B. The user of mobile phone A can also edit or select the content to be sent in interface 130. For example, Figure 2A in (c), when mobile phone A receives the operation of the user clicking the button "+○", the album button is displayed. When mobile phone A receives an operation on the album button, the interface 140 as shown in Figure 2A (d) can be displayed. The interface 140 includes thumbnails (or called preview images) of each image in the gallery. Assume that mobile phone A detects that the first thumbnail is selected (such as a single click selection), and mobile phone A receives an operation on the send button, then the interface 150 as shown in Figure 2A (e) can be displayed. The interface 150 includes a prompt message: Please adjust the direction of the mobile phone to align with the satellite. The user can adjust the direction of the mobile phone to align with the satellite. When the mobile phone detects alignment with the satellite, the interface as shown in Figure 2AThe interface 160 shown in (f). The interface 160 includes a prompt message: Sending, please stay still. In the embodiment of the present application, mobile phone A can compress the selected image to generate a multimedia data stream. Since the data volume of the multimedia data stream is small, mobile phone A can send the multimedia data stream to mobile phone B via satellite. After successful sending, mobile phone A can display as Figure 2A the interface 170 shown in (g). The interface 170 includes a prompt message: Sent. Optionally, the interface 170 can also display a prompt message for receiving the satellite receipt. After that, the mobile phone can display as Figure 2A the interface 180 shown in (h). The interface 180 includes the content sent to user B.

[0080] Figure 2A In (d), taking the user selecting the first image as an example, it can be understood that the user may also select other images, such as the second, the third, and so on. The data volume of the images selected by the user is not necessarily the same. The user may select an image of 10M or an image of 20M. In the embodiment of the present application, regardless of the data volume of the image selected by the user, mobile phone A can compress the image into a multimedia data stream with a data volume less than or equal to the target value (for example, 800B or 1KB) (the specific implementation process will be described later) to ensure that the image can be successfully sent to the peer via satellite.

[0081] As Figure 2B (a), it is the interface 190 of the instant messaging application (such as the Huawei Changlian application) in mobile phone B. The option of satellite message is displayed in the interface 190. Optionally, a prompt message can also be displayed in the interface 190 to prompt that there is a new satellite message, such as symbol ①. When mobile phone B receives an operation on the option of satellite message, it can display as Figure 2B the interface 1100 shown in (b). The interface 1100 includes a thumbnail (or called preview image) of the image sent by mobile phone A. When mobile phone B receives an operation on the thumbnail, it can display as Figure 2B the interface 1200 shown in (c). The interface 1200 includes the image sent by mobile phone A.

[0082] It should be noted that Figure 2A and Figure 2B take mobile phone A sending an image to mobile phone B via satellite as an example. Of course, mobile phone A can also send other multimedia such as videos, animated pictures, and emoticons to mobile phone B via satellite. The specific operation process is similar and will not be exemplified one by one.

[0083] The following describes the implementation principle of mobile phone A sending an image to mobile phone B via satellite. It should be noted that although the following takes sending an image as an example, the implementation principle is the same for other multimedia such as videos, animated pictures, and emoticons.

[0084] Please refer to Figure 3 , which is a schematic flowchart of a multimedia transmission method provided in an embodiment of this application. This method can be applicable to Figure 1 a communication system, and can also be applicable to Figure 2A and Figure 2B scenarios. As shown in Figure 3 , the process may include:

[0085] S300, mobile phone A is currently in a network - free state. Regarding the network - free state, please refer to the previous description.

[0086] S301, mobile phone A receives a first operation, and the first operation is used to trigger sending an image to mobile phone B. Taking Figure 2A (d) as an example, the first operation can be an operation on the send button (for example, a click operation).

[0087] S302, mobile phone A determines the target file size.

[0088] Exemplarily, the target file size can be 1KB, 800B, 600B, etc., and the specific value is not limited in the embodiments of this application. The target file size is used to indicate that the multimedia to be sent to the satellite needs to be compressed to be less than or equal to the target file size.

[0089] In some embodiments, the target file size is pre - configured. For example, mobile phone A stores the target file size when it leaves the factory. Or, the target file size is specified in the communication protocol between mobile phone A and the satellite. Or, the target file size can also be indicated by the satellite to mobile phone A. For example, the satellite sends configuration information to mobile phone A, and the configuration information includes the target file size.

[0090] In some examples, for different types of multimedia, the target file size can be different. For example, when the multimedia is an image, the target file size is 800B; when the multimedia is a video, the target file size is 1KB.

[0091] S303, mobile phone A compresses the image to generate a multimedia data stream, and the data volume of the multimedia data stream is less than or equal to the target file size.

[0092] Optionally, there are various image compression methods. For example, compression can be performed through an encoding method. Optionally, the encoding method can include lossy encoding, lossless encoding, orthogonal transform encoding, etc., which are not limited in the embodiments of this application. Or, compression can also be achieved through feature extraction. Optionally, feature extraction can be implemented through a convolutional neural network, which is not elaborated in the embodiments of this application. Exemplarily, please refer to Figure 4, Mobile phone A includes a compression framework, which is used to compress multimedia (such as images) to a target file size. For example, the compression framework includes a convolutional neural network, an encoding module, and a control module. When an image is input into the compression framework, the convolutional neural network extracts feature information from the image, and the extracted feature information is encoded by the encoding module. The encoding module can encode the feature information into a multimedia data stream according to the target file size provided by the control module, and the data volume of the multimedia data stream is less than or equal to the target file size. That is to say, no matter how large the data volume of the multimedia input into the compression framework is, the data volume of the multimedia data stream output after passing through the compression framework is less than or equal to the target file size (for example, 800B).

[0093] S304, Mobile phone A sends the multimedia data stream to the satellite.

[0094] In some examples, mobile phone A can send the entire multimedia data stream to the satellite at one time. For example, when the bandwidth of the satellite is sufficient, the entire multimedia data stream can be sent to the satellite.

[0095] In other examples, the multimedia data stream can be sent in multiple times. For example, the multimedia data stream can be split into N data packets, where N is an integer greater than or equal to 2, and each data packet includes a segment of the data stream in the multimedia data stream. The N data packets are sent in N times. Optionally, the number of data packets N into which the multimedia data stream is split can be determined according to the transmission bandwidth of the satellite. For example, if the total amount of the multimedia data stream is 800B and the transmission bandwidth is 100B, it is split into 8 data packets.

[0096] In some examples, the sending order of the 8 data packets can be determined according to the priority relationship of the 8 data packets. For example, each data packet corresponds to different feature information in the image, and the priority relationship of the data packets can be determined according to the priority of the feature information corresponding to the data packets. For example, among the 8 data packets, data packets 1 to 4 correspond to feature information 1 in the image, and data packets 5 to 8 correspond to feature information 2 in the image. If the priority of feature information 1 is higher than that of feature information 2, then data packets 1 to 4 are sent first (the sending order of the 4 data packets is not limited), and data packets 5 to 8 are sent later (the sending order of the 4 data packets is not limited).

[0097] Optionally, the priority of feature information 1 is higher than that of feature information 2, which may include: feature information 1 is used to describe the edge contour of an object in the image, and feature information 2 is used to describe the details of the object in the image. The details may include the color, brightness, etc. of the object. In this way, since data packets 1 to 4 are sent first, after the peer end (i.e., mobile phone B) receives data packets 1 to 4, it can restore the general contour of the object in the image according to feature information 1. In this case, even if the transmission of data packets 5 to 4 fails, the peer end (i.e., mobile phone B) can still know the general content of the image. Of course, if the transmission of data packets 5 to 4 is successful, the peer end (i.e., mobile phone B) can add details to the image according to feature information 2 to improve the clarity of the image.

[0098] Optionally, the priority of feature information 1 is higher than that of feature information 2, which may include: feature information 1 is used to describe object 1 in the image, and feature information 2 is used to describe object 2 in the image, and the priority of object 1 is higher than that of object 2. In this way, since data packets 1 to 4 are sent first, after the peer end (i.e., mobile phone B) receives data packets 1 to 4, it can restore object 1 in the image according to these four data packets. In this case, even if the transmission of data packets 5 to 4 fails, the peer end (i.e., mobile phone B) can still know that object 1 is included in the image. Of course, if the transmission of data packets 5 to 4 is successful, the peer end (i.e., mobile phone B) can restore object 2 according to these four data packets to improve the integrity of the image. Optionally, the priority of object 1 being higher than that of object 2 may include at least one of the following: object 1 is a foreground object and object 2 is a background object; or, object 1 is a person and object 2 is not a person; or, the area occupied by object 1 in the image is larger than the area occupied by object 2 in the image; or, the position of object 1 in the image is centered and the position of object 2 in the image is close to the edge, etc.

[0099] In the above example, the multimedia data stream is split into 8 data packets and sent separately. In some examples, it takes a certain amount of time to send 8 data packets. To ensure that mobile phone A maintains communication with the satellite within this time period, every 4 data packets are taken as a group. After the satellite receives a group of data packets, it can return a receipt to mobile phone A to indicate that mobile phone A and the satellite are currently in a communication state. For example, after mobile phone A sends a group of data packets, it can wait for the receipt from the satellite. If it receives the receipt, it continues to send the next group of data packets. If it does not receive the receipt, it determines that the communication with the satellite is interrupted and may not need to continue sending the next group of data packets or resend the previous group of data packets. It should be noted that taking 4 data packets as a group is used as an example above, and it can also be more or fewer data packets as a group. The number of data packets in each group can be pre-configured, for example, it can be specified by the protocol or indicated by the base station. The embodiments of the present application do not make any limitations.

[0100] S305, the satellite sends a multimedia data stream to mobile phone B.

[0101] S306, the satellite sends a receipt to mobile phone A to indicate that the multimedia data stream has been successfully sent.

[0102] Optionally, S306 may or may not be executed, which is not limited in the embodiments of this application.

[0103] S307, mobile phone B decompresses the multimedia data stream to obtain multimedia.

[0104] For example, please refer to Figure 4 , mobile phone B includes a decompression module for decompressing the multimedia data stream. The decompression module includes a deconvolution neural network and a decoding module. The decoding module is used to decode the multimedia data stream to obtain the feature information of the image, and then processes the feature information through the deconvolution neural network to obtain the image.

[0105] S308, mobile phone B displays the image.

[0106] Optionally, the execution order of S306, S307, and S308 is not limited in the embodiments of this application.

[0107] As mentioned above, the multimedia data stream can be sent all at once or in multiple times. Taking sending all at once as an example, the multimedia data stream can be carried in a single message. Taking message 1 as an example, optionally, in addition to the multimedia data stream, message 1 may further include at least one of the following information:

[0108] (1) The first indication information for indicating the type of multimedia. For example, when the first indication information is 00, it is used to indicate that the multimedia is an image; when the first indication information is 01, it is used to indicate that the multimedia is a video; when the first indication information is 10, it is used to indicate that the multimedia is an emoji.

[0109] (2) The second indication information for indicating the size of the multimedia. The size may include dimensions and / or length. Taking the multimedia as an image as an example, the size of the image may include the dimensions of the image, such as the height H and width W of the image. Taking the multimedia as a video as an example, the size of the video may include the dimensions of the video, such as the height H and width W of the image, and may also include the length of the video, such as the duration of the video. Taking the multimedia as an audio as an example, the size of the audio may include the length of the audio, such as the duration of the audio.

[0110] (3) The third indication information for indicating the identity of the recipient (i.e., mobile phone B). Optionally, the recipient identity may include the recipient's number (e.g., phone number). Optionally, the recipient identity may also include the number of recipients. Taking the previous Figure 2A (c) as an example, user A may Figure 2ASelect one or more recipients in the interface of (c). Assuming one recipient is selected, the number of recipients is 1, and the number is the phone number of this recipient.

[0111] (4) The fourth indication information is used to indicate the sender (i.e., mobile phone A) identification. Optionally, the sender identification may include the sender's number (e.g., phone number).

[0112] As an example, please refer to Figure 5A , which is a schematic diagram of Message 1. As Figure 5A , Message 1 includes three fields. The first field occupies X bits and includes the third indication information. As described above, the third indication information is used to indicate the recipient's identification. The second field occupies Y bits and includes the first indication information. As described above, the first indication information is used to indicate the multimedia type. The third field occupies Z bits and includes the multimedia data stream. It should be noted that in actual applications, Message 1 may include more or fewer fields than Figure 5A . The embodiments of the present application do not make limitations. In addition, Figure 5A takes the example that the recipient identification in Message 1 is in the front field, the multimedia type is in the middle field, and the multimedia data stream is in the back field. In actual applications, it can also be other layouts. For example, the recipient identification is in the front field, the multimedia data stream is in the middle field, and the multimedia type is in the back field, and so on.

[0113] Considering that the multimedia sent by mobile phone A to the satellite can also be emoji, animated pictures, etc. Taking emoji as an example, in order to improve the transmission efficiency, a possible situation is that some emoji are pre-stored in the satellite. If mobile phone A needs to send a certain emoji to the satellite, it only needs to send the identification of the emoji to the satellite, and there is no need to send the multimedia of the emoji, and the transmission volume is greatly reduced. Therefore, as another example, please refer to Figure 5B , which is another schematic diagram of Message 1. The difference from Figure 5A is that Figure 5B in Message 1 includes a reserved field of P bits. The reserved field is used when sending special multimedia (e.g., emoji or animated pictures). Taking the previous Figure 2A (c) as an example, Figure 2A in the interface of (c), emoji can be displayed. These emoji can be pre-stored in the satellite. If the user selects one of the emoji, mobile phone A can send the identification of the emoji to the satellite. In this case, Figure 5B in Message 1, the multimedia type in the second field can be 10, which is used to indicate that the multimedia is an emoji. The reserved field in Message 1 can be the identification of the emoji. It should be understood that in this case, the multimedia data stream in the third field of Message 1 is empty because there is no need to transmit the emoji.

[0114] Taking the example where a multimedia data stream is split into N data packets and sent in N parts, each data packet is carried and sent in an independent message, that is, N data packets are sent through N messages. Taking N = 8 as an example, that is, the multimedia data stream is split into 8 data packets. Please refer to Figure 5C , mobile phone A sequentially sends 8 messages to the satellite, namely message 1 to message 8. Among them, data packet 1 is included in message 1, data packet 2 is included in message 2, and so on. As Figure 5C , since message 1 contains indication information such as the recipient identifier and multimedia type, these indication information may not be included in messages 2 to 8 to reduce the transmission volume.

[0115] In the previous text Figure 2A (d), the user selects image 1000, and mobile phone A compresses the image 1000 into a multimedia data stream and sends it to mobile phone B. Mobile phone B obtains image 1300 through decompression, as Figure 2B (c). Figure 2B (c), the clarity of each area in image 1300 is the same. This is because, Figure 2A (d), when mobile phone A receives an operation on the send button, it compresses each area on image 1000 with the same compression ratio to obtain a multimedia data stream. Therefore, the clarity of each area in the image 1300 obtained by mobile phone B through decompressing the multimedia data stream is the same.

[0116] In some other examples, in the previous text Figure 2A (d), when mobile phone A receives an operation on the send button, it compresses each area on image 1000 with different compression ratios to obtain a multimedia data stream, so that the clarity of each area in the image 1300 obtained by mobile phone B through decompressing the multimedia data stream is different. For example, please refer to Figure 6 (a), which is the interface of an instant messaging application (such as Huawei Chat) in mobile phone B. An option for satellite messages is displayed in this interface. When mobile phone B receives an operation on the option for satellite messages, it can display an interface such as Figure 6 (b). This interface includes a thumbnail (or preview image) of the image sent by mobile phone A. When mobile phone B receives an operation on the thumbnail, it can display an interface such as Figure 6 (c). This interface includes image 1300 sent by mobile phone A. The clarity of different areas in image 1300 is different.

[0117] As mentioned in the above example, Figure 2AIn (d), when mobile phone A receives an operation on the send button, it compresses each region on image 1000 using different compression ratios to obtain a multimedia data stream. It can be understood that before compressing each region on image 1000 using different compression ratios, the image 1000 can be divided into different regions first. Optionally, the region division can be automatically performed by mobile phone A or manually by the user.

[0118] Taking automatic division as an example. That is to say, Figure 2A In (d), after mobile phone A receives an operation on the send button, it automatically divides image 1000 into different regions, and then compresses different regions using different compression ratios and sends them to mobile phone B. For example, mobile phone A can automatically identify the target object on image 1000, and then divide the region where the target object is located and the regions where other objects are located into different regions. The target object can be an object centered in the position of image 1000, an object with a larger area, an object with a higher priority, etc. Optionally, the priority relationship of different objects can be stored in mobile phone A, and the priority relationship includes, for example, person > animal > plant. When mobile phone A determines that there are multiple objects in the image, it can determine which object has the highest priority according to this priority relationship.

[0119] Taking manual division by the user as an example. Continuing with the previous Figure 2A (d) as an example, when mobile phone A receives an operation on the first thumbnail (for example, a double-click operation), it can display an interface such as Figure 7A (a), and this interface includes image 1000. The user can manually divide regions on image 1000. For example, Figure 7A in (a), after mobile phone A receives a circle-drawing operation (represented by a dashed line in the figure), it divides the region inside the circle and the region outside the circle into different regions. Optionally, if the mobile phone receives an operation on the confirm button, it can return to the Figure 2A (d) interface. After the user clicks the send button in this interface, the mobile phone compresses the regions divided by the user using different compression ratios and then sends them to mobile phone B. Figure 7A In (a), if the mobile phone receives an operation on the return button, it can re-divide the regions.

[0120] Or, continuing with the previous Figure 2A (d) as an example, when mobile phone A receives an operation on the first thumbnail (for example, a double-click operation), it can display an interface such as Figure 7AThe interface of (b), which includes the image 1000, and there is a dashed box on the image 1000 (i.e., the dashed box appears automatically). The area inside the dashed box and the area outside the dashed box are divided into different regions. Optionally, the dashed box can be located in the middle of the image or at any position. Or, mobile phone A can identify the target object and then display the dashed box at the position where the target object is located. For the identification of the target object, please refer to the previous text. It can be understood that considering that after the dashed box appears automatically, the area enclosed by the dashed box may not meet the user's requirements. Therefore, the user can also adjust the position, area, etc. of the dashed box to re-divide the region.

[0121] Continue with the previous text Figure 2A Taking (d) as an example, when mobile phone A receives an operation on the first thumbnail (for example, a double-click operation), it can display an interface such as Figure 7A (c). This interface includes the image 1000, and the slashes filled in the area where the target object (for example, a tree) is located on the image 1000 (or other colors or others can also be filled), indicating that the target object is compressed with a different compression ratio from other objects. Of course, the user can replace the target object. For example, Figure 7A In (c), when mobile phone A receives a click operation on the image 1000 and determines that the click operation is within the area where the object "sun" is located, the target object is replaced with "sun", and slashes are filled in the area where the sun is located, indicating that the sun is compressed with a different compression ratio from other objects.

[0122] The above are several ways to divide the region of the image. It can be understood that there can be other division methods, and the embodiments of the present application will not list them one by one.

[0123] Taking Figure 7A (b) as an example, mobile phone A divides the image 1000 into two regions. In the embodiments of the present application, mobile phone A can perform differential compression on these two regions to obtain a multimedia data stream, so that mobile phone B can obtain an image with different clarity in different regions by decompressing the multimedia data stream. The following describes Figure 7A the differential compression process of the two regions in (b).

[0124] For example, please refer to Figure 7B , the image 1000 is divided into two image blocks, image block 1 and image block 2. Mobile phone A compresses image block 1 with compression ratio 1 to obtain multimedia data stream 1. Mobile phone A compresses image block 2 with compression ratio 2 to obtain multimedia data stream 2. Compression ratio 2 is different from compression ratio 1. For example, compression ratio 2 is higher than compression ratio 1. Moreover, the total data volume of multimedia data stream 1 and multimedia data stream 2 is less than or equal to the target file size, such as 800B.

[0125] Continue as Figure 7B, after receiving Multimedia Data Stream 1 and Multimedia Data Stream 2, mobile phone B can decompress Multimedia Data Stream 1 and Multimedia Data Stream 2 respectively to obtain two image blocks, namely Image Block 1 and Image Block 2. Mobile phone B combines these two image blocks into one image, and the clarity of different regions on this image is different. It can be understood that when mobile phone B combines two image blocks into one image, it needs to use the positional relationship between these two image blocks. A possible way is that mobile phone A sends the positional relationship between these two image blocks to mobile phone B. Optionally, the positional relationship can be located in any field of Message 1 in the foregoing text, and the embodiments of the present application do not make limitations.

[0126] In the above embodiment, different regions are compressed using different compression ratios. For example, Figure 7B in, Image Block 1 is compressed using Compression Ratio 1, and Image Block 2 is compressed using Compression Ratio 2. In some examples, mobile phone A can set different compression ratios for different regions by itself, as long as it is ensured that the clarity of different regions on the compressed image is different and the amount of image data after compression does not exceed the target file size. For example, Figure 7B in, mobile phone A can set a smaller compression ratio for Image Block 1 and a larger compression ratio for Image Block 2 by itself, so that Image Block 1 in the image obtained by mobile phone B is clearer.

[0127] In other examples, the compression ratios of different regions can be set manually by the user.

[0128] For example, continuing with the foregoing Figure 2A (d) as an example, when mobile phone A receives an operation on the first thumbnail (for example, a double-click operation), it can display an interface such as Figure 7C (a), and Image 1300 is displayed in this interface. Image 1300 is an image obtained by compressing all regions on Image 1000 using the same compression ratio, so the clarity of each region on Image 1300 is the same. A progress bar is also displayed on mobile phone A, and the progress bar includes an icon (for example, a black dot). By default, the icon is located in the middle of the progress bar, representing that the clarity of each region on the image is the same, that is, the compression ratio of each region is the same.

[0129] For ease of understanding, assume that the original file size of the original image, that is, Image 1000, is 20M in total, and the original file size of Image Block 1 is 5M, and the original file size of Image Block 2 is 15M.

[0130] Figure 7C (a), the compression ratio 1 of Image Block 1 can be 5M / X, where X represents the file size after Image Block 1 is compressed.

[0131] Figure 7CIn (a), the compression ratio 2 of image block 2 can be 15M / Y, where Y represents the file size of image block 2 after compression, and X + Y equals the target file size (e.g., 800B). Therefore, the total file size of the two compressed image blocks does not exceed the target file size.

[0132] Figure 7C In (a), when the user drags the icon to the left, as Figure 7C in (b), the compression ratio 1 of image block 1 is increased, and the compression ratio 2 of image block 2 is decreased, so image block 1 is blurrier than image block 2.

[0133] Figure 7C In (b), the compression ratio 1 of image block 1 can be 5M / X’, where X’ represents the file size of image block 1 after compression. Compared with Figure 7C (a), X’ is less than X. It can be understood that the total target file size is 800B, but the file size X allocated to image block 1 is reduced, so the compression ratio 1 increases, and thus image block 1 is Figure 7C blurrier than (a).

[0134] Figure 7C In (b), the compression ratio 2 of image block 2 can be 15M / Y’, where Y’ represents the file size of image block 2 after compression. Compared with Figure 7C (a), Y’ is greater than Y. This is because the total target file size is 800B, and the file size X allocated to image block 1 is reduced, so the file size Y allocated to image block 2 becomes larger, and thus the compression ratio 2 decreases, and image block 2 is Figure 7C clearer than (a). X’ + Y’ equals the target file size (e.g., 800B), that is, the file size of the two compressed image blocks does not exceed the target file size.

[0135] It can be understood that Figure 7C in (b), if the mobile phone receives an operation on the confirmation button, it can return to the Figure 2A interface of (d). In this interface, after the user clicks the send button, the mobile phone compresses the area divided by the user with different compression ratios and then sends it to mobile phone B. In this way, on the image obtained by mobile phone B, image block 1 is blurred and image block 2 is clear.

[0136] Figure 7C In (a), when the user drags the icon to the right, as Figure 7C in (c), the compression ratio 1 of image block 1 is decreased, and the compression ratio 2 of image block 2 is increased, so image block 1 is clear and image block 2 is blurred.

[0137] Figure 7C In (c), the compression ratio 1 of image block 1 can be 5M / X”, where X” represents the file size of image block 1 after compression. Compared withFigure 7C (a), X" is greater than X. It can be understood that the total size of the target file is 800B. The file size X allocated to Image Block 1 has increased, so Compression Rate 1 has decreased. Therefore, Image Block 1 is clearer than Figure 7C (a).

[0138] Figure 7C (c), the compression rate 2 of Image Block 2 can be 15M / Y", where Y" represents the file size of Image Block 2 after compression. Compared with Figure 7C (a), Y" is less than Y. This is because the total size of the target file is 800B. The file size X allocated to Image Block 1 has increased, so the file size Y for Image Block 2 has decreased. Therefore, the compression rate 2 has increased, and Image Block 2 is blurrier than Figure 7C (a). X" + Y" is equal to the target file size (e.g., 800B), that is, the file sizes of the two compressed image blocks do not exceed the target file size.

[0139] It can be understood that Figure 7C (c), if the mobile phone receives an operation on the confirmation button, it can return to Figure 2A (d)'s interface. In this interface, after the user clicks the send button, the mobile phone compresses the area divided by the user with different compression rates and then sends it to Mobile Phone B. In this way, on the image obtained by Mobile Phone B, Image Block 1 is clear and Image Block 2 is blurred.

[0140] In the above embodiment, the compression rate 1 of Image Block 1 is described by the ratio of the original file size of Image Block 1 to the file size of Image Block 1 after compression. The compression rate 2 of Image Block 2 is described by the ratio of the original file size of Image Block 2 to the file size of Image Block 2 after compression. In some other examples, the compression rate 1 of Image Block 1 can also be described by the ratio of the original resolution of Image Block 1 to the resolution of Image Block 1 after compression. Similarly, the compression rate 2 of Image Block 2 can also be described by the ratio of the original resolution of Image Block 2 to the resolution of Image Block 2 after compression.

[0141] For ease of understanding, assume that the original resolution of the original image, i.e., Image 1000, is H*W, where the original resolution of Image Block 1 is H1*W1 and the original resolution of Image Block 2 is H2*W2.

[0142] Figure 7C (a), the compression rate 1 of Image Block 1 can include:

[0143]

[0144] Among them, H1 and W1 are the original height and width of Image Block 1. H1' and W1' are the compressed height and width of Image Block 1. H1 / H1' represents the compression rate of Image Block 1 in terms of height, and W1 / W1' represents the compression rate of Image Block 1 in terms of width. H3 and W3 are the target dimensions, such as 240*180, which can be determined in advance. a = File Size a / Target File Size, where File Size a is the file size of Image Block 1 after compression.

[0145] Figure 7C In (b), the compression rate 2 of Image Block 2 can satisfy:

[0146]

[0147] Among them, H2 and W2 are the original height and width of Image Block 2. H2' and W2' are the compressed height and width of Image Block 2. H2 / H2' represents the compression rate of Image Block 2 in terms of height, and W2 / W2' represents the compression rate of Image Block 2 in terms of width. H3 and W3 are the target dimensions, such as 240*180. b = File Size b / Target File Size, where File Size b is the file size of Image Block 2 after compression. File Size a + File Size b equals the Target File Size.

[0148] Figure 7C In (a), when the user drags the icon to the left, the compression rate 1 of Image Block 1 increases, and the compression rate 2 of Image Block 2 decreases. Therefore, during the process of the icon moving to the left, Image Block 1 gradually blurs, and Image Block 2 gradually becomes clearer, as shown in Figure 7C (b). The implementation principle includes the following (1) and (2).

[0149] (1), Figure 7C In (b), the compression rate 1 of Image Block 1 satisfies:

[0150]

[0151] Compared with Figure 7C (a), a' is less than a. That is, the total target file size is 800B, but the file size allocated to Image Block 1 is reduced. Therefore, a' decreases, so the compression rate 1 increases. For example, the compression rate of Image Block 1 in terms of height, H1 / H1', and in terms of width, W1 / W1', both increase. Therefore, H1' and W1' decrease, and the resolution of Image Block 1 is lower than that in Figure 7C (a), that is, the clarity decreases.

[0152] (2), Figure 7C In (b), the compression rate 2 of Image Block 2 can satisfy:

[0153]

[0154] Compared with Figure 7C (a), b is greater than b. That is, the total size of the target file is 800B. Since the file size allocated to image block 1 is reduced, the file size allocated to image block 2 is increased. So b is increased, and the compression rate 2 is decreased. For example, the compression rate of image block 2 in height H2 / H2, and in width W2 / W2 are both decreased. So H2 and W2 are increased. That is, image block 2 has Figure 7C a higher resolution than (a), that is, higher clarity.

[0155] Figure 7C In (a), when the user drags the icon to the right, the compression rate 1 of image block 1 is decreased, and the compression rate 2 of image block 2 is increased. So during the process of the icon moving to the right, image block 1 becomes gradually clearer and image block 2 becomes gradually blurrier, as shown in Figure 7C (c). The implementation principle includes the following (3) and (4).

[0156] (3), Figure 7C In (c), the compression rate 1 of image block 1 satisfies:

[0157]

[0158] Compared with Figure 7C (a), a'' is greater than a. That is, the total size of the target file is 800B. However, the file size allocated to image block 1 is increased. So a'' is increased, and the compression rate 1 is decreased. For example, the compression rate of image block 1 in height H1 / H1', and in width W1 / W1' are both decreased. So H1' and W1' are increased. Image block 1 has Figure 7C a higher resolution than (a), that is, higher clarity.

[0159] (4), Figure 7C In (c), the compression rate 2 of image block 2 can satisfy:

[0160]

[0161] Compared with Figure 7C (a), b'' is less than b. That is, the total size of the target file is 800B. Since the file size allocated to image block 1 is increased, the file size allocated to image block 2 is decreased. So b'' is decreased, and the compression rate 2 is increased. For example, the compression rate of image block 2 in height H2 / H2'', and in width W2 / W2'' are both increased. So H2'' and W2'' are decreased. That is, image block 2 has Figure 7C a lower resolution than (a), that is, lower clarity.

[0162] It should be noted that Figure 7CThis is an example of manually setting the compression ratio of different regions on an image. In practical applications, the compression ratio of different regions can also be manually set in other ways, which is not limited in the embodiments of this application.

[0163] Please refer to Figure 8 , which is a schematic structural diagram of an electronic device provided by an embodiment of this application. The electronic device can be the first device (for example, mobile phone A) or the second device (for example, mobile phone B) in the foregoing text. As Figure 8 shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0164] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. Among them, the controller may be the nerve center and command center of the electronic device. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0165] In some embodiments, the processor 110 may execute the shortcut display method provided in the embodiments of the present application. For example, the processor 110 may display a first interface through the display screen 194. The first interface includes N regions, where N is a positive integer. The N regions respectively correspond to N applications in the electronic device. At least one shortcut of a first application is included in the first region among the N regions. The first region is any one of the N regions. The first application is the application corresponding to the first region among the N applications. The at least one shortcut is used to open at least one function or interface of the first application. Among them, the shortcuts in the first region are independent and irrelevant to the shortcuts in other regions (regions other than the first region among the N regions).

[0166] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0167] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface to implement the touch function of the electronic device 100.

[0168] The I2S interface may be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 may be coupled to the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface to implement the function of answering a call through a Bluetooth headset.

[0169] The PCM interface may also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through the PCM bus interface. In some embodiments, the audio module 170 may also transmit an audio signal to the wireless communication module 160 through the PCM interface to implement the function of answering a call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0170] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to implement the function of playing music through Bluetooth headphones.

[0171] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

[0172] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0173] The USB interface 130 is an interface that conforms to the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0174] It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are only illustrative descriptions and do not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0175] The wireless communication function of the electronic device can be implemented by Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Modulation and Demodulation Processor, Baseband Processor, etc. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0176] Mobile Communication Module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device. Mobile Communication Module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. Mobile Communication Module 150 can receive electromagnetic waves from Antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the Modulation and Demodulation Processor for demodulation. Mobile Communication Module 150 can also amplify the signal modulated by the Modulation and Demodulation Processor, and convert it into electromagnetic waves through Antenna 1 and radiate it out. In some embodiments, at least some functional modules of Mobile Communication Module 150 can be arranged in Processor 110. In some embodiments, at least some functional modules of Mobile Communication Module 150 and at least some modules of Processor 110 can be arranged in the same device.

[0177] Wireless Communication Module 160 can provide solutions for wireless communications such as wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. applied to the electronic device. Wireless Communication Module 160 can be one or more devices integrating at least one communication processing module. Wireless Communication Module 160 receives electromagnetic waves via Antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to Processor 110. Wireless Communication Module 160 can also receive the signals to be sent from Processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through Antenna 2 and radiate them out.

[0178] In some embodiments, antenna 1 of the electronic device is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, enabling the electronic device to communicate with the network and other devices through wireless communication technologies.

[0179] The display screen 194 is used to display the display interface of applications, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0180] The electronic device 100 can implement the shooting function through the ISP, camera 193, video codec, GPU, display screen 194, and application processor, etc. Among them, the ISP is used to process the data fed back by the camera 193.

[0181] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system and software codes of at least one application program, etc. The data storage area can store the data generated during the use of the electronic device (such as images, videos, etc.). In addition, the internal memory 121 can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash memory, etc.

[0182] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, save files such as pictures and videos in the external memory card.

[0183] The electronic device can implement audio functions through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor, etc. Such as music playback, recording, etc.

[0184] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0185] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music through one or more speakers 170A, or listen to hands-free calls and other external audio scenarios.

[0186] The receiver 170B, also known as the "earpiece", can be one or more, and is used to convert an audio electrical signal into a sound signal. When the electronic device 100 answers a call or a voice message, it can listen to the voice by bringing the receiver 170B close to the human ear.

[0187] The microphone 170C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal.

[0188] The headphone jack 170D is used to connect a wired headphone.

[0189] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194.

[0190] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake during shooting.

[0191] The barometric pressure sensor 180C is used to measure barometric pressure. In some embodiments, the electronic device calculates the altitude based on the barometric pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0192] The magnetic sensor 180D includes a Hall sensor. The electronic device can use the magnetic sensor 180D to detect the opening and closing of a flip leather case.

[0193] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device in various directions (generally three axes). When the electronic device is stationary, it can detect the magnitude and direction of gravity.

[0194] The distance sensor 180F is used to measure distance. The electronic device can measure distance through infrared or laser.

[0195] The proximity light sensor 180G can include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode can be an infrared light-emitting diode. The electronic device emits infrared light outward through the light-emitting diode. The electronic device uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device. When insufficient reflected light is detected, the electronic device can determine that there is no object near the electronic device.

[0196] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness.

[0197] The fingerprint sensor 180H is used to collect fingerprints.

[0198] The temperature sensor 180J is used to detect temperature.

[0199] The touch sensor 180K, also known as the "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event.

[0200] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals of the vibrating bone mass of the human vocal part.

[0201] The keys 190 include a power-on key, volume keys, etc. The keys 190 can be mechanical keys. They can also be touch keys. The electronic device can receive key inputs and generate key signal inputs related to the user settings and function controls of the electronic device. The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. The indicator 192 can be an indicator light and can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card can be in contact with and separated from the electronic device by being inserted into or removed from the SIM card interface 195.

[0202] It can be understood that Figure 8 the components shown do not specifically limit the electronic device. The electronic device in the embodiments of the present invention can include more or fewer components than Figure 8 those in. In addition, Figure 8 the combination / connection relationship between the components in

[0203] Figure 9 is a schematic structural diagram of the electronic device 900 provided by the embodiments of the present application. The electronic device 900 can be the first device (for example, mobile phone A) or the second device (for example, mobile phone B) in the foregoing text. As Figure 9As shown in the figure, the electronic device 900 may include: one or more processors 901; one or more memories 902; a communication interface 903, and one or more computer programs 904. Each of the above components may be connected through one or more communication buses 905. The one or more computer programs 904 are stored in the memory 902 and configured to be executed by the one or more processors 901. The one or more computer programs 904 include instructions. For example, when the electronic device 900 is the first device in the foregoing text, the instructions may be used to execute the relevant steps of the first device in the corresponding foregoing embodiments, such as executing Figure 3 the relevant steps of the first device in the figure. For another example, when the electronic device 900 is the second device in the foregoing text, the instructions may be used to execute the relevant steps of the second device in the corresponding foregoing embodiments, such as executing Figure 3 the relevant steps of the second device in the figure. The communication interface 903 is used to implement communication between the electronic device 900 and other devices. For example, the communication interface may be a transceiver.

[0204] In the foregoing embodiments provided in the present application, the method provided in the embodiments of the present application is introduced from the perspective of an electronic device (such as a mobile phone) as the execution subject. To implement each function in the method provided in the foregoing embodiments of the present application, the electronic device may include a hardware structure and / or a software module, and implement each of the above functions in the form of a hardware structure, a software module, or a combination of a hardware structure and a software module. Whether a certain function among the above functions is executed in the form of a hardware structure, a software module, or a combination of a hardware structure and a software module depends on the specific application and design constraints of the technical solution.

[0205] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)). Without conflict, the solutions of the above embodiments can be combined and used.

[0206] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, system, or computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0207] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, and the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0208] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means that implement the function specified in the flowchart(s) Figure 1 a flowchart or flowcharts and / or block(s) Figure 1 a block or blocks specified therein.

[0209] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable apparatus provide steps for implementing the function specified in the flowchart(s) Figure 1 a flowchart or flowcharts and / or block(s) Figure 1 a block or blocks specified therein.

[0210] It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the scope and spirit of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims

1. A multimedia transmission method, characterized in that, Applicable to a first device, where the first device is in a network - free state, the method includes: Receiving a first operation, where the first operation is used to trigger sending multimedia to a second device; the multimedia includes a first image; Sending N multimedia data streams to a satellite, where the N multimedia data streams are data streams obtained by compressing the multimedia, N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold; Wherein, the N multimedia data streams respectively correspond to N feature information on the first image, and the sending order of the N multimedia data streams is determined according to the priority relationship of the N feature information; The N multimedia data streams include a second multimedia data stream and a third multimedia data stream. The feature information corresponding to the second multimedia data stream is used to describe the edge contour of an object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of the object in the first image; the sending time of the second multimedia data stream is earlier than that of the third multimedia data stream.

2. The method according to claim 1, characterized in that, The details of the object in the first image include the brightness of the object in the first image, and / or the color of the object in the first image.

3. The method according to claim 1 or 2, characterized in that, The N multimedia data streams are data streams obtained by compressing different regions on the first image with different compression ratios, so that the second image is obtained after decompressing the N multimedia data streams, and the clarity of different regions on the second image is different.

4. The method according to claim 3, characterized in that, 0 Before receiving the first operation, the method further includes: Receiving a second operation, where the second operation is used to set the clarity of different regions on the first image.

5. The method according to claim 4, wherein The second operation includes any one of: a click operation, a double - click operation, a circle - drawing operation.

6. The method according to claim 4, characterized in that The second operation is used to set the compression ratio of different regions on the first image.

7. The method according to any one of claims 3-6, characterized in that, The method further includes: Displaying the second image.

8. The method according to claim 4, wherein The N multimedia data streams are data streams obtained by compressing the target region and the non - target region on the first image with different compression ratios. The target region includes at least one of: a user - specified region, a region where a target object is located, a region centered in position, and the non - target region is other regions outside the target region.

9. The method according to claim 8, wherein The target object satisfies one or more of the following: The target object is located at the center position of the first image; The first image includes a first object and a second object, the priority of the first object is higher than that of the second object, and the target object is the first object.

10. The method according to claim 8, wherein The target region includes a user - specified region. Before receiving the second operation, the method further includes: Displaying the first image; Receiving the second operation includes: Receiving a circle - drawing operation on the first image, and the user - specified region is the region inside the circle or the region outside the circle of the circle - drawing.

11. The method according to claim 8, wherein The target region includes a user - specified region. Before receiving the second operation, the method further includes: Displaying the first image and a first mark; Receiving the second operation includes: Receive an adjustment operation on the first marker and determine a second marker; the second marker divides the first image into the target area and the non-target area.

12. The method according to claim 8, wherein The target area includes a user-specified area. Before receiving the second operation, the method further includes: Display the first image and a third marker; the third marker is used to indicate that the compression ratio of a third object is different from the compression ratios of other objects in the first image, and the other objects in the first image include a fourth object. The receiving the second operation includes: Receive a click operation on the fourth object and determine a fourth marker; the fourth marker is used to indicate that the compression ratio of the fourth object is different from the compression ratios of other objects in the first image, and the other objects in the first image include the third object.

13. The method according to any one of claims 1-12, characterized in that, The method further includes: Receive a return message from the satellite, and the return message is used to indicate that the N multimedia data streams are successfully sent.

14. The method according to any one of claims 1-12, characterized in that, Sending N multimedia data streams to the satellite includes: Sending M multimedia data streams to the satellite, where the M multimedia data streams are one or more of the N multimedia data streams, and M is a positive integer; When receiving the return message from the satellite, send the remaining N - M multimedia data streams to the satellite, and the return message is used to indicate that the M multimedia data streams are successfully sent.

15. The method according to any one of claims 1-14, characterized in that, The first multimedia data stream among the N multimedia data streams is sent in a first message, the first multimedia data stream is one or more data streams among the N multimedia data streams, and the first message further includes at least one of the following: First indication information, used to indicate the type of the multimedia; Second indication information, used to indicate the size of the multimedia; Third indication information, used to indicate the identifier of the first device; Fourth indication information, used to indicate the identifier of the second device.

16. The method according to any one of claims 1-15, characterized in that, The second threshold is one of the following: 600B, 800B, 1KB; and / or, N is 8.

17. A multimedia transmission method, characterized in that, Applicable to a second device, the method includes: Receive N multimedia data streams sent by the satellite, where N is a positive integer, the data volume of each data stream among the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold; Based on the second multimedia data stream among the N multimedia data streams, obtain a first image, and the first image includes the edge contour of an object; Based on the third multimedia data stream among the N multimedia data streams and the first image, obtain a second image, and the second image includes the details of the object, and the receiving time of the third multimedia data stream is later than the receiving time of the second multimedia data stream.

18. The method according to claim 17, wherein The first multimedia data stream among the N multimedia data streams is carried in a first message, the first multimedia data stream is one or more data streams among the N multimedia data streams, and the first message further includes at least one of the following: First indication information, used to indicate the type of the multimedia; Second indication information, used to indicate the size of the multimedia; Third indication information for indicating the identity of the first device; Fourth indication information for indicating the identity of the second device.

19. The method according to claim 17 or 18, characterized in that The method further includes: Displaying the second image, where the clarity of different regions on the second image is different.

20. The method according to claim 19, wherein The second image includes a first object and a second object, and the compression ratios of the first object and the second object are different.

21. The method according to any one of claims 17-20, characterized in that, The second threshold is one of the following: 600B, 800B, 1KB; and / or, N is 8.

22. A multimedia transmission method, characterized in that, Applicable to a first device, the method includes: Receiving a second operation for setting the clarity of different regions on a first image; According to the second operation, compressing different regions on the first image using different compression ratios.

23. The method according to claim 22, wherein The second operation is used to set the compression ratios of different regions on the first image.

24. The method according to claim 22 or 23, characterized in that, The step of compressing different regions on the first image using different compression ratios according to the second operation includes: According to the second operation, compressing different regions on the first image using different compression ratios to obtain N multimedia data streams, where N is a positive integer; among them, the N multimedia data streams respectively correspond to N feature information on the first image.

25. The method according to claim 24, wherein When the first device is in a network-free state, the method further includes: Receiving a first operation for triggering the sending of the first image to a second device; The data volume of each of the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold; The sending order of the N multimedia data streams is determined according to the priority relationship of the N feature information; the N multimedia data streams include a second multimedia data stream and a third multimedia data stream, the feature information corresponding to the second multimedia data stream is used to describe the edge contour of the object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of the object in the first image; the sending time of the second multimedia data stream is earlier than that of the third multimedia data stream.

26. The method according to claim 25, characterized in that, The details of the object in the first image include the brightness of the object in the first image and / or the color of the object in the first image.

27. The method according to claim 25 or 26, characterized in that, The second image obtained after decompressing the N multimedia data streams has different clarity in different regions.

28. The method according to claim 22, characterized in that only The second operation includes any one of: click operation, double-click operation, circle-drawing operation.

29. An electronic device, characterized in that, Includes: A processor, a memory, and one or more programs; Among them, the one or more programs are stored in the memory, and the one or more programs include instructions. When the instructions are executed by the processor, the electronic device is caused to execute the method steps according to any one of claims 1-28.

30. A communication system, characterized in that, Includes: A first device, a second device, and a satellite, The first device is used to execute the method steps according to any one of claims 1-16; The second device is used to execute the method steps according to any one of claims 17-21.

31. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, and when the computer program runs on a computer, it causes the computer to execute the method according to any one of claims 1 to 28.

Images