Multimedia transmission method and related equipment

Abstract

The invention discloses a multimedia transmission method and related equipment, which can realize multimedia transmission through satellites in an area which cannot be covered by a ground mobile communication network. For example, when a first device is in a network-free state, a first operation is received for triggering transmission of multimedia to a second device. The first device sends N multimedia data streams to the satellite, the N multimedia data streams are data streams obtained by compressing multimedia, N is a positive integer, the data volume of each data stream in the N multimedia data streams does not exceed a first threshold, and the first threshold is smaller than or equal to the transmission bandwidth of the satellite; the total data volume of the N multimedia data streams does not exceed a second threshold.

Description

[0001] This application is a divisional application, the original application number is 202410081118.5, the original application date is January 19, 2024, and the entire contents of the original application are incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminals, in particular to a multimedia transmission method and related equipment. BACKGROUND

[0003] The ground mobile communication network provides convenient services for people's life, but in areas such as oceans, forests or deserts, due to the difficulty of deploying ground base stations, the coverage of the ground mobile communication network is affected. Therefore, for groups such as ocean workers and field explorers, once in danger, they will not be able to send a distress signal to the outside world due to no network (because the ground mobile communication network cannot cover), resulting in missing the rescue time. SUMMARY

[0004] The embodiments of the present application provide a multimedia transmission method and related equipment, which can realize the transmission of multimedia in an area where the ground mobile communication network cannot cover.

[0005] In a first aspect, a multimedia transmission method is provided, which is suitable for a first device. For example, the first device can be a terminal device such as a mobile phone or a PC. The method comprises: the first device is in a no-network state. The first device receives a first operation, and the first operation is used to trigger sending multimedia to a second device. The first device sends N multimedia data streams to a satellite, the N multimedia data streams are data streams obtained by compressing the multimedia, N is a positive integer, the data amount of each data stream in the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data amount of the N multimedia data streams does not exceed a second threshold.

[0006] In the embodiments of the present application, when the first device is in a no-network state, it can send multimedia such as images to other devices through a satellite. Moreover, the first device can compress the multimedia to obtain N multimedia data streams, and the data amount of each multimedia data stream does not exceed the transmission bandwidth of the satellite, so as to ensure that each multimedia data stream can be successfully sent as much as possible. Moreover, the embodiments of the present application consider that if the number of multimedia data streams is too large (i.e. N is too large), it will take a long time to send the N multimedia data streams. In order to avoid too long sending time, in the embodiments of the present application, the total data amount of the N multimedia data streams does not exceed the second threshold, so the number of N will not be too large, and the sending time will not be too long, avoiding affecting the user experience.

[0007] In a possible design, a first multimedia data stream in the N multimedia data streams is carried in a first packet, the first multimedia data stream being one or more of the N multimedia data streams, and the first packet further includes at least one of the following:

[0008] first indication information, used for indicating a type of the multimedia;

[0009] second indication information, used for indicating a size of the multimedia;

[0010] third indication information, used for indicating an identity of the first device;

[0011] fourth indication information, used for indicating an identity of the second device.

[0012] In an embodiment of the present application, the first packet can indicate the type and size of the multimedia, so that the receiving end can know the type and size of the received multimedia through the first packet, thereby improving the accuracy of the multimedia obtained by decompressing the multimedia data stream at the receiving end.

[0013] In a possible design, the first multimedia data stream can include any one or more of the N multimedia data streams, or the first multimedia data stream can be the first multimedia data stream sent in the N multimedia data streams, or the first multimedia data stream can be the last multimedia data stream sent in the N multimedia data streams, or the first multimedia data stream can be the multimedia data stream with the smallest data volume in the N multimedia data streams.

[0014] In a possible design, the multimedia includes a first image, the N multimedia data streams correspond to N characteristic information on the first image respectively, and the sending sequence of the N multimedia data streams is determined according to a priority relationship of the N characteristic information.

[0015] In an embodiment of the present application, when the first device sends an image to the second device through a satellite, the first device can preferentially send a multimedia data stream corresponding to characteristic information 1 on the image, and then send a multimedia data stream corresponding to characteristic information 2. The priority of the characteristic information 1 is higher than that of the characteristic information 2. In this way, the receiving end can first obtain the characteristic information 1, and restore the content (for example, the edge contour of an object on the image) corresponding to the characteristic information 1, and then receive the characteristic information 2, and restore the content (for example, the details of the object on the image) corresponding to the characteristic information 2, thereby realizing gradual transmission of the image from blur to clarity.

[0016] In a possible design, the N multimedia data streams include a second multimedia data stream and a third multimedia data stream, and the sending time of the second multimedia data stream is earlier than that of the third multimedia data stream when the following condition is met: the feature information corresponding to the second multimedia data stream is used to describe the edge contour of an object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of the object in the first image; or the feature information corresponding to the second multimedia data stream is used to describe a first object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe a second object in the first image, and the priority of the first object is higher than that of the second object.

[0017] In the embodiment of the present application, since the second multimedia data stream is sent preferentially, the receiving end can restore the approximate contour of the object in the image according to the feature information of the second multimedia data stream. In this way, even if the third multimedia data stream fails to be sent, the receiving end can know the approximate content of the image. Of course, if the third multimedia data stream is successfully sent, the receiving end can add details to the image according to the feature information of the third multimedia data stream, so as to improve the definition of the image. Alternatively, since the second multimedia data stream is sent preferentially, the receiving end can restore the first object in the image according to the feature information of the second multimedia data stream. In this way, even if the third multimedia data stream fails to be sent, the receiving end can know that the first object is included in the image. Of course, if the third multimedia data stream is successfully sent, the receiving end can restore the second object according to the feature information of the third multimedia data stream, so as to improve the integrity of the image.

[0018] In a possible design, the second multimedia data stream or the third multimedia data stream can be the first multimedia data stream.

[0019] In a possible design, the multimedia is a first image, and the N multimedia data streams are data streams obtained by compressing different regions of the first image using different compression rates, so that the N multimedia data streams, after being decompressed, obtain a second image, and the definition of different regions of the second image is different.

[0020] It should be noted that if the image is large, a large compression rate needs to be used to compress the image, so as to ensure that the image can be successfully sent, for example, the total data amount of the compressed multimedia data stream does not exceed a second threshold. It should be understood that once the compression rate is large, the definition of the image will be low, which affects the viewing of the receiving end. In the embodiment of the present application, different regions of the image can be differentially compressed under the condition that the total data amount of the compressed multimedia data stream does not exceed the second threshold. For example, the compression rate of some regions is small, so as to ensure the definition of these regions, and the compression rate of other regions is large, so as to reduce the transmission data amount. In this way, the definition of different regions of the image received by the receiving end is different.

[0021] In a possible design, before receiving the first operation, the method further includes: receiving a second operation, where the second operation is used to set the definition of different regions on the first image.

[0022] In an embodiment of this application, when a user of the first device wants to send an image to the second device through the satellite, the user can set the definition of different regions on the image. The first device performs differential compression on different regions on the image according to the user setting and sends the image to the second device through the satellite, so that the second device obtains an image with different definitions of different regions. In this way, the user of the sending end can set the definition of different regions according to his own requirement. Assuming that the user wants the other party to focus on a certain region, the user sets a higher definition for the region to ensure that the receiving party can clearly see the content in the region after receiving the image.

[0023] In a possible design, the second operation is used to set a definition impact factor of different regions on the first image. The definition impact factor can be understood as a parameter that can affect the definition. For example, the compression rate can affect the definition, so the second operation can be to set the compression rate of different regions.

[0024] In a possible design, the method further includes: displaying the second image.

[0025] In an embodiment of this application, when a user of the first device wants to send an image to the second device through the satellite, the user can set the definition of different regions on the image, and the first device can display the definition setting result (i.e., the second image) to facilitate the user to know the definition setting result.

[0026] In a possible design, the N multimedia data streams are obtained by using different compression rates to compress target regions and non-target regions on the first image, where the target regions include at least one of the following: a user-specified region, a region where a target object is located, and a region with a central position, and the non-target regions are other regions except the target regions.

[0027] In an embodiment of this application, the target regions and the non-target regions on the image can be differentially compressed under the condition that the total data amount of the compressed multimedia data streams does not exceed the second threshold. For example, the definition of the target regions is higher than that of the non-target regions. In this way, the receiving party can clearly see the content in the target regions, and the content in the target regions is not failed to be conveyed due to excessive compression of the target regions.

[0028] In a possible design, the method further includes: receiving a return message of the satellite, where the return message is used to indicate that the N multimedia data streams are successfully sent.

[0029] In the embodiments of the present application, after the first device sends the N multimedia data streams to the satellite, the first device can receive a reply from the satellite to indicate that the sending is successful. The first device can output the reply to prompt the user that the sending is successful, thereby improving the user experience.

[0030] In a possible design, the sending of the N multimedia data streams to the satellite includes: sending M multimedia data streams to the satellite, the M multimedia data streams being one or more of the N multimedia data streams, and M being a positive integer; and sending the remaining N-M multimedia data streams to the satellite upon receiving a return message from the satellite, the return message being used to indicate that the sending of the M multimedia data streams is successful.

[0031] In the embodiments of the present application, the first device can send the N multimedia data streams in multiple times. Since it takes a certain time length to send the N multimedia data streams, in order to ensure that the first device keeps communicating with the satellite in the time length, the first device can first send a part of the multimedia data streams, and then wait for a reply from the satellite. If the reply is received, it indicates that the first device keeps communicating with the satellite, and then the first device continues to send other multimedia data streams, thereby avoiding that the first device and the satellite have interrupted the communication, and the first device continues to send the multimedia data streams to the satellite, resulting in waste of power consumption.

[0032] The second aspect further provides a multimedia transmission method, which is applicable to a second device. For example, the second device can be a terminal device such as a mobile phone or a PC. The method includes: receiving, by the second device, N multimedia data streams sent by a satellite, N being a positive integer, a data amount of each of the N multimedia data streams being less than or equal to a first threshold, the first threshold being less than or equal to a transmission bandwidth of the satellite, and a total data amount of the N multimedia data streams being less than or equal to a second threshold; and obtaining, by the second device, a multimedia based on the N multimedia data streams.

[0033] In a possible design, a first multimedia data stream in the N multimedia data streams is carried in a first packet, the first multimedia data stream being one or more of the N multimedia data streams, and the first packet further includes at least one of the following:

[0034] first indication information, used to indicate a type of the multimedia;

[0035] second indication information, used to indicate a size of the multimedia;

[0036] third indication information, used to indicate an identity of the first device;

[0037] fourth indication information, used to indicate an identity of the second device.

[0038] In a possible design, the first multimedia data stream can include any one or more of the N multimedia data streams, or a first-received multimedia data stream of the N multimedia data streams, or a last-received multimedia data stream of the N multimedia data streams, or a multimedia data stream with a smallest data amount of the N multimedia data streams.

[0039] In a possible design, the multimedia is a first image, and the method further includes: displaying the first image, and the first image has different resolutions in different regions.

[0040] In a possible design, the multimedia is obtained based on the N multimedia data streams, including: obtaining a first image based on a second multimedia data stream of the N multimedia data streams, where the first image includes an edge contour of an object; and obtaining a second image based on a third multimedia data stream of the N multimedia data streams and the first image, where the second image includes details of the object, and the third multimedia data stream is received later than the second multimedia data stream.

[0041] In an embodiment of this application, since the second multimedia data stream is received preferentially, the second device can restore the approximate contour of the object in the image according to the characteristic information of the second multimedia data stream. In this way, even if the third multimedia data stream is not received, the approximate content of the image can be known. Of course, if the third multimedia data stream is received, details can be added to the image according to the characteristic information of the third multimedia data stream, so as to improve the resolution of the image.

[0042] In a possible design, the multimedia is obtained based on the N multimedia data streams, including: obtaining a first image based on a second multimedia data stream of the N multimedia data streams, where the first image includes a first object; and obtaining a second image based on a third multimedia data stream of the N multimedia data streams and the first image, where the second image includes the first object and a second object, and the third multimedia data stream is received later than the second multimedia data stream.

[0043] In an embodiment of this application, since the second multimedia data stream is received preferentially, the second device can restore the approximate contour of the object in the image according to the characteristic information of the second multimedia data stream. In this way, even if the third multimedia data stream is not received, the approximate content of the image can be known. Of course, if the third multimedia data stream is received, details can be added to the image according to the characteristic information of the third multimedia data stream, so as to improve the resolution of the image.

[0044] The third aspect also provides a communication system, including: a first device, a second device and a satellite.

[0045] A first device configured to perform the method steps of the first aspect above.

[0046] A second device configured to perform the method steps of the second aspect above.

[0047] A fourth aspect further provides an electronic device comprising:

[0048] a processor, a memory, and one or more programs;

[0049] wherein the one or more programs are stored in the memory and, when executed by the processor, cause the electronic device to perform the method of the first aspect or the second aspect above.

[0050] A fifth aspect further provides a computer-readable storage medium storing a computer program which, when run on a computer, causes the computer to perform the method of the first aspect or the second aspect above.

[0051] A sixth aspect further provides a computer program product comprising a computer program which, when run on a computer, causes the computer to perform the method of the first aspect or the second aspect above.

[0052] A seventh aspect further provides a chip coupled with a memory in an electronic device, configured to invoke a computer program stored in the memory and perform the technical solutions of the first aspect or the second aspect of the embodiments of the present application. In the embodiments of the present application, "coupled" means that two components are directly or indirectly combined with each other.

[0053] The technical effects achieved by the second aspect to the seventh aspect above can refer to the description of the technical effects achieved by the corresponding design solutions in the first aspect above, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0054] Figure 1 A schematic diagram of a communication system provided by an embodiment of the present application;

[0055] Figure 2A A schematic diagram of a communication system provided by an embodiment of the present application; Figure 2B A schematic diagram of a mobile phone A sending an image to a mobile phone B through a satellite provided by an embodiment of the present application;

[0056] Figure 3 A flowchart of a multimedia transmission method provided by an embodiment of the present application;

[0057] Figure 4 Another schematic diagram of a communication system provided by an embodiment of the present application;

[0058] Figures 5A to 5C A schematic diagram of a message sent by the mobile phone A according to an embodiment of the present application is shown in FIG. 1;

[0059] Figure 6 A schematic diagram of the mobile phone B receiving the image according to an embodiment of the present application is shown in FIG. 2;

[0060] Figure 7A A schematic diagram of the mobile phone A dividing the image into regions according to an embodiment of the present application is shown in FIG. 3;

[0061] Figure 7B A schematic diagram of the mobile phone A sending images with different resolutions to the mobile phone B according to an embodiment of the present application is shown in FIG. 4;

[0062] Figure 7C A schematic diagram of the mobile phone A setting resolutions of different regions of the image according to an embodiment of the present application is shown in FIG. 5;

[0063] Figure 8 A schematic diagram of an electronic device according to an embodiment of the present application is shown in FIG. 6;

[0064] Figure 9 Another schematic diagram of an electronic device according to an embodiment of the present application is shown in FIG. 7. DETAILED DESCRIPTION

[0065] Hereinafter, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0066] (1) At least one in the embodiments of the present application includes one or more; wherein the more refers to greater than or equal to two. In addition, it should be understood that in the description of the present specification, the terms "first", "second", "third" and the like are only used to distinguish the purposes of description and cannot be understood as indicating or implying relative importance or indicating or implying order. For example, the first device and the second device do not represent the importance or order of the two, but only for the purpose of description. In the embodiments of the present application, "and / or" is only used to describe the relationship between the two, which means that there are three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, the character " / " in this paper generally represents that the front and rear associated objects are a "or" relationship.

[0067] (2) The orientation terms mentioned in the embodiments of the present application, such as "up", "down", "left", "right", "in", "out" and the like, are only the direction of the drawing, therefore, the orientation terms used are for better and clearer description and understanding of the embodiments of the present application, and are not intended to indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, therefore, it cannot be understood as a limitation of the embodiments of the present application.

[0068] (3) The description herein of an embodiment of the application indicating that “one embodiment,” “in some examples,” or “in some embodiments” means that a specific feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. The appearances of the phrases “in some examples,” “in one embodiment,” “in some embodiments,” “in other embodiments,” “in additional embodiments,” and so on, in various places in the specification are not necessarily all referring to the same embodiment, unless otherwise specifically stated. Rather, they are used as a device to connect features, structures, or characteristics of one or more embodiments to one or more of the other embodiments discussed elsewhere in the specification without necessity of connecting the same feature, structure, or characteristic of each and every embodiment. The terms “comprising,” “including,” “containing,” and “having” and their variations are meant to be equivalent to the term “including,” unless otherwise specifically stated. The terms “consisting of” and “consisting essentially of” mean “including and limited to,” unless otherwise specifically stated.

[0069] (4) The multimedia referred to in the embodiments of the application can include various media such as images, videos, audios, moving pictures, and emoticons.

[0070] As described above, in areas such as oceans, forests, or deserts, it is difficult to deploy ground base stations, resulting in that the ground mobile communication network cannot cover these areas. To this end, a solution is that in these areas (i.e., areas where the ground mobile communication network cannot cover), communication can be performed through non-terrestrial networks (NTN). For example, the NTN can include satellites, high-altitude platforms, unmanned aerial vehicles, ships, vehicles, and the like. Taking the satellite as an example, that is, users in areas such as oceans, forests, or deserts can communicate with the outside world through the satellite, which is of great help to groups such as ocean workers and field explorers.

[0071] For example, please refer to Figure 1 , a schematic diagram of a communication system provided by an embodiment of the application is shown. As Figure 1 , the communication system includes a first device, a second device, and a satellite. The first device and the second device can communicate through the satellite. It should be noted that the type of the satellite is not limited by the embodiments of the application. For example, the satellite can be a low earth orbit (LEO) satellite, and of course, it can also be a high earth orbit (HEO) satellite. For example, the satellite can be a Beidou satellite or other satellites.

[0072] It should be noted that Figure 1For example, the first device is a mobile phone A, and the second device is a mobile phone B. It can be understood that, in addition to the mobile phone, the first device and the second device can also be other types of devices. For example, the first device can also be a personal computer (PC). Optionally, the PC can include a tablet computer, a notebook computer, a desktop computer, and the like. Alternatively, the first device can also be a wearable device such as a watch or a bracelet. Alternatively, the first device can also be a smart home device such as a television or a refrigerator. Alternatively, the first device can also be a vehicle such as a vehicle of various types, a train, an aircraft, and the like. Alternatively, the first device can also be a vehicle-mounted device such as an intelligent cockpit, various systems in the intelligent cockpit such as an in-vehicle infotainment (IVI) or other vehicle-mounted devices such as a vehicle domain controller (VDC), a cockpit domain controller (CDC), an ADAS / AD domain controller (ADC), a mobile data center (MDC), and the like. Alternatively, the first device can also be a virtual reality (VR) device, an augmented reality (AR) device, a mixed reality (MR) device, and the like. Similarly, the second device can also be a PC. Alternatively, the second device can also be a wearable device such as a watch or a bracelet. Alternatively, the second device can also be a smart home device such as a television or a refrigerator. Alternatively, the second device can also be a vehicle. Alternatively, the second device can also be a vehicle-mounted device. Alternatively, the second device can also be a VR device, an AR device, an MR device, and the like. In summary, the embodiments of the present application do not limit the device types of the first device and the second device. The first device and the second device can be devices of the same type such as mobile phones. Alternatively, the first device and the second device can be devices of different types such as a mobile phone and a PC. In this document, the first device and the second device are mainly taken as mobile phones for description.

[0073] In addition, although Figure 1In the above description, only three devices, i.e., the first device, the second device and the satellite, are shown. In fact, more devices can be included. For example, a ground station, a server, etc. can be included between the satellite and the second device. For example, the first device sends information to the satellite, and the information includes a recipient identifier (e.g., a phone number of the recipient). After receiving the information, the satellite sends the information to the ground station. The ground station determines a corresponding server according to the recipient identifier in the information, and then sends the information to the server. For example, if the recipient number is 185XXXXXXXX in Chengdu, the ground station can send the information to a server in Chengdu, and the server sends the information to the second device, and the number of the second device is the number of the recipient.

[0074] The following continues to take Figure 1 For example, and Figure 1 The communication process between the mobile phone A and the mobile phone B is described by taking that the mobile phone A sends information to the mobile phone B through the satellite as an example.

[0075] In some examples, when the mobile phone A is in a networkless state, the mobile phone A can send information to the outside world through the satellite. Optionally, the networkless state can include that the mobile phone A is not connected to any network (e.g., not connected to a wifi, a 4G or a 5G mobile data network, etc.), and that the SIM card of the mobile phone A has no signal. Optionally, when the mobile phone A is in the networkless state, a prompt information can be displayed on the display screen, for example, “No service” is displayed in the status bar. Of course, in other examples, when the mobile phone A is in a network state, the mobile phone A can also send information to the outside world through the satellite, and the embodiments of the present application are not limited.

[0076] In some embodiments, the transmission resource (e.g., bandwidth) provided by the satellite is very small, and in order to ensure that the information can be successfully sent, the mobile phone A can only send a small amount of information. For example, the data amount of text information (e.g., a short message) is small, so the mobile phone A can send text information to the mobile phone B through the satellite. For example, the mobile phone A sends the words “danger ahead” to the mobile phone B through the satellite. However, in actual use, the editing process of the text information is relatively cumbersome, and the text information cannot accurately and intuitively describe the current actual situation, for example, the special environmental characteristics in the wild, the insect characteristics in the forest, etc. cannot be accurately described through the text information.

[0077] To this end, the embodiment of the present application provides a multimedia transmission method, in which the mobile phone A can send multimedia to the mobile phone B through a satellite. Optionally, the multimedia can include images, videos, audios, moving pictures, and emoticons, etc. Therefore, through the technical means of the embodiment of the present application, on the one hand, the convenience is improved because there is no need for too many text editing operations, and on the other hand, the current actual situation can be accurately and intuitively described through multimedia. As described above, the bandwidth of the transmission channel of the satellite is very small, and the data volume of the multimedia is large. In order to ensure that the multimedia can be successfully sent, in the embodiment of the present application, the mobile phone A can compress the multimedia to generate a multimedia data stream, and the data volume of the multimedia data stream obtained through compression is small, and the multimedia data stream can be sent to the mobile phone B through the satellite.

[0078] Hereinafter, taking the multimedia as an image as an example, the operation process of the mobile phone A sending the image to the mobile phone B through the satellite is described in combination with Figure 2A and Figure 2B .

[0079] As shown in Figure 2A (a), the mobile phone A displays an interface 110. The interface 110 displays "no service" in the status bar, which is used to indicate that the mobile phone A is currently in a networkless state, which can be referred to the description above. The interface 110 can be the interface of an instant messaging application (for example, the Huawei Freesurfing application) in the mobile phone A. The interface 110 can include an option of a satellite message. When the mobile phone A receives an operation (for example, a click operation) on the option of the satellite message, the interface 120 as shown in Figure 2A (b) can be displayed. The interface 120 includes a button of new information. When the mobile phone A receives an operation on the button of the new information, the interface 130 as shown in Figure 2A (c) can be displayed. The user of the mobile phone A can select a recipient in the interface 130, for example, the selected recipient is the user B. The user of the mobile phone A can also edit or select the content to be sent in the interface 130. For example, Figure 2A (c), when the mobile phone A receives an operation of the user clicking the button , the album button is displayed. When the mobile phone A receives an operation on the album button, the interface 140 as shown in Figure 2A (d) can be displayed. The interface 140 includes thumbnails (or called preview pictures) of each image in the gallery. Assuming that the mobile phone A detects that the first thumbnail is selected (for example, selected by single clicking), and the mobile phone A receives an operation on the send button, the interface 150 as shown in Figure 2A (e) can be displayed. The interface 150 includes a prompt information: please adjust the direction of the mobile phone to align with the satellite. The user can adjust the direction of the mobile phone to align with the satellite. When the mobile phone detects the alignment with the satellite, the interface 160 as shown in Figure 2AInterface 160 is shown in (f). Interface 160 includes the prompt message: Sending, please remain still. In this embodiment, mobile phone A can compress the selected image to generate a multimedia data stream. Since the multimedia data stream has a small data volume, mobile phone A can send the multimedia data stream to mobile phone B via satellite. After successful transmission, mobile phone A can display the following: Figure 2A Interface 170 is shown in (g). Interface 170 includes a notification message: Sent. Optionally, interface 170 may also display a notification message indicating satellite transmission and reception. Afterwards, the mobile phone may display, as shown in (g). Figure 2A Interface 180 is shown in (h). Interface 180 includes content to be sent to user B.

[0080] Figure 2A In (d), taking the user's selection of the first image as an example, it is understandable that the user may also select other images, such as the second, third, etc. The data size of the images selected by the user may not be the same; it may be a 10M image or a 20M image. In this embodiment, regardless of the data size of the image selected by the user, mobile phone A can compress the image into a multimedia data stream with a data size less than or equal to the target value (e.g., 800B or 1KB) (the specific implementation process will be described later) to ensure that the image can be successfully transmitted to the other end via satellite.

[0081] like Figure 2B (a) is the interface 190 of an instant messaging application (e.g., Huawei Connect) on mobile phone B. Interface 190 displays the option for satellite messages. Optionally, interface 190 may also display a notification message, such as symbol ①, to indicate the arrival of a new satellite message. When mobile phone B receives an operation on the option for satellite messages, it may display something like... Figure 2B (b) Interface 1100. Interface 1100 includes a thumbnail (or preview) of the image sent by mobile phone A. When mobile phone B receives an operation on the thumbnail, it can display, as shown below. Figure 2B (c) Interface 1200. Interface 1200 includes images sent from mobile phone A.

[0082] It should be noted that, Figure 2A and Figure 2B Taking the example of mobile phone A sending an image to mobile phone B via satellite, mobile phone A can also send videos, GIFs, emojis, and other multimedia to mobile phone B via satellite. The specific operation process is similar and will not be illustrated one by one.

[0083] The following explains how mobile phone A sends images to mobile phone B via satellite. It should be noted that although this example uses images, the underlying principle applies to other multimedia formats such as videos, GIFs, and emojis.

[0084] Please see Figure 3 This is a schematic flowchart illustrating a multimedia transmission method provided in an embodiment of this application. This method can be applied to... Figure 1 The communication system can also be applied to Figure 2A and Figure 2B The scene. For example... Figure 3 The process may include:

[0085] S300, Mobile Phone A is currently in a no-network state. Please refer to the previous description for information about the no-network state.

[0086] S301, Mobile phone A receives a first operation, which triggers the sending of an image to mobile phone B. Figure 2A (d) For example, the first operation can be an operation on the send button (e.g., a click operation).

[0087] S302, Mobile Phone A determines the size of the target file.

[0088] For example, the target file size can be 1KB, 800B, 600B, etc., and the specific value is not limited in this application embodiment. The target file size is used to indicate that the multimedia transmitted to the satellite needs to be compressed to a size less than or equal to the target file size.

[0089] In some embodiments, the target file size is pre-configured. For example, mobile phone A stores the target file size at the factory. Alternatively, the target file size is specified in the communication protocol between mobile phone A and the satellite. Or, the target file size can be indicated by the satellite to mobile phone A. For example, the satellite sends configuration information to mobile phone A, which includes the target file size.

[0090] In some examples, the target file size can differ depending on the type of multimedia. For instance, when the multimedia is an image, the target file size is 800 bytes; when the multimedia is a video, the target file size is 1 KB.

[0091] S303, Mobile phone A compresses the image to generate a multimedia data stream, and the amount of data in the multimedia data stream is less than or equal to the size of the target file.

[0092] Optionally, there are various image compression methods. For example, compression can be achieved through encoding. Optionally, encoding methods may include lossy encoding, lossless encoding, orthogonal transform encoding, etc., which are not limited in this application embodiment. Alternatively, compression can also be achieved through feature extraction. Optionally, feature extraction can be implemented using a convolutional neural network, which will not be elaborated upon in this application embodiment. For examples, please refer to... Figure 4Mobile phone A includes a compression framework used to compress multimedia (e.g., images) to a target file size. For example, the compression framework includes a convolutional neural network, an encoding module, and a control module. When an image is input into the compression framework, the convolutional neural network extracts feature information from the image. This extracted feature information is then encoded by the encoding module. The encoding module can encode the feature information into a multimedia data stream based on the target file size provided by the control module. The multimedia data stream size is less than or equal to the target file size. In other words, regardless of the amount of multimedia data input to the compression framework, the output multimedia data stream size after compression is less than or equal to the target file size (e.g., 800 bytes).

[0093] S304, Mobile phone A sends a multimedia data stream to the satellite.

[0094] In some examples, mobile phone A can send the entire multimedia data stream to the satellite at once. For instance, when the satellite has sufficient bandwidth, the entire multimedia data stream can be sent to the satellite.

[0095] In other examples, the multimedia data stream can be sent in multiple parts. For instance, the multimedia data stream can be split into N data packets, where N is an integer greater than or equal to 2, and each data packet contains a segment of the multimedia data stream. These N data packets are then sent in N parts. Optionally, the number of data packets N in the multimedia data stream can be determined based on the satellite's transmission bandwidth. For example, if the total volume of the multimedia data stream is 800 bytes and the transmission bandwidth is 100 bytes, it can be split into 8 data packets.

[0096] In some examples, the transmission order of the eight data packets can be determined based on their priority relationships. For instance, each data packet corresponds to different feature information within an image, and the priority relationship can be determined based on the priority of the feature information corresponding to each data packet. For example, if data packets 1 to 4 correspond to feature information 1 in the image, and data packets 5 to 8 correspond to feature information 2, then if feature information 1 has a higher priority than feature information 2, data packets 1 to 4 are transmitted first (the transmission order of the four data packets is not limited), and data packets 5 to 8 are transmitted later (the transmission order of the four data packets is not limited).

[0097] Optionally, feature information 1 has a higher priority than feature information 2, and may include: feature information 1 describes the edge contour of objects in the image, while feature information 2 describes the details of objects in the image. Details may include the object's color, brightness, etc. In this method, since data packets 1 to 4 are sent first, after the receiving end (i.e., mobile phone B) receives data packets 1 to 4, it can reconstruct the approximate outline of objects in the image based on feature information 1. In this way, even if data packets 5 to 4 fail to be sent, the receiving end (i.e., mobile phone B) can still know the approximate content of the image. Of course, if data packets 5 to 4 are sent successfully, the receiving end (i.e., mobile phone B) can add details to the image based on feature information 2 to improve the image's clarity.

[0098] Optionally, feature information 1 has a higher priority than feature information 2. This can include: feature information 1 describes object 1 in the image, and feature information 2 describes object 2 in the image, with object 1 having a higher priority than object 2. In this way, since data packets 1 to 4 are sent first, the receiving end (i.e., mobile phone B) can reconstruct object 1 in the image based on these four data packets. Thus, even if data packets 5 to 4 fail to be sent, the receiving end (i.e., mobile phone B) can still know that object 1 is present in the image. Of course, if data packets 5 to 4 are sent successfully, the receiving end (i.e., mobile phone B) can reconstruct object 2 based on these four data packets to improve image integrity. Optionally, the higher priority of object 1 can include at least one of the following: object 1 is a foreground object, and object 2 is a background object; or, object 1 is a person, and object 2 is not a person; or, the area occupied by object 1 in the image is greater than the area occupied by object 2 in the image; or, object 1 is centered in the image, and object 2 is near the edge of the image, etc.

[0099] In the example above, the multimedia data stream is split into 8 data packets and sent separately. In some examples, sending all 8 data packets takes a certain amount of time. To ensure that mobile phone A maintains communication with the satellite during this time, each group of 4 data packets is sent as a set. After receiving a set of data packets, the satellite can send an acknowledgment back to mobile phone A, indicating that mobile phone A and the satellite are currently in communication. For example, after sending a set of data packets, mobile phone A can wait for the satellite's acknowledgment. If an acknowledgment is received, it continues to send the next set of data packets. If no acknowledgment is received, it is determined that communication with the satellite has been interrupted, and it does not need to continue sending the next set of data packets or resend the previous set of data packets. It should be noted that the example above uses 4 data packets as a set, but more or fewer data packets can be used as a set. The number of data packets in each set can be pre-configured, for example, it can be specified by the protocol or indicated by the base station. This application embodiment does not limit this.

[0100] S305, the satellite sends a multimedia data stream to mobile phone B.

[0101] S306, the satellite sends a receipt to mobile phone A to indicate that the multimedia data stream was successfully sent.

[0102] Optionally, S306 may or may not be executed; this application embodiment does not limit this.

[0103] S307, Mobile Phone B decompresses the multimedia data stream to obtain multimedia.

[0104] For example, see Figure 4 Mobile phone B includes a decompression module for decompressing multimedia data streams. The decompression module includes a deconvolutional neural network and a decoding module. The decoding module decodes the multimedia data stream to obtain image feature information, and then processes this feature information through the deconvolutional neural network to obtain the final image.

[0105] S308, image displayed on phone B.

[0106] Optionally, the execution order of S306, S307, and S308 is not limited in this embodiment.

[0107] As mentioned earlier, multimedia data streams can be sent all at once or in multiple parts. Taking a single transmission as an example, the multimedia data stream can be carried within a single message. Taking message 1 as an example, optionally, in addition to the multimedia data stream, message 1 may include at least one of the following information:

[0108] (1) First indication information, used to indicate the type of multimedia. For example, when the first indication information is 00, it indicates that the multimedia is an image; when the first indication information is 01, it indicates that the multimedia is a video; when the first indication information is 10, it indicates that the multimedia is an emoji.

[0109] (2) Second indication information, used to indicate the size of the multimedia. The size may include dimensions and / or length. Taking an image as an example, the size of the image may include the dimensions of the image, such as the height H and width W of the image. Taking a video as an example, the size of the video may include the dimensions of the video, such as the height H and width W of the image, and may also include the length of the video, such as the duration of the video. Taking audio as an example, the size of the audio may include the length of the audio, such as the duration of the audio.

[0110] (3) Third indication information, used to indicate the recipient (i.e., mobile phone B) identifier. Optionally, the recipient identifier may include the recipient's number (e.g., telephone number). Optionally, the recipient identifier may also include the number of recipients. (Referring to the previous text...) Figure 2A (c) For example, user A can Figure 2A(c) Select one or more recipients in the interface. If one recipient is selected, the number of recipients is 1 and the number is the recipient's phone number.

[0111] (4) Fourth indication information, used to indicate the sender (i.e., mobile phone A) identifier. Optionally, the sender identifier may include the sender's number (e.g., telephone number).

[0112] As an example, please see Figure 5A This is a schematic diagram of message 1. For example... Figure 5A Message 1 includes three fields. The first field occupies X bits and includes third indication information, as mentioned earlier, used to indicate the receiver's identifier. The second field occupies Y bits and includes first indication information, as mentioned earlier, used to indicate the multimedia type. The third field occupies Z bits and includes the multimedia data stream. It should be noted that in practical applications, Message 1 may include more than... Figure 5A The number of fields, whether more or fewer, is not limited in this embodiment. Furthermore, Figure 5A In the example of the Chinese-Israeli message 1, the receiver identifier is located in the first field, the multimedia type is located in the middle field, and the multimedia data stream is located in the last field. In practical applications, there can be other layouts, such as the receiver identifier being located in the first field, the multimedia data stream being located in the middle field, and the multimedia type being located in the last field, etc.

[0113] Considering that the multimedia transmitted by mobile phone A to the satellite could also include emojis, GIFs, etc. Taking emojis as an example, to improve transmission efficiency, one possible scenario is that the satellite pre-stores some emojis. If mobile phone A needs to send a specific emoji to the satellite, it only needs to send the emoji's identifier, without needing to send the entire emoji, thus significantly reducing the amount of data transmitted. Therefore, as another example, please refer to... Figure 5B This is another schematic diagram of message 1. (And...) Figure 5A The difference is that, Figure 5B In message 1, there is a P-bit reserved field. This reserved field is used when sending special multimedia (e.g., emoticons or GIFs). (As mentioned earlier...) Figure 2A (c) is an example. Figure 2A (c) The interface can display emojis, which can be pre-stored in the satellite. If the user selects an emoji, mobile phone A can send the emoji's identifier to the satellite. In this case, Figure 5B In message 1, the multimedia type in the second field can be 10, indicating that the multimedia is an emoji. The reserved field in message 1 can be an emoji identifier. It should be understood that in this case, the multimedia data stream in the third field of message 1 is empty because no emoji needs to be transmitted.

[0114] Taking a multimedia data stream split into N data packets and sent in N separate packets as an example, each data packet is carried in an independent message, meaning N data packets are sent through N messages. For example, if N=8, the multimedia data stream is split into 8 data packets. Please see [link to relevant documentation]. Figure 5C Mobile phone A sequentially sends eight messages to the satellite, named messages 1 through 8. Message 1 includes data packet 1, message 2 includes data packet 2, and so on. For example... Figure 5C Since message 1 contains indication information such as receiver identifier and multimedia type, messages 2 to 8 may not contain this indication information in order to reduce the amount of data transmitted.

[0115] In the previous text Figure 2A In (d), the user selected image 1000. Phone A compressed image 1000 into a multimedia data stream and sent it to phone B. Phone B decompressed the image to obtain image 1300. Figure 2B (c) Figure 2B In (c), the sharpness of all regions in image 1300 is the same. This is because... Figure 2A In (d), when mobile phone A receives the operation for sending the button, it compresses each area on image 1000 using the same compression rate to obtain a multimedia data stream. Therefore, the clarity of each area on image 1300 obtained by mobile phone B through decompressing the multimedia data stream is the same.

[0116] In other examples, the preceding text Figure 2A In (d), when mobile phone A receives an operation to press the send button, it compresses different regions of image 1000 using different compression rates to obtain a multimedia data stream, so that the clarity of different regions of image 1300 obtained by mobile phone B after decompressing the multimedia data stream varies. For example, please refer to [link to example]. Figure 6 (a) shows the interface of an instant messaging application (e.g., Huawei MeeTime) on mobile phone B, which displays the option for satellite messages. When mobile phone B receives an operation on the option for satellite messages, it can display something like this. Figure 6 (b) is the interface that includes a thumbnail (or preview) of the image sent by phone A. When phone B receives an operation on the thumbnail, it can display something like... Figure 6 (c) is the interface, which includes image 1300 sent by mobile phone A. Different areas of image 1300 have different levels of clarity.

[0117] In the example above, it is mentioned that Figure 2AIn (d), when mobile phone A receives an operation to press the send button, it compresses different regions of image 1000 using different compression rates to obtain a multimedia data stream. It is understandable that before applying different compression rates to different regions of image 1000, image 1000 can be divided into different regions. Optionally, the region division can be automatic by mobile phone A or manual by the user.

[0118] Take automatic partitioning as an example. That is to say, Figure 2A In (d), after receiving the send button operation, mobile phone A automatically divides image 1000 into different regions, then compresses each region using a different compression rate before sending it to mobile phone B. For example, mobile phone A can automatically identify target objects in image 1000 and then divide the region containing the target object into different regions from the regions containing other objects. The target object can be an object centered in image 1000, a large object, a high-priority object, etc. Optionally, mobile phone A can store the priority relationship of different objects, such as people > animals > plants. When mobile phone A determines that the image contains multiple objects, it can determine which object has the highest priority based on this priority relationship.

[0119] Let's take manual partitioning by the user as an example. Continuing from the previous text... Figure 2A (d) For example, when mobile phone A receives an operation on the first thumbnail (e.g., a double-tap operation), it can display something like this: Figure 7A (a) is an interface that includes image 1000. Users can manually divide regions on image 1000. For example, Figure 7A In (a), after receiving the circle drawing operation (represented by dashed lines in the diagram), mobile phone A divides the area inside the circle and the area outside the circle into different regions. Optionally, if the mobile phone receives an operation on the confirm button, it can return to... Figure 2A (d) is the interface where, after the user clicks the send button, the phone compresses the user-defined area using different compression rates and then sends it to phone B. Figure 7A In (a), if the phone receives an operation on the back button, the area can be redefined.

[0120] Or, continuing from the previous text Figure 2A (d) For example, when mobile phone A receives an operation on the first thumbnail (e.g., a double-tap operation), it can display something like this: Figure 7A(b) The interface includes image 1000, which has a dashed bounding box (i.e., the dashed bounding box appears automatically). The area inside the dashed bounding box and the area outside the dashed bounding box are divided into different regions. Optionally, the dashed bounding box can be located in the center of the image or at any position. Alternatively, mobile phone A can identify a target object and then display the dashed bounding box at the location of the target object. Please refer to the previous section for target object identification. It is understandable that, considering that the area enclosed by the dashed bounding box may not meet the user's requirements after it appears automatically, the user can also adjust the position, area, etc. of the dashed bounding box to redefine the region.

[0121] Continuing from the previous text Figure 2A (d) For example, when mobile phone A receives an operation on the first thumbnail (e.g., a double-tap operation), it can display something like this: Figure 7A (c) The interface includes image 1000, and the area on image 1000 containing the target object (e.g., a tree) is filled with diagonal lines (or may be filled with color or other elements), indicating that the target object is compressed at a different compression rate than other objects. Of course, the user can change the target object, for example... Figure 7A In (c), mobile phone A receives the user's click operation on image 1000 and determines that the click operation is located in the area where the object "sun" is located. Then the target object is changed to "sun", and the area where the sun is located is filled with diagonal lines to represent that the sun and other objects are compressed using different compression rates.

[0122] The above are several ways to divide an image into regions. It is understood that there are other ways to divide an image, but these are not all listed in the embodiments of this application.

[0123] by Figure 7A (b) For example, mobile phone A divides image 1000 into two regions. In this embodiment, mobile phone A can perform differential compression on these two regions to obtain a multimedia data stream, so that mobile phone B, by decompressing the multimedia data stream, obtains an image with different clarity in different regions. The following description... Figure 7A (b) Differential compression process between the two regions.

[0124] For example, see Figure 7B Image 1000 is divided into two image blocks, image block 1 and image block 2. Mobile phone A compresses image block 1 using compression ratio 1 to obtain multimedia data stream 1. Mobile phone A compresses image block 2 using compression ratio 2 to obtain multimedia data stream 2. Compression ratio 2 is different from compression ratio 1. For example, compression ratio 2 is higher than compression ratio 1. Furthermore, the total data size of multimedia data stream 1 and multimedia data stream 2 is less than or equal to the target file size, for example, 800 bytes.

[0125] Continue as Figure 7BAfter receiving multimedia data stream 1 and multimedia data stream 2, mobile phone B can decompress them respectively to obtain two image blocks, namely image block 1 and image block 2. Mobile phone B combines these two image blocks into a single image, in which different areas have varying degrees of clarity. It is understood that mobile phone B needs to use the positional relationship between the two image blocks when combining them into a single image. One possible approach is that mobile phone A sends the positional relationship between the two image blocks to mobile phone B. Optionally, the positional relationship can be located in any field of message 1 mentioned above; this embodiment of the application does not limit this.

[0126] In the above embodiments, different regions are compressed using different compression ratios. For example, Figure 7B In the example, image block 1 is compressed using compression ratio 1, and image block 2 is compressed using compression ratio 2. In some examples, phone A can automatically set different compression ratios for different areas, as long as the clarity of different areas in the compressed image remains consistent, and the size of the compressed image data does not exceed the target file size. For example, Figure 7B In the image obtained by phone B, phone A can automatically set a smaller compression rate for image block 1 and a larger compression rate for image block 2, so that image block 1 is clearer in the image obtained by phone B.

[0127] In other examples, the compression ratio for different regions can be manually set by the user.

[0128] For example, continuing from the previous text Figure 2A (d) For example, when mobile phone A receives an operation on the first thumbnail (e.g., a double-tap operation), it can display something like this: Figure 7C (a) shows the interface, which displays image 1300. Image 1300 is an image compressed using the same compression rate across all areas of image 1000, so the clarity of each area in image 1300 is the same. Phone A also displays a progress bar containing an icon (e.g., a black dot). By default, the icon is located in the middle of the progress bar, indicating that the clarity of each area in the image is the same, meaning that the compression rate of each area is the same.

[0129] For ease of understanding, assume that the original file size of the original image (image 1000) is 20M in total, and the original file size of image block 1 is 5M, and the original file size of image block 2 is 15M.

[0130] Figure 7C In (a), the compression ratio of image block 1 can be 5M / X, where X represents the file size of image block 1 after compression.

[0131] Figure 7CIn (a), the compression ratio 2 of image block 2 can be 15M / Y, where Y represents the file size of image block 2 after compression, and X+Y equals the target file size (e.g., 800B). Therefore, the total file size of the two compressed image blocks does not exceed the target file size.

[0132] Figure 7C In (a), when the user drags the icon to the left, as shown... Figure 7C (b) The compression ratio 1 of image block 1 is increased, while the compression ratio 2 of image block 2 is decreased, so image block 1 is blurrier than image block 2.

[0133] Figure 7C In (b), the compression ratio of image block 1 can be 5M / X', where X' represents the file size of image block 1 after compression. Figure 7C (a) Compared to X, X' is smaller than X. This can be understood as follows: the total target file size is 800B, but the file size X allocated to image patch 1 is reduced, so the compression ratio 1 is increased. Therefore, image patch 1 is smaller than X. Figure 7C (a) It's blurred.

[0134] Figure 7C In (b), the compression ratio 2 of image block 2 can be 15M / Y', where Y' represents the file size of image block 2 after compression. Figure 7C (a) Compared to Y, Y' is greater than Y. This is because the total target file size is 800B. Since the file size X allocated to image patch 1 is reduced, the file size Y allocated to image patch 2 is increased. Therefore, the compression ratio 2 is reduced, and image patch 2 is larger than Y. Figure 7C (a) It's clear now. X'+Y' equals the target file size (e.g., 800B), meaning the file size of the two compressed image blocks does not exceed the target file size.

[0135] Understandable Figure 7C In (b), if the phone receives an operation on the confirm button, it can return to... Figure 2A In interface (d), after the user clicks the send button, the phone compresses the user-defined regions using different compression rates and then sends them to phone B. Thus, in the image received by phone B, image patch 1 is blurry, while image patch 2 is clear.

[0136] Figure 7C In (a), when the user drags the icon to the right, as shown... Figure 7C (c) The compression ratio 1 of image block 1 is reduced and the compression ratio 2 of image block 2 is increased, so image block 1 is clear and image block 2 is blurry.

[0137] Figure 7C In (c), the compression ratio of image block 1 can be 5M / X", where "X" represents the file size of image block 1 after compression.Figure 7C (a) Compared to X, X” is greater than X. This can be understood as the total target file size being 800B, and the file size X allocated to image patch 1 has increased, thus the compression ratio 1 has decreased. Therefore, image patch 1 is more compressed than X”. Figure 7C (a) It's clear now.

[0138] Figure 7C In (c), the compression ratio 2 of image block 2 can be 15M / Y", where "Y" represents the file size of image block 2 after compression. Figure 7C (a) Compared to Y, Y” is smaller. This is because the total target file size is 800B. The file size X allocated to image patch 1 has increased, so the file size Y allocated to image patch 2 has decreased. Therefore, the compression ratio 2 has increased, and image patch 2 is smaller than Y”. Figure 7C (a) It's blurred. X”+Y” equals the target file size (e.g., 800B), meaning the file size of the two compressed image blocks does not exceed the target file size.

[0139] Understandable Figure 7C In (c), if the phone receives an operation on the confirm button, it can return to... Figure 2A In interface (d), after the user clicks the send button, the phone compresses the user-defined area using different compression rates and then sends it to phone B. Thus, in the image received by phone B, image block 1 is clear, while image block 2 is blurry.

[0140] In the above embodiments, the compression ratio 1 of image block 1 is described by the ratio of the original file size of image block 1 to the compressed file size of image block 1. The compression ratio 2 of image block 2 is described by the ratio of the original file size of image block 2 to the compressed file size of image block 2. In other examples, the compression ratio 1 of image block 1 can also be described by the ratio of the original resolution of image block 1 to the compressed resolution of image block 1. Similarly, the compression ratio 2 of image block 2 can also be described by the ratio of the original resolution of image block 2 to the compressed resolution of image block 2.

[0141] For ease of understanding, assume that the original resolution of the original image, i.e., image 1000, is H*W, where the original resolution of image block 1 is H1*W1 and the original resolution of image block 2 is H2*W2.

[0142] Figure 7C In (a), the compression ratio 1 of image block 1 may include:

[0143]

[0144] Where H1 and W1 are the original height and original width of image patch 1. H1' and W1' are the compressed height and width of image patch 1. H1 / H1' represents the compression ratio of image patch 1 in height, and W1 / W1' represents the compression ratio of image patch 1 in width. H3 and W3 are the target dimensions, such as 240*180, which can be predetermined. a = file size a / target file size, where file size a is the file size of image patch 1 after compression.

[0145] Figure 7C In (b), the compression ratio 2 of image block 2 can satisfy:

[0146]

[0147] Where H2 and W2 are the original height and width of image patch 2. H2' and W2' are the compressed height and width of image patch 2. H2 / H2' represents the compression ratio of image patch 2 in height, and W2 / W2' represents the compression ratio of image patch 2 in width. H3 and W3 are the target dimensions, for example, 240*180. b = file size b / target file size, where file size b is the compressed file size of image patch 2. File size a + file size b equals the target file size.

[0148] Figure 7C In (a), when the user drags the icon to the left, the compression ratio 1 of image block 1 increases, while the compression ratio 2 of image block 2 decreases. Therefore, as the icon moves to the left, image block 1 gradually becomes blurry, while image block 2 gradually becomes clearer. Figure 7C (b). The implementation principles include the following (1) and (2).

[0149] (1), Figure 7C In (b), the compression ratio 1 of image block 1 satisfies:

[0150]

[0151] and Figure 7C Compared to (a), a' is smaller than a, meaning the total target file size is 800B, but the file size allocated to image patch 1 is reduced, so a' decreases, and therefore the compression ratio 1 increases. For example, the compression ratio H1 / H1' in height and the compression ratio W1 / W1' in width of image patch 1 both increase, so H1' and W1' decrease. Image patch 1 is larger than... Figure 7C (a) The resolution has been reduced, meaning the clarity has been reduced.

[0152] (2), Figure 7C In (b), the compression ratio 2 of image block 2 can satisfy:

[0153]

[0154] and Figure 7C (a) Compared to b, b' is greater than b, meaning the total target file size is 800B. Since the file size allocated to image patch 1 is reduced, the file size allocated to image patch 2 is increased, therefore b' increases. Consequently, the compression ratio 2 decreases. For example, the compression ratio H2 / H2' in height and the compression ratio W2 / W2' in width of image patch 2 both decrease, so H2' and W2' increase. That is, image patch 2 is larger than b'. Figure 7C (a) The resolution has been improved, that is, the clarity has been improved.

[0155] Figure 7C In (a), when the user drags the icon to the right, the compression ratio 1 of image block 1 decreases, and the compression ratio 2 of image block 2 increases. Therefore, as the icon moves to the right, image block 1 gradually becomes clearer, while image block 2 gradually becomes blurry. Figure 7C (c). The implementation principles include the following (3) and (4).

[0156] (3), Figure 7C In (c), the compression ratio 1 of image block 1 satisfies:

[0157]

[0158] and Figure 7C Compared to (a), a” is greater than a, meaning the total target file size is 800B, but the file size allocated to image patch 1 has increased, so a” has increased, thus reducing the compression ratio 1. For example, the compression ratio H1 / H1' in height and the compression ratio W1 / W1' in width of image patch 1 have both decreased, so H1' and W1' have increased. Image patch 1 is larger than... Figure 7C (a) The resolution has been improved, that is, the clarity has been improved.

[0159] (4), Figure 7C In (c), the compression ratio 2 of image block 2 can satisfy:

[0160]

[0161] and Figure 7C (a) Compared to b, b” is smaller than b, meaning the total target file size is 800B. Since the file size allocated to image patch 1 increased, the file size allocated to image patch 2 decreased, therefore b” decreased, and the compression ratio 2 improved. For example, the compression ratio H2 / H2' in height and the compression ratio W2 / W2' in width of image patch 2 both improved, so H2' and W2' became smaller. That is, image patch 2 is smaller than b”. Figure 7C (a) The resolution has been reduced, meaning the clarity has been reduced.

[0162] It should be noted that, Figure 8This is an example of manually setting the compression ratio of different regions on an image. In practical applications, other methods can also be used to manually set the compression ratio of different regions. This application does not limit this approach.

[0163] Please see Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device can be the first device (e.g., mobile phone A) or the second device (e.g., mobile phone B) mentioned above. Figure 8 As shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0164] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the nerve center and command center of the electronic device. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has just used or is repeatedly used. If processor 110 needs to reuse the instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.

[0165] In some embodiments, the processor 110 can execute the shortcut display method provided in the embodiments of this application. For example, the processor 110 can display a first interface through the display screen 194, the first interface including N regions, where N is a positive integer. The N regions correspond to N applications in the electronic device. The first region includes at least one shortcut of the first application in the first region among the N regions. The first region is any one of the N regions. The first application is the application corresponding to the first region among the N applications. At least one shortcut is used to open at least one function or interface of the first application. Wherein, the shortcut in the first region is independent and unrelated to the shortcuts in other regions (regions among the N regions other than the first region).

[0166] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0167] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0168] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0169] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0170] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0171] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0172] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0173] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0174] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0175] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in conjunction with a tuning switch.

[0176] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G in electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0177] The wireless communication module 160 can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0178] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to communicate with networks and other devices via wireless communication technology.

[0179] The display screen 194 is used to display the application's interface, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0180] The electronic device 100 can perform shooting functions through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP is used to process the data fed back by the camera 193.

[0181] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application program. The data storage area may store data generated during the use of the electronic device (e.g., images, videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, general-purpose flash memory, etc.

[0182] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.

[0183] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.

[0184] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0185] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls and other external playback scenarios through one or more speakers 170A.

[0186] The receiver 170B, also known as a "handpiece," can be one or more, and is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0187] The microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals.

[0188] The 170D headphone jack is used to connect wired headphones.

[0189] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.

[0190] The gyroscope sensor 180B can be used to determine the motion attitude of an electronic device. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization.

[0191] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0192] The magnetic sensor 180D includes a Hall effect sensor. Electronic devices can use the magnetic sensor 180D to detect the opening and closing of a flip cover.

[0193] The 180E accelerometer can detect the magnitude of acceleration in various directions (typically three axes) of electronic devices. When the electronic device is stationary, it can detect the magnitude and direction of gravity.

[0194] The 180F distance sensor is used to measure distance. Electronic devices can measure distance using infrared or laser.

[0195] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device emits infrared light outward through the LED. The electronic device uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near the electronic device. When insufficient reflected light is detected, the electronic device can determine that no object is near the electronic device.

[0196] An ambient light sensor 180L is used to detect ambient light levels. Electronic devices can adaptively adjust the brightness of the display screen 194 based on the detected ambient light levels.

[0197] The fingerprint sensor 180H is used to collect fingerprints.

[0198] The 180J temperature sensor is used to detect temperature.

[0199] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can then transmit the detected touch operation to the application processor to determine the type of touch event.

[0200] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords.

[0201] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. The electronic device can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device.

[0202] Understandable Figure 8 The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiments of the present invention may include, but is not limited to, components that are more advanced than those shown. Figure 8 More or fewer parts. Furthermore, Figure 9 The combination / connection relationships between the components can also be adjusted and modified.

[0203] Figure 9 This is a schematic diagram of the structure of an electronic device 900 provided in an embodiment of this application. The electronic device 900 can be the first device (e.g., mobile phone A) or the second device (e.g., mobile phone B) mentioned above. Figure 3As shown, the electronic device 900 may include: one or more processors 901; one or more memories 902; a communication interface 903; and one or more computer programs 904. These devices can be connected via one or more communication buses 905. The one or more computer programs 904 are stored in the memory 902 and configured to be executed by the one or more processors 901. The one or more computer programs 904 include instructions. For example, when the electronic device 900 is the first device mentioned above, the instructions can be used to perform the relevant steps of the first device as described in the corresponding embodiments above, such as executing... Figure 3 The relevant steps of the first device. For example, when electronic device 900 is the second device mentioned above, this instruction can be used to execute the relevant steps of the second device as described in the corresponding embodiments above, such as executing... Figure 1 The relevant steps for the second device. Communication interface 903 is used to enable communication between electronic device 900 and other devices, such as a transceiver.

[0204] In the embodiments provided above, the methods provided by the embodiments of this application are described from the perspective of an electronic device (e.g., a mobile phone) as the executing entity. To implement the functions of the methods provided in the embodiments of this application, the electronic device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is implemented in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0205] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (SSD)). Where there is no conflict, the solutions in the above embodiments can be combined.

[0206] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0207] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0208] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0209] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes ​ The steps of the function specified in one or more boxes.

[0210] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope and intent of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and variations.

Claims

1. A multimedia transmission method, characterized in that, Applicable to a first device, the first device including a control module, the first device being in a no-network state, the method includes: A first operation is received, which triggers the transmission of multimedia to a second device; the multimedia is a first image. The first feature information and the second feature information of the multimedia are extracted by a convolutional neural network. The first feature information is used to indicate the edge contours in the first image, and the second feature information is used to indicate the details of objects in the first image. The first feature information and the second feature information are encoded according to the second threshold to obtain a first data stream; wherein the amount of data in the first data stream does not exceed the second threshold, and the second threshold is determined by the control module. Based on the first data stream and the first threshold, N multimedia data streams are obtained; wherein, N is a positive integer, the data volume of each of the N multimedia data streams does not exceed the first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed the second threshold; Send M multimedia data streams to the satellite, wherein the M multimedia data streams are one or more of the N multimedia data streams, and M is a positive integer; Upon receiving the return message from the satellite, the remaining NM multimedia data streams are sent to the satellite, the return message indicating that the M multimedia data streams were successfully sent.

2. The method according to claim 1, characterized in that, The details of the object in the first image include the brightness of the object in the first image and / or the color of the object in the first image.

3. The method according to claim 1 or 2, characterized in that, The N multimedia data streams correspond to N feature information on the first image, and the sending order of the N multimedia data streams is determined according to the priority relationship of the N feature information.

4. The method according to claim 3, characterized in that, The N multimedia data streams include a second multimedia data stream and a third multimedia data stream. The second multimedia data stream is sent earlier than the third multimedia data stream when the following conditions are met: The feature information corresponding to the second multimedia data stream is used to describe the edge contours of objects in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of objects in the first image; or, The feature information corresponding to the second multimedia data stream is used to describe the first object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the second object in the first image, wherein the first object has a higher priority than the second object.

5. The method according to any one of claims 1-4, characterized in that, The N multimedia data streams are data streams obtained by compressing different regions of the first image using different compression rates, so that the N multimedia data streams are decompressed to obtain the second image, and the clarity of different regions of the second image is different.

6. The method according to claim 5, characterized in that, Before receiving the first operation, the method further includes: A second operation is received, which is used to set the sharpness of different regions on the first image.

7. The method according to claim 6, characterized in that, The second operation includes any one of the following: a click operation, a double-click operation, or a circle operation.

8. The method according to claim 6, characterized in that, The second operation is used to set the compression ratio for different regions on the first image.

9. The method according to any one of claims 5-8, characterized in that, The method further includes: The second image is displayed.

10. The method according to claim 6, characterized in that, The N multimedia data streams are data streams obtained by compressing the target region and non-target region on the first image using different compression rates. The target region includes at least one of the following: a user-specified region, the region where the target object is located, and a region with a central position. The non-target region is any region other than the target region.

11. The method according to claim 10, characterized in that, The target object satisfies one or more of the following: The target object is located in the center of the first image; The first image includes a first object and a second object, the first object having a higher priority than the second object, and the target object is the first object.

12. The method according to claim 10, characterized in that, The target area includes a user-specified area. Prior to receiving the second operation, the method further includes: Display the first image; The receiving second operation includes: The system receives a circle drawing operation on the first image, wherein the user-specified area is either the area inside the circle or the area outside the circle.

13. The method according to claim 10, characterized in that, The target area includes a user-specified area. Prior to receiving the second operation, the method further includes: Display the first image and the first marker; The receiving second operation includes: The system receives an adjustment operation on the first marker and determines a second marker; the second marker divides the first image into the target region and the non-target region.

14. The method according to claim 10, characterized in that, The target area includes a user-specified area. Prior to receiving the second operation, the method further includes: The first image and the third marker are displayed; the third marker is used to indicate that the compression ratio of the third object is different from that of other objects in the first image, including the fourth object. The receiving second operation includes: A click operation on the fourth object is received, and a fourth marker is determined; the fourth marker is used to indicate that the compression ratio of the fourth object is different from the compression ratio of other objects in the first image, and the other objects in the first image include the third object.

15. The method according to any one of claims 1-14, characterized in that, The first multimedia data stream among the N multimedia data streams is carried in the first message and sent. The first multimedia data stream is one or more of the N multimedia data streams. The first message also includes at least one of the following: First indication information is used to indicate the type of the multimedia; The second indication information is used to indicate the size of the multimedia; The third indication information is used to indicate the identifier of the first device; The fourth indication information is used to indicate the identifier of the second device.

16. The method according to any one of claims 1-15, characterized in that, The second threshold is one of the following: 600B, 800B, 1KB; and / or, N is 8.

17. A multimedia transmission method, characterized in that, Applicable to a second device, the method includes: Receive N multimedia data streams sent by a satellite, where N is a positive integer, the data volume of each of the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold; Based on the N multimedia data streams, multimedia is obtained.

18. The method according to claim 17, characterized in that, The first multimedia data stream among the N multimedia data streams is carried in the first message. The first multimedia data stream is one or more of the N multimedia data streams. The first message also includes at least one of the following: First indication information is used to indicate the type of the multimedia; The second indication information is used to indicate the size of the multimedia; The third indication information is used to indicate the identifier of the first device; The fourth indication information is used to indicate the identifier of the second device.

19. The method according to claim 17 or 18, characterized in that, The multimedia is a first image, and the method further includes: The first image is displayed, and different regions of the first image have different levels of clarity.

20. The method according to claim 17 or 18, characterized in that, Based on the N multimedia data streams, multimedia is obtained, including: A first image is obtained based on the second multimedia data stream among the N multimedia data streams, and the first image includes the edge contour of the object; A second image is obtained based on the third multimedia data stream among the N multimedia data streams and the first image. The second image includes details of the object. The reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

21. The method according to claim 17 or 18, characterized in that, Based on the N multimedia data streams, multimedia is obtained, including: A first image is obtained based on the second multimedia data stream among the N multimedia data streams, and the first image includes a first object; Based on the third multimedia data stream among the N multimedia data streams and the first image, a second image is obtained. The second image includes the first object and the second object. The reception time of the third multimedia data stream is later than the reception time of the second multimedia data stream.

22. The method according to any one of claims 17-21, characterized in that, The second threshold is one of the following: 600B, 800B, 1KB; and / or, N is 8.

23. A multimedia transmission method, characterized in that, Applicable to a first device, the method includes: Receive a second operation, the second operation being used to set the sharpness of different regions on the first image; According to the second operation, different regions on the first image are compressed using different compression ratios; wherein, the sharpness of each region on the first image corresponds to the compression ratio used for each region.

24. The method according to claim 23, characterized in that, The step of compressing different regions of the first image using different compression ratios according to the second operation includes: According to the second operation, different regions on the first image are compressed using different compression ratios to obtain N multimedia data streams, where N is a positive integer; wherein, the N multimedia data streams correspond to N feature information on the first image.

25. The method according to claim 24, characterized in that, The method further includes: The first device is in a no-network state. Receive a first operation, the first operation being used to trigger the sending of the first image to the second device; The data volume of each of the N multimedia data streams does not exceed a first threshold, the first threshold is less than or equal to the transmission bandwidth of the satellite, and the total data volume of the N multimedia data streams does not exceed a second threshold. The transmission order of the N multimedia data streams is determined according to the priority relationship of the N feature information; the N multimedia data streams include a second multimedia data stream and a third multimedia data stream, the feature information corresponding to the second multimedia data stream is used to describe the edge contour of the object in the first image, and the feature information corresponding to the third multimedia data stream is used to describe the details of the object in the first image; the transmission time of the second multimedia data stream is earlier than that of the third multimedia data stream.

26. The method according to claim 25, characterized in that, The details of the object in the first image include the brightness of the object in the first image and / or the color of the object in the first image.

27. The method according to claim 25 or 26, characterized in that, The N multimedia data streams are decompressed to obtain a second image, and different regions of the second image have different levels of clarity.

28. The method according to claim 23, characterized only in that, The second operation includes any one of the following: a click operation, a double-click operation, or a circle operation.

29. An electronic device, characterized in that, include: Processor, memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the processor, cause the electronic device to perform the steps of the method as described in any one of claims 1-28.

30. A communication system, characterized in that, include: First equipment, second equipment, and satellite. The first device is configured to perform the steps of the method as described in any one of claims 1-16; The second device is used to perform the steps of the method as described in any one of claims 17-22.

31. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1 to 28.

Images