Satellite communication method and related apparatus
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2024-11-20
- Publication Date
- 2026-06-26
AI Technical Summary
In areas without network coverage, users cannot communicate through mobile cellular networks, resulting in interruption of communication services, which may affect the safety of users' lives and property in emergency situations.
Through the satellite communication system, the rich media information transmission between terminal devices is realized, the compressed rich media information data is transmitted using satellite devices, and the server decompresses and transmits the decompressed information to the receiving device.
It effectively reduces the amount of data required for satellite equipment to transmit, supports the transmission of rich media information between terminal equipment, reduces the decompression processing requirements of the receiving equipment, and ensures the effectiveness and security of information transmission.
Smart Images

Figure CN122295983A_ABST
Abstract
Description
Satellite communication method and related device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 22, 2023, with application number 202311569325.7, and priority to the Chinese patent application entitled “Satellite Communication Methods and Related Devices”, all contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of electronic technology, and in particular to satellite communication methods and related devices. Background Art
[0003] With the development of communication technology, users often use mobile phones and other electronic devices for communication in their daily lives. Outdoors, mobile phones and other electronic devices can communicate through mobile cellular networks. However, cellular networks cannot cover all areas. For example, there may be areas in forests, deserts, mountainous areas, cities, and rural areas that are not covered by mobile cellular networks.
[0004] When users are in areas not covered by mobile cellular networks, their mobile phones and other terminal devices will not be able to provide communication services due to the lack of cellular signals. This will cause inconvenience to users and may even endanger their lives and property in emergency situations.
[0005] Satellite communication systems are essential infrastructure integrating positioning, timing, and communications. They are particularly suitable for communicating in areas where mobile communications are unavailable, unavailable, or where the communications system is disrupted. Currently, some essential satellite communication system resources have been released for civilian use. For consumer services and device characteristics, communication solutions must be designed based on the unique characteristics of satellite communication systems.
[0006] Therefore, how to achieve effective information transmission between different terminal devices through satellite communication systems remains to be studied. Summary of the Invention
[0007] The embodiment of the present application provides a satellite communication method, which can transmit rich media information to other terminal devices via satellite devices when the terminal device has no network, thereby effectively improving the user experience.
[0008] In a first aspect, the present application provides a satellite communication method, which is applied to a satellite communication system, the satellite communication system including a first terminal device, a first server, and a second terminal device, the method including: a first application of the first terminal device receives a first input operation; in response to the first input operation, the first application of the first terminal device obtains first rich media information; the first application of the first terminal device obtains compressed data of the first rich media information; the first application of the first terminal device receives a second input operation; in response to the second input operation, the first terminal device sends a first request message to the first server via a satellite device, the first request message including compressed data of the first rich media information; the first server decompresses the compressed data of the first rich media information to obtain second rich media information; the first server sends a first message content to the second terminal device, the first message content indicating the second rich media information; the second terminal device displays the second rich media information based on the first message content.
[0009] In implementing an embodiment of the present application, when a sender intends to send a first rich media message to a recipient via a satellite device, the sender's first terminal device transmits the compressed data of the first rich media message to the first server via the satellite device; the first server decompresses the compressed data and directly or indirectly transmits the decompressed second rich media message to the recipient's second terminal device. In this way, the amount of data required to be transmitted by the satellite device is effectively reduced, so that the satellite device can also support the transmission of rich media information between terminal devices; the first server performs the decompression processing, and the recipient's second terminal device may not have the decompression processing capability and can receive the first message content according to the conventional message processing method, reducing the requirements for the second terminal device; the decompressed second rich media message can contain valid information of the first rich media message, and the recipient can obtain the valid information of the first rich media message that the sender needs to transmit through the second rich media message. It can be understood that in application scenarios without a network (such as rescue scenarios), transmitting rich media information via satellite devices can provide recipients with richer and more complete help information, which is more helpful in protecting the user's life and property safety.
[0010] In one implementation, the first message content includes the second rich media information. When implementing the embodiment of the present application, the first server may directly transmit the second rich media information to the recipient's terminal device.
[0011] In one implementation, the first message content includes a first website link corresponding to the second rich media information; and the second terminal device displays the second rich media information based on the first message content, including: in response to an input operation on the first website link, the second terminal device displays the second rich media information on a first webpage corresponding to the first website link. In implementing this embodiment of the present application, the first server may transmit a webpage link to the second rich media information to the recipient's terminal device, and the user may choose whether to view the rich media information on the webpage corresponding to the webpage link, thereby reducing the data traffic required to transmit the first message content.
[0012] In one implementation, the first server sends the first message content to the second terminal device, including: the first server sends the first message content to the second application of the second terminal device; the second application includes an instant messaging application and / or a text message application. By implementing the embodiment of the present application, the recipient's terminal device can receive the first message content through the instant messaging application and / or the text message application, which can meet the different needs of different users. For example, when the recipient's terminal device does not have a mobile cellular network but can access the Internet, it cannot receive the first message content through the text message application, but can receive the first message content through the instant messaging application. For example, when the recipient's terminal device has a mobile cellular network but no data traffic, it cannot receive the first message content through the instant messaging application, but can receive the first message content through the text message application. Receiving the first message content through the instant messaging application and the text message application can reduce the possibility of the user missing the first message content.
[0013] In one implementation, before the first application of the first terminal device receives the second input operation, the method further includes: the first terminal device displays a first user interface of the first application, the first user interface including first rich media information; and in response to a third input operation, the first terminal device decompresses the compressed data of the first rich media information, obtaining and displaying the decompressed second rich media information. In implementing this embodiment of the present application, the sender can control the first terminal device to display the second rich media information corresponding to the first rich media information, thereby providing a preview of the rich media information actually received by the recipient.
[0014] In one implementation, a first rich media message includes a non-critical portion and N critical portions, and a second rich media message generated based on the first rich media message also includes a non-critical portion and N critical portions, where N is a positive integer greater than zero. The clarity of the critical portion of the second rich media message is higher than the clarity of the non-critical portion of the second rich media message. The clarity of the non-critical portion of the second rich media message is lower than the clarity of the non-critical portion of the first rich media message. In implementing this embodiment of the present application, during the compression and decompression process of the first rich media message, the clarity of the non-critical portion of the rich media message is reduced, ensuring that the clarity of the critical portion is higher than the clarity of the non-critical portion. In this way, while minimizing the amount of compressed data of the first rich media message, the information indicated by the critical portion of the rich media message is effectively retained, ensuring that the recipient can obtain the information.
[0015] In one implementation, the first terminal device obtains compressed data of the first rich media information, including: the first terminal device performs lossy compression with a first loss rate on a non-critical part of the first rich media information, obtains first compressed data of the non-critical part of the first rich media information, and the compressed data of the first rich media information includes the first compressed data; the first terminal device does not compress the critical part of the first rich media information, and the compressed data of the first rich media information includes the original data of the critical part of the first rich media information; or, the first terminal device performs lossless compression on the critical part of the first rich media information, obtains second compressed data of the critical part of the first rich media information, and the compressed data of the first rich media information includes the second compressed data; or, the first terminal device performs compression with a second loss rate on the critical part of the first rich media information, obtains third compressed data of the critical part of the first rich media information, and the compressed data of the first rich media information includes the third compressed data, and the second loss rate is lower than the first loss rate. In implementing the embodiments of the present application, the non-critical parts of the rich media information are subjected to lossy compression with a high loss rate, and the critical parts are not compressed, or are subjected to lossless compression or lossy compression with a low loss rate; in this way, while the amount of compressed data of the first rich media information is reduced as much as possible, the information indicated by the critical part in the rich media information is effectively retained, ensuring that the recipient can obtain the information.
[0016] In one implementation, the first user interface includes a first control, the third input operation is applied to the first control, and the first control is used to trigger the first terminal device to obtain second rich media information corresponding to the first rich media information. In implementing this embodiment of the present application, the sender can manually trigger the first terminal device to obtain the second rich media information corresponding to the first rich media information through the first control.
[0017] In one implementation, the first rich media information is a first image, and the third input operation is used to generate or adjust a first selection box on the first image. The area within the first selection box is the key portion of the first image, and the area outside the selection box is the non-key portion of the first image. In implementing this embodiment of the present application, the first rich media information may be the first image, and the sender may manually generate or adjust a selection box around the key portion of the first image displayed on the first terminal device.
[0018] In one implementation, the key portion includes a preset object, and the key portion is automatically identified by the first terminal device based on the preset object. In implementing the embodiment of the present application, the first terminal device can automatically identify the key portion of the first rich media information based on the preset object.
[0019] In one implementation, the method further includes: the first terminal device extracting first text information indicated by a first key portion of the first rich media information, where the first key portion is any one of the N key portions; the first request message also includes the first text information; the first message content includes the first text information; and the second terminal device displays the first text information based on the first message content. In implementing this embodiment of the present application, the first terminal device pre-extracts the text information indicated by the key portion of the rich media information and includes the text information in the first message content; thus, the recipient can accurately obtain the text information indicated by the key portion of the rich media information.
[0020] In one implementation, the method further includes: extracting, by the first terminal device, first text information indicated by a first key portion of the first rich media information, where the first key portion is any one of the N key portions; the first request message also including the first text information; and the first text information being used to decompress compressed data of the first rich media information. In implementing this embodiment of the present application, the text information indicated by the key portion pre-extracted by the first terminal device can be used to assist the first server in performing the aforementioned decompression process, thereby improving the accuracy and clarity of the text in the key portion after decompression.
[0021] In one implementation, the method further includes: the first terminal device displays a first user interface of the first application; the first user interface is used to preview the second rich media information, the first user interface includes a second control and a third control, the second control is used to perform primary compression on the first rich media information, and the third control is used to perform secondary compression on the first rich media information, the data volume of the compressed data after the secondary compression is less than the data volume of the compressed data after the primary compression; in response to an input operation on the second control, the second rich media information is obtained and displayed based on the compressed data of the primary compression of the first rich media information; or, in response to an input operation on the third control, the second rich media information is obtained and displayed based on the compressed data of the secondary compression of the first rich media information. In implementing an embodiment of the present application, the first terminal device can provide the sender with multiple compression level options, and different compression levels correspond to different data volumes of compressed data generated; after selecting a specified compression level, the sender can preview the second rich media information generated according to the compression algorithm corresponding to the compression level in advance; in this way, the sender can select the compression level of the first rich media information as needed, effectively improving the user experience.
[0022] In one implementation, the first user interface further includes first indication information and second indication information; the first indication information is used to indicate the amount of compressed data after level one compression and the estimated transmission time for sending the first message content to the second terminal using the level one compressed data; and the second indication information is used to indicate the amount of compressed data after level two compression and the estimated transmission time for sending the first message content to the second terminal using the level one compressed data. By implementing this embodiment of the present application, the sender can select the compression level of the first rich media information as needed based on the amount of compressed data and transmission time corresponding to each compression level, thereby effectively improving the user experience.
[0023] In one implementation, the first request message includes the sender's account and the recipient's account, and the recipient's account is used to determine the recipient's second terminal device. In implementing this embodiment of the application, the first server can determine the recipient's terminal device based on the recipient's account.
[0024] In one implementation, the first request message includes a first field, a second field, a third field, and a fourth field; the first field is used to indicate whether the first request message carries an image; the second field is used to indicate a first compression algorithm used for the first image; the third field is used to indicate the data length of the compressed data of the first image; and the fourth field is used to indicate the compressed data of the first image. This embodiment of the present application provides a message format for the first request message; based on the message format of the first request message, the first server can extract specified fields of the message and thereby determine whether the satellite message sent by the sender via the satellite device carries an image, the compression algorithm used for the image, the data length of the compressed data after the image is compressed, and the compressed data after the image is compressed.
[0025] In one implementation, the second user interface of the first application includes a fourth control; before the first application of the first terminal device receives the first input operation, the method further includes: in response to the input operation directed to the fourth control, the first application displaying a capture preview interface, the capture preview interface including a preview image captured by a camera; in response to the first input operation, the first application of the first terminal device obtaining first rich media information, including: in response to the first input operation, the first application of the first terminal device invoking the camera to capture the first image; the first rich media information is the first image, and the second rich media information is an image obtained by decompressing compressed data of the first image. In implementing this embodiment of the present application, the first rich media information may be an image captured by the sender using the camera while composing a satellite message.
[0026] In one implementation, the first input operation is used to capture a first image, and the first rich media information is the first image; or, the first input operation is used to select a first image from a local gallery, and the first rich media information is the first image; or, the first input operation is used to capture a first video, and the first rich media information is the first video; or, the first input operation is used to select a first video from a local gallery, and the first rich media information is the first video; or, the first input operation is used to record a first audio, and the first rich media information is the first audio.
[0027] In one implementation, the compressed data of the first rich media information is obtained after the first terminal device compresses and encodes the first rich media information using a first compression algorithm; the first server decompresses the compressed data of the first rich media information to obtain the second rich media information, including: the first server decompresses the first rich media information using a decompression algorithm corresponding to the first compression algorithm to obtain the decompressed second rich media information; or the first server decompresses the first rich media information using a decompression algorithm corresponding to the first compression algorithm to obtain the decompressed third rich media information; the first server enhances the third rich media information using a first enhancement algorithm to obtain the enhanced second rich media information. In implementing the embodiment of the present application, after decompressing the first rich media information, the decompressed rich media information can also be overall enhanced using a preset rich media information enhancement algorithm to obtain the enhanced second rich media information. In this way, the clarity of the second rich media information can be increased and the quality of the second rich media information can be improved.
[0028] In a second aspect, the present application provides a satellite communication method, the method comprising: a first application of a first terminal device receives a first input operation; in response to the first input operation, the first application of the first terminal device obtains first rich media information; the first application of the first terminal device obtains compressed data of the first rich media information; the first application of the first terminal device receives a second input operation; in response to the second input operation, the first terminal device sends a first request message to a first server via a satellite device, the first request message including the compressed data of the first rich media information; the first server is configured to decompress the compressed data of the first rich media information, obtain second rich media information, and send a first message content to the second terminal device, the first message content indicating the second rich media information.
[0029] In implementing an embodiment of the present application, when a sender intends to send a first rich media message to a recipient via a satellite device, the sender's first terminal device transmits the compressed data of the first rich media message to the first server via the satellite device; the first server decompresses the compressed data and directly or indirectly transmits the decompressed second rich media message to the recipient's second terminal device. In this way, the amount of data required to be transmitted by the satellite device is effectively reduced, so that the satellite device can also support the transmission of rich media information between terminal devices; the first server performs the decompression processing, and the recipient's second terminal device may not have the decompression processing capability and can receive the first message content according to the conventional message processing method, reducing the requirements for the second terminal device; the decompressed second rich media message can contain valid information of the first rich media message, and the recipient can obtain the valid information of the first rich media message that the sender needs to transmit through the second rich media message. It can be understood that in application scenarios without a network (such as rescue scenarios), transmitting rich media information via satellite devices can provide recipients with richer and more complete help information, which is more helpful in protecting the user's life and property safety.
[0030] In one implementation, the first message content includes second rich media information.
[0031] In one implementation, the first message content includes a first website link corresponding to the second rich media information, and the first webpage corresponding to the first website link is used to display the second rich media information.
[0032] In one implementation, the first application includes an instant messaging application or a text messaging application.
[0033] In one implementation, before the first application of the first terminal device receives the second input operation, the method also includes: the first terminal device displays the first user interface of the first application, and the first user interface includes first rich media information; in response to the third input operation, the first terminal device decompresses the compressed data of the first rich media information, obtains and displays the decompressed second rich media information.
[0034] In one implementation, the first rich media information includes a non-critical portion and N critical portions; the second rich media information generated based on the first rich media information also includes a non-critical portion and N critical portions, where N is a positive integer greater than zero; the clarity of the critical portion of the second rich media information is higher than the clarity of the non-critical portion of the second rich media information; and the clarity of the non-critical portion of the second rich media information is lower than the clarity of the non-critical portion of the first rich media information.
[0035] In one implementation, the first terminal device obtains compressed data of the first rich media information, including: the first terminal device performs lossy compression with a first loss rate on a non-critical part of the first rich media information, obtains first compressed data of the non-critical part of the first rich media information, and the compressed data of the first rich media information includes the first compressed data; the first terminal device does not compress the critical part of the first rich media information, and the compressed data of the first rich media information includes the original data of the critical part of the first rich media information; or, the first terminal device performs lossless compression on the critical part of the first rich media information, obtains second compressed data of the critical part of the first rich media information, and the compressed data of the first rich media information includes the second compressed data; or, the first terminal device performs compression with a second loss rate on the critical part of the first rich media information, obtains third compressed data of the critical part of the first rich media information, and the compressed data of the first rich media information includes the third compressed data, and the second loss rate is lower than the first loss rate.
[0036] In one implementation, the first user interface includes a first control, the third input operation acts on the first control, and the first control is used to trigger the first terminal device to obtain second rich media information corresponding to the first rich media information.
[0037] In one implementation, the first rich media information is a first image, and the third input operation is used to generate a first selection box on the first image or adjust the first selection box on the first image, the area within the first selection box in the first image is the key part, and the area outside the selection box in the first image is the non-key part.
[0038] In one implementation, the key portion includes a preset object, and the key portion is automatically identified by the first terminal device based on the preset object.
[0039] In one implementation, the method also includes: the first terminal device extracts the first text information indicated by the first key part of the first rich media information, the first key part is any one of the above-mentioned N key parts; the first request message also includes the first text information; the first message content includes the first text information.
[0040] In one implementation, the method also includes: the first terminal device extracts the first text information indicated by the first key part of the first rich media information, where the first key part is any one of the above-mentioned N key parts; the first request message also includes the first text information; the first text information is used to decompress the compressed data of the first rich media information.
[0041] In one implementation, the first request message includes the sender's account number and the recipient's account number, and the recipient's account number is used to determine the recipient's second terminal device.
[0042] In one implementation, the first request message includes a first field, a second field, a third field, and a fourth field; the first field is used to indicate whether the first request message carries an image; the second field is used to indicate the first compression algorithm adopted by the first image; the third field is used to indicate the data length of the compressed data of the first image; and the fourth field is used to indicate the compressed data of the first image.
[0043] In one implementation, the second user interface of the first application includes a fourth control; before the first application of the first terminal device receives the first input operation, the method also includes: in response to the input operation for the fourth control, the first application displays a shooting preview interface, and the shooting preview interface includes a preview image captured by the camera; in response to the first input operation, the first application of the first terminal device obtains the first rich media information, including: in response to the first input operation, the first application of the first terminal device calls the camera to capture the first image; the first rich media information is the first image, and the second rich media information is the image obtained after decompressing the compressed data of the first image.
[0044] In a third aspect, the present application provides a satellite communication method, which includes: a second terminal device receives a first message content sent by a first server, the first message content indicating second rich media information; the second rich media information is obtained by the first server after decompressing the compressed data of the first rich media information, and the compressed data of the first rich media information is sent to the first server by the first terminal device via a satellite device using a first request message; the second terminal device displays the second rich media information based on the first message content.
[0045] In implementing an embodiment of the present application, when a sender intends to send a first rich media message to a recipient via a satellite device, the sender's first terminal device transmits the compressed data of the first rich media message to the first server via the satellite device; the first server decompresses the compressed data and directly or indirectly transmits the decompressed second rich media message to the recipient's second terminal device. In this way, the amount of data required to be transmitted by the satellite device is effectively reduced, so that the satellite device can also support the transmission of rich media information between terminal devices; the first server performs the decompression processing, and the recipient's second terminal device may not have the decompression processing capability and can receive the first message content according to the conventional message processing method, reducing the requirements for the second terminal device; the decompressed second rich media message can contain valid information of the first rich media message, and the recipient can obtain the valid information of the first rich media message that the sender needs to transmit through the second rich media message. It can be understood that in application scenarios without a network (such as rescue scenarios), transmitting rich media information via satellite devices can provide recipients with richer and more complete help information, which is more helpful in protecting the user's life and property safety.
[0046] In one implementation, the first message content includes second rich media information.
[0047] In one implementation, the first message content includes a first URL link corresponding to the second rich media information; the above-mentioned second terminal device displays the second rich media information based on the first message content, including: in response to an input operation on the first URL link, the second terminal device displays the second rich media information on the first web page corresponding to the first URL link.
[0048] In one implementation, the second terminal device receives the first message content sent by the first server, including: the second application of the second terminal device receives the first message content sent by the first server; the second application includes an instant messaging application and / or a text message application.
[0049] In one implementation, the first rich media information includes a non-critical portion and N critical portions; the second rich media information generated based on the first rich media information also includes a non-critical portion and N critical portions, where N is a positive integer greater than zero; the clarity of the critical portion of the second rich media information is higher than the clarity of the non-critical portion of the second rich media information; and the clarity of the non-critical portion of the second rich media information is lower than the clarity of the non-critical portion of the first rich media information.
[0050] In one implementation, the key portion is selected by a user from the first rich media information.
[0051] In one implementation, the key portion includes a preset object, and the key portion is automatically identified by the first terminal device based on the preset object.
[0052] In one implementation, the first request message also includes first text information, and the first message content includes the first text information; the first text information is text information indicated by the first key part of the first rich media information, and the first key part is any one of the above-mentioned N key parts. The method also includes: the second terminal device displays the first text information based on the first message content.
[0053] In a fourth aspect, the present application provides a satellite communication method, which includes: a first server receives a first request message sent by a first terminal device via a satellite device, the first request message including compressed data of first rich media information; the first server decompresses the compressed data of the first rich media information to obtain second rich media information; the first server sends a first message content to a second terminal device, the first message content indicating the second rich media information.
[0054] In implementing an embodiment of the present application, when a sender intends to send a first rich media message to a recipient via a satellite device, the sender's first terminal device transmits the compressed data of the first rich media message to the first server via the satellite device; the first server decompresses the compressed data and directly or indirectly transmits the decompressed second rich media message to the recipient's second terminal device. In this way, the amount of data required to be transmitted by the satellite device is effectively reduced, so that the satellite device can also support the transmission of rich media information between terminal devices; the first server performs the decompression processing, and the recipient's second terminal device may not have the decompression processing capability and can receive the first message content according to the conventional message processing method, reducing the requirements for the second terminal device; the decompressed second rich media message can contain valid information of the first rich media message, and the recipient can obtain the valid information of the first rich media message that the sender needs to transmit through the second rich media message. It can be understood that in application scenarios without a network (such as rescue scenarios), transmitting rich media information via satellite devices can provide recipients with richer and more complete help information, which is more helpful in protecting the user's life and property safety.
[0055] In one implementation, the first message content includes second rich media information.
[0056] In one implementation, the first message content includes a first website link corresponding to the second rich media information, and the first webpage corresponding to the first website link is used to display the second rich media information.
[0057] In one implementation, the first server sends the first message content to the second terminal device, including: the first server sends the first message content to the second application of the second terminal device; the second application includes an instant messaging application and / or a text message application.
[0058] In one implementation, the first rich media information includes a non-critical portion and N critical portions; the second rich media information generated based on the first rich media information also includes a non-critical portion and N critical portions, where N is a positive integer greater than zero; the clarity of the critical portion of the second rich media information is higher than the clarity of the non-critical portion of the second rich media information; and the clarity of the non-critical portion of the second rich media information is lower than the clarity of the non-critical portion of the first rich media information.
[0059] In one implementation, the first request message also includes first text information, and the first message content includes the first text information; the first text information is text information indicated by the first key part of the first rich media information, and the first key part is any one of N key parts; the second terminal device is used to display the first text information based on the first message content.
[0060] In one implementation, the first request message also includes first text information; the first text information is text information indicated by the first key part of the first rich media information, and the first key part is any one of the above-mentioned N key parts; the first text information is used to decompress the compressed data of the first rich media information.
[0061] In one implementation, the first request message includes the sender's account number and the recipient's account number, and the recipient's account number is used to determine the recipient's second terminal device.
[0062] In one implementation, the first request message includes a first field, a second field, a third field, and a fourth field; the first field is used to indicate whether the first request message carries an image; the second field is used to indicate the first compression algorithm adopted by the first image; the third field is used to indicate the data length of the compressed data of the first image; and the fourth field is used to indicate the compressed data of the first image.
[0063] In a fifth aspect, an embodiment of the present application provides a terminal device, comprising: a processor and a memory, wherein the memory is coupled to the processor, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the terminal device executes the satellite communication method described in any one of the second aspect or the third aspect.
[0064] In a sixth aspect, an embodiment of the present application provides a server, comprising: a processor and a memory, wherein the memory is coupled to the processor, the memory is used to store computer program code, and the computer program code comprises computer instructions. When the processor reads the computer instructions from the memory, the server executes the satellite communication method described in the fourth aspect.
[0065] In a seventh aspect, an embodiment of the present application provides a computer storage medium comprising computer instructions, which, when executed on a computer, enables the computer to execute a satellite communication method in any possible implementation of any of the above aspects.
[0066] In an eighth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the satellite communication method in any possible implementation of any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0067] FIG1 is a schematic diagram of a system architecture of a satellite communication system provided in an embodiment of the present application;
[0068] Figures 2A to 2D are user interfaces related to creating a new Beidou satellite message on the Changlian APP provided in an embodiment of the present application;
[0069] 2E to 2I are user interfaces related to the sender editing message content and adding images according to an embodiment of the present application;
[0070] Figures 2J to 2N are user interfaces related to sending edited message content provided in an embodiment of the present application;
[0071] Figures 3A to 3G are user interfaces related to a recipient receiving message content according to an embodiment of the present application;
[0072] 4A to 4N are user interfaces related to adding a video according to an embodiment of the present application;
[0073] 5A to 5L are user interfaces related to adding audio according to an embodiment of the present application;
[0074] 6A to 6F are user interfaces related to sending images provided in an embodiment of the present application;
[0075] 7A to 7D are user interfaces related to various compression levels provided in an embodiment of the present application;
[0076] 8A to 8O are user interfaces related to manually selecting a key area according to an embodiment of the present application;
[0077] 9A to 9G are user interfaces related to manually selecting a key area according to an embodiment of the present application;
[0078] 10A to 10D are user interfaces related to providing multiple compression levels for key areas according to an embodiment of the present application;
[0079] 11A to 11D are user interfaces related to automatic selection of key areas provided by an embodiment of the present application;
[0080] 12A to 12H are user interfaces related to extracting text information of key areas provided in an embodiment of the present application;
[0081] FIG13 is a flow chart of a satellite communication method according to an embodiment of the present application;
[0082] FIG14 is a flow chart of a satellite communication method according to an embodiment of the present application;
[0083] FIG15 is a schematic diagram of the structure of a terminal device provided in an embodiment of the present application;
[0084] FIG16 is a schematic diagram of the structure of the application server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0085] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0086] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.
[0087] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application (APP) or an operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[0088] Low-Earth orbit satellites provide standard internet data services. Terminal devices can use these satellites to send various types of information, such as images and other rich media, over mobile networks. However, other types of satellites (such as geosynchronous orbit satellites) typically cannot use mobile networks, have low communication frequencies (e.g., once per second), limited bandwidth, and small single-transmission data volumes (e.g., 1680 bits). These satellites can typically only send low-data-volume information like text messages and positioning information, and do not support high-data-volume rich media like images, voice, and video.
[0089] An embodiment of the present application provides a satellite communication method that supports sending rich media information such as pictures via satellite; for specific application scenarios without a network (such as a rescue scenario), the user's terminal device can transmit richer and more diverse information to other terminal devices via satellite equipment, effectively improving the user experience.
[0090] The following introduces the satellite communication system 10 involved in the satellite communication method provided in the embodiment of the present application.
[0091] Figure 1 illustrates the system architecture of a satellite communication system 10 provided in an embodiment of the present application. As shown in Figure 1 , satellite communication system 10 includes a transmitting device (e.g., terminal device 100), at least one receiving device (e.g., terminal device 200), and a satellite device. In this embodiment of the present application, terminal device 100 can send satellite messages to terminal device 200 via the satellite device. These satellite messages can include not only text information but also rich media information such as images, audio, video, and animation.
[0092] In some embodiments, as shown in FIG1 , the satellite device includes a first satellite (e.g., Beidou satellite 300) and a satellite ground station 400 for the first satellite. After the terminal device 100 sends a Beidou satellite message to the Beidou satellite 300, the Beidou satellite 300 sends the Beidou satellite message to the terminal device 100 via the satellite ground station 400.
[0093] The embodiment of the present application does not specifically limit the type of the above-mentioned first satellite. The first satellite can be a geosynchronous orbit satellite, such as Beidou satellite 300. The subsequent embodiments are illustrative using Beidou satellite 300 as an example.
[0094] In some embodiments, as shown in FIG1 , a terminal device 100 has a first application installed (e.g., the Changlian app). The user of the terminal device 100 (i.e., the sender) is a registered user of the first application. The satellite communication system 10 also includes an application server 500 for the first application (e.g., the Changlian app's application server). The first application of the terminal device 100 can compress rich media information 1 (e.g., image 1) that the user intends to transmit, obtaining compressed data 1. The sender can trigger the terminal device 100 to send compressed data 1 to the Beidou satellite 300 through the first application. The Beidou satellite 300 sends compressed data 1 to the application server 500 via the satellite ground station 400. The application server 500 decompresses the compressed data 1 using a decompression processing module and sends the decompressed rich media information 2 to the terminal device 200. For example, the compressed data of image 1 is decompressed to obtain image 2. The recipient can view rich media information 2 through the terminal device 200. Rich media information 1 and rich media information 2 can contain the same valid information.
[0095] The decompression processing module may be an independent server / server cluster, or a module integrated into the application server 500 .
[0096] The embodiments of this application do not specifically limit the first application, and the subsequent embodiments will be illustratively described using the Changlian APP as an example of the first application.
[0097] In some embodiments, the amount of compressed data 1 is relatively small (e.g., less than 1KB), which is less than the maximum amount of data that can be supported by the satellite device for a single transmission. In one implementation, compressed data 1 is lossy compressed data, and rich media information 2 is lossy rich media information 1. Compared with rich media information 1, rich media information 2 contains less information. Although there are missing details and it is more blurred, it can convey the same effective information. For example, image 1 is lossy compressed and then decompressed to form image 2. Both image 1 and image 2 show the sender's current geographical environment. The sender's location can be determined by both image 1 and image 2.
[0098] In some embodiments, the terminal device 200 also has the first application installed, and the user of the terminal device 200 (i.e., the recipient) is also a registered user of the first application. After obtaining the decompressed rich media information 2, the application server 500 of the first application can send the rich media information 2 to the first application of the terminal device 200 via the communication network. The user can view the rich media information 2 through the first application (e.g., the Changlian app).
[0099] In some embodiments, the user (i.e., recipient) of terminal device 200 is not a registered user of the first application. As shown in FIG1 , satellite communication system 10 may further include a network device 600 (e.g., a short message gateway) of the operator's mobile cellular network. After obtaining the decompressed rich media message 2, application server 500 of the first application may send rich media message 2 to network device 600. Network device 600 then sends rich media message 2 to the SMS app of terminal device 200 via the mobile cellular network. The user may then view rich media message 2 via the SMS app.
[0100] The recipient's account (such as a mobile phone number) can be the sender's contact or a public account of the National Emergency Rescue Center.
[0101] The SMS gateway is used to solve the SMS intercommunication and service provider access issues between networks and operators, and provides a dynamic data exchange platform system. The embodiment of the present application does not specifically limit the network device 600. For example, the network device 600 also includes a base station.
[0102] In some embodiments, as shown in Figure 1, the satellite communication system 10 also includes a web server 700 (for example, an H5 web server); after obtaining the decompressed rich media information 2, the application server 500 obtains the URL link of the rich media information 2 from the web server 700, and sends the URL link of the rich media information 2 to the Changlian APP or SMS APP of the terminal device 200; the user can view the rich media information 2 indicated by the above URL link on the terminal device 200.
[0103] In some embodiments, as shown in FIG1 , the satellite communication system 10 further includes a risk control platform 800. After the application server 500 obtains the rich media information 2, it may request the risk control platform 800 to detect whether the rich media information 2 includes any violation information. Only if no violation information is included does the application server 500 send the rich media information 2 to the terminal device 200.
[0104] The communication network may include local area networks (LANs) and / or wide area networks (WANs). The communication network may be implemented using any known network communication protocol, which may be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), FireWire, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, wireless fidelity (Wi-Fi), NFC, voice over Internet protocol (VoIP), a communication protocol supporting a network slicing architecture, or any other suitable communication protocol.
[0105] The terminal devices 100 and 200 may be mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, and may also be cellular phones, personal digital assistants (PDAs), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, wearable devices (such as smart bracelets), vehicle-mounted devices, smart home devices (such as smart TVs, smart screens, large-screen devices, etc.) and / or smart city devices, etc. The embodiment of the present application does not impose any special restrictions on the specific type of the terminal device 100. The terminal device may also be referred to as an electronic device, a terminal, etc.
[0106] The application server 500 may be a single server, a server cluster consisting of multiple servers, or a cloud computing center. The application server 500 involved in the embodiments of the present application may also be referred to as a cloud server, cloud, or cloud side. The web server 700 may refer to the relevant description of the application server 500 and will not be repeated here.
[0107] It should be understood that Figure 1 is merely a schematic diagram of the system structure of the communication system provided in an embodiment of the present application, and does not constitute a specific limitation on the satellite communication system 10. The satellite communication system 10 may include more or fewer devices than shown in the figure. For example, it may also include wireless relay equipment and wireless backhaul equipment (not shown in Figure 1), which are not limited here.
[0108] Through the satellite communication system provided in the embodiment of the present application, when the sender intends to send rich media information 1 to the recipient via a satellite device, the satellite device only needs to transmit the compressed data of the rich media information 1, which effectively reduces the amount of data that the satellite device needs to transmit, so that the satellite device can also support the transmission of rich media information between terminal devices; in addition, the rich media information 2 restored from the compressed data of the rich media information 1 can retain the valid information of the rich media information 1, and the recipient can obtain the necessary information that the sender needs to transmit through the rich media information 2; in specific application scenarios (such as rescue scenarios), by transmitting rich media information, users and rescue agencies can be provided with richer and more complete help information, which is more helpful in protecting the safety of users' lives and property.
[0109] The satellite communication method provided in the embodiments of the present application will be described in detail below through interface embodiments 1 to 4 in combination with application scenarios.
[0110] In an application scenario (such as a rescue scenario), when the sender's terminal device 100 is in an area such as the ocean, desert, grassland, or uninhabited area where mobile communications are not covered, or cannot be covered, or the communication system is destroyed, the terminal device 100 cannot use other network resources (such as local area networks, mobile cellular networks) other than the satellite communication network, that is, the terminal device 100 is in a state of no signal / no network service. The satellite communication network includes the aforementioned satellite equipment. The sender's terminal device 100 can communicate with the recipient's terminal device 200 through the satellite communication network to transmit text information, as well as rich media information such as images, videos, voice, and animation. When a user needs to ask for help, the above-mentioned rich media information can more clearly convey to the recipient his or her location and environment, required rescue measures, and other information.
[0111] Interface Example 1
[0112] In the first embodiment of the interface, in the above application scenario, the sender can edit the message content 1 of the Beidou satellite message 1 sent to the recipient through the first application of the terminal device 100 (such as the Changlian APP), and add rich media information such as images, voice, video, and animation to the message content 1. The first application can compress the rich media information 1 selected by the user to obtain compressed data 1, decompress the compressed data 1 to obtain compressed preview information corresponding to the rich media information 1 (i.e., rich media information 2), and then add rich media information 2 to the message content 1; the sender can trigger the terminal device 100 to send compressed data 1 via the Beidou satellite 300 through the first application, and the compressed data 1 is used to transmit the rich media information 2 to the recipient.
[0113] Exemplarily, taking rich media information 1 including image 1 as an example, FIG. 2A to FIG. 2M show the user interface of the sender's terminal device 100 sending rich media information to the recipient through the Beidou satellite message of the Changlian APP.
[0114] 2A to 2D show the relevant user interfaces for a sender to create a new Beidou satellite message through the Changlian APP.
[0115] Figure 2A shows the main interface 11 on the terminal device 100 for displaying installed apps. The main interface 11 may include: a status bar 101, a tray 102 with commonly used app icons, other app icons 103, and a page indicator 104. The status bar 101 includes a cellular network signal indicator 101A, which indicates that the terminal device 100 currently has no cellular network signal; the status bar 101 may also include a prompt message 101B to remind the user that there is currently no network service. The tray 102 of commonly used app icons can display an icon 102A for the SMS app; the other app icons 103 can display an icon 103A for the Changlian app. The other app icons can be distributed across multiple pages, and the page indicator 104 can be used to indicate which page of apps the user is currently viewing. The user can swipe left or right on the area of the other app icons to view the app icons on other pages.
[0116] As shown in Figures 2A and 2B, in response to the user clicking on the icon 103A of the Changlian APP, the terminal device 100 starts the Changlian APP and displays the user interface 12 of the Changlian APP. The user interface 12 includes a navigation bar 201, and the navigation bar 201 includes multiple page options, such as a message option 201A, a call option, a space option, and a contact option. When a page option (such as the message option 201A) is selected, the user interface 12 displays the page content corresponding to the page option. The page content corresponding to the message option 201A includes one or more message bars, such as the Beidou satellite message bar 202. The Beidou satellite message bar 202 is a message bar corresponding to the service number of the Beidou satellite message provided by the Changlian APP.
[0117] As shown in Figures 2B and 2C , upon receiving and responding to a user click on Beidou satellite message bar 202, terminal device 100 displays Beidou satellite message interface 13. Beidou satellite message interface 13 may include one or more contact message log fields, such as message log field 203 for contact "Nancy." Upon detecting a user click on message log field 203, a message interface for that contact may be displayed, displaying the Beidou satellite message history for that contact. Beidou satellite message interface 13 may also include a create message control 204.
[0118] As shown in Figures 2C and 2D , upon receiving and responding to a user clicking on a create message control 204, the terminal device 100 displays a create message interface 14 for editing the message content 1 and recipients of the Beidou satellite message 1. The create message interface 14 may include a "Create Message" title, a recipient field 205, one or more message editing controls, such as a keyboard, a location control 206, a quick help control 207, a message editing field 208, and a send control 209.
[0119] The recipient field 205 can be used to trigger the terminal device 100 to display a contact list, allowing the user to select one or more recipients. The recipient field 205 can also be used to display one or more selected recipients. For example, as shown in FIG2E , the recipient field 205 displays the name of the recipient selected by the user, such as "David." When the carry location control 206 is selected, the terminal device 100 can display the terminal device 100's location information (e.g., latitude and longitude) in the new message interface 14 and automatically include the above location information in the message content when sending a message, so that the recipient can understand the current location of the terminal device 100. The quick help control 207 is used to trigger the terminal device 100 to display multiple message options, each of which indicates a help message. In response to the user's operation on one or more message options, the terminal device 100 can quickly add the help message corresponding to each message option to the message content, allowing the user to quickly edit the message content of the Beidou satellite message 1. The message editing bar 208 can be used to display text information and emoticons entered by the user. The message content 1 of the Beidou satellite message 1 edited by the user includes the information displayed in the message editing bar 208. The send control 209 can be used to trigger the terminal device 100 to send the edited message content 1 to the terminal device corresponding to the recipient, such as the terminal device 200.
[0120] FIG. 2E to FIG. 2I show relevant user interfaces for the sender to edit the message content and add the image 1 to the message content.
[0121] In some embodiments, as shown in Figures 2E and 2F, the new message interface 14 also includes a camera control 210. Upon receiving and responding to a user click on the camera control 210, the terminal device 100 displays a shooting preview interface 15. The shooting preview interface 15 includes a preview area 301, a shooting mode bar 302, a camera switching control 303, a shooting control 304, and an album control 305. The preview area 301 is used to display a preview image captured by the terminal device 100's camera in the currently selected shooting mode. The shooting mode bar 302 is used to select a shooting mode. For example, the shooting mode bar 302 includes photo mode, portrait mode, wide aperture mode, night scene mode, and professional mode. The camera switching control 303 is used to switch the camera currently capturing images. The shooting control 304 is used to trigger the terminal device 100 to use the camera to capture and save photos based on the current shooting mode. The album control 305 is used to view previously captured photos.
[0122] As shown in Figures 2F and 2G , upon receiving and responding to a user clicking on capture control 304, terminal device 100 captures image 1 and displays compression preview interface 16. Compression preview interface 16 includes image 1, compression preview control 306, confirmation control 307, cancel control 312, and prompt 313. Cancel control 312 is used to trigger terminal device 100 to return to capture preview interface 15; prompt 313 is used to indicate that by clicking on compression preview control 306, image 1 can be compressed and decompressed, and a compressed preview image after decompression can be displayed.
[0123] In some embodiments, as shown in Figures 2G and 2H, after receiving and responding to the user's operation of clicking the compression preview control 306, the terminal device 100 Changlian APP can compress image 1 using a preset compression algorithm to obtain compressed data a; decompress the compressed data a using a decompression algorithm corresponding to the preset compression algorithm, obtain and display the decompressed image 2, that is, the compressed preview image; through the compressed preview image, the user can preview in advance the actual image corresponding to image 1 that the recipient can receive.
[0124] In some embodiments, the terminal device 100 decompresses the compressed data a using a decompression algorithm corresponding to a preset compression algorithm. After obtaining the decompressed image 2, the terminal device 100 enhances the image 2 using a preset image enhancement algorithm to enrich the details of the image 2, increase the clarity of the image 2, and improve the image quality of the image 2, thereby obtaining an enhanced image 3. In response to a user clicking on the compression preview control 306, the terminal device 100 displays the decompressed and enhanced image 3, i.e., the compressed preview image. This embodiment of the present application does not specifically limit the above-mentioned image enhancement algorithm.
[0125] In some embodiments, the preset compression algorithm is a compression algorithm for a large model (eg, an NVPE algorithm), and the decompression algorithm is a decompression algorithm for a large model corresponding to the preset compression algorithm.
[0126] In one implementation, the compressed data a is lossy compressed data, and image 2 is a lossy version of image 1. Compared to image 1, image 2 lacks details and is visually more blurred. However, image 2 and image 1 contain the same valid information. For example, both image 2 and image 1 indicate the captured fence, road, forest, mountain, and sun position. Based on image 2 and image 1, the sender's current location and environment can be determined.
[0127] In some embodiments, as shown in FIG2H , in response to a user clicking on compressed preview control 306 , terminal device 100 further displays a comparison control 308 and prompt 314 ; prompt 314 prompts the user to click on comparison control 308 to compare image 1 with the compressed preview image corresponding to image 1, thereby facilitating the user to observe the difference between the original image and the image received by the recipient. Exemplarily, upon detecting a user touch operation on comparison control 308 , terminal device 100 switches the compressed preview image to image 1 ; upon detecting that the user stops touching comparison control 308 , terminal device 100 switches image 1 back to the compressed preview image.
[0128] As shown in Figures 2H and 2I , after performing a compressed preview, the terminal device 100 receives and responds to the user clicking the confirmation control 307. The terminal device 100 displays an icon 309 for Image 1 / a compressed preview image of Image 1 in the display area 310 of the new message interface 14, along with a delete control 311, adding the compressed preview image of Image 1 to the message content 1 of the Beidou satellite message 1. The delete control 311 is used to delete the icon 309 from the display area 310 and the compressed preview image of Image 1 already added to the message content 1. The icon 309 can be a scaled-down version of the compressed preview image or an image within a partial area of the compressed preview image. It is understood that after adding the compressed preview image of Image 1, the user can continue to add rich media information such as images, videos, audio, and animations to the message content 1. The following embodiments will be described using the example of adding a compressed preview image of Image 1 to the message content 1.
[0129] As shown in FIG2I , before or after adding the compressed preview image of image 1, the user can enter text message 1, such as "I'm trapped, requesting help!", in message editing field 208. The content 1 of the currently edited Beidou satellite message 1 includes the text message 1 and the compressed preview image of image 1.
[0130] In some embodiments, the terminal device 100 does not require the user to trigger a compressed preview of image 1; as shown in Figures 2F and 2I, after detecting that the user clicks the shooting control 304, the terminal device 100 shoots image 1, and the background automatically performs a compressed preview of image 1, obtains a compressed preview image of image 1, and displays the icon of the compressed preview image in the display area 310 of the new message interface 14, that is, the compressed preview image of image 1 is added to the currently edited message content 1.
[0131] 2I to 2M show user interfaces related to the sender sending the edited message content 1 .
[0132] As shown in FIG2I , in response to a user clicking the send control 209, terminal device 100 transmits the edited message content 1 to the recipient's corresponding terminal device, such as terminal device 200, via satellite communication system 10. First, terminal device 100 transmits a satellite request message 1 to a BeiDou satellite 300 of satellite communication system 10. Satellite request message 1 is used to transmit message content 1. Satellite request message 1 carries compressed data a of image 1 and text information 1. Compressed data a of image 1 is used to obtain a compressed preview image of image 1.
[0133] Before sending the satellite request message 1 to the Beidou satellite 300, it is necessary to search and align the Beidou satellite 300. Only after the search and alignment are complete can the Beidou satellite 300 receive the satellite request message 1 from the terminal device 100. As shown in Figures 2I and 2J , upon receiving and responding to the user clicking the send control 209, the terminal device 100 displays the calibration page 17.
[0134] As shown in Figure 2J, the calibration page 17 may include an operation prompt 401, a calibration auxiliary diagram 402, and a close control 403. Among them, the operation prompt 401 can be used to prompt the user to calibrate the compass. For example, the operation prompt 401 includes "Please keep the display screen perpendicular to the ground and rotate it once to complete the calibration circle". The calibration auxiliary diagram 402 can be used to assist the user in completing the calibration. For example, the calibration auxiliary diagram 402 may include the small ball and circle shown in Figure 2D. As the user rotates the terminal device 100, the small ball can move around the inside of the circle. After the small ball moves once inside the circle, the terminal device 100 completes the compass calibration. The close control 403 can be used to trigger the terminal device 100 to close the calibration page 17. After closing the calibration page 17 before the compass is calibrated, a message indicating that the sending failed can be displayed.
[0135] As shown in Figures 2J and 2K, after calibration is complete, the terminal device 100 may automatically close the calibration page 17 and display the star alignment page 18. In some embodiments, the terminal device 100 may skip the calibration page 17 and directly display the star alignment page 18. For example, after the user clicks the send control 209, if it is determined that the terminal device 100 does not require compass calibration, the terminal device 100 directly displays the star alignment page 18.
[0136] As shown in Figure 2K, the satellite alignment page 18 may include a satellite alignment prompt 404, a satellite alignment auxiliary map 405, a strength indicator 406, and a close control 407. The satellite alignment prompt 404 is used to instruct the user to perform a satellite alignment operation. For example, the satellite alignment prompt 404 may include "Try to be in an open area outdoors to avoid foreign objects blocking the signal within the line of sight." The satellite alignment auxiliary map 405 can be used to prompt the terminal device 100 whether a satellite has been detected. The satellite alignment auxiliary map 405 may include a fan-shaped area that can be used to prompt the user of the positional relationship between the satellite location and the antenna pointing direction of the terminal device 100. In the figure shown in Figure 2K, no satellite icon appears in the satellite alignment auxiliary map 405, which is used to prompt that the terminal device 100 has not yet searched for a satellite. The strength indicator 406 is used to indicate the strength of the detected satellite signal. The close control 407 can be used to trigger the terminal device 100 to close the satellite alignment page 18. After closing the satellite alignment page 18 before satellite alignment, a message indicating that the transmission failed can be displayed.
[0137] As shown in FIG2L , after the terminal device 100 searches for a satellite, the terminal device 100 may display a satellite icon 409 and an alignment operation prompt 408 in the satellite search auxiliary map 405 based on the relative position of the searched satellite. The alignment operation prompt 408 is used to instruct the user to perform an alignment operation. The relative position between the satellite and the terminal device 100 can be represented by a pitch angle and an azimuth angle. The relative position of the fan-shaped area of the satellite search auxiliary map 405 and the satellite icon 409 can be used to indicate the azimuth angle between the location of the satellite and the antenna pointing of the terminal device 100. For example, if the satellite icon 409 is located on the right side of the fan-shaped area, the alignment operation prompt 408 may include the text "Turn the device right to make the satellite enter the fan-shaped area"; as shown in FIG2M , when the user rotates the terminal device 100 to the right so that the satellite icon 409 is located in the fan-shaped area, the azimuth angle of the terminal device 100 relative to the satellite is adjusted.
[0138] In addition, the satellite-finding auxiliary chart 405 may also include a pitch angle identifier, such as the small ball shown in FIG2L . The relative positions of the center area of the circle in the satellite-finding auxiliary chart 405 and the small ball can be used to indicate the pitch angle of the terminal device 100 relative to the satellite. As shown in FIG2L , the alignment operation prompt 408 may also include "Tilt the device upward to move the small ball to the center area." As shown in FIG2M , when the small ball moves to the center area, the pitch angle of the terminal device 100 relative to the satellite is adjusted.
[0139] It can be understood that the satellite search and alignment page 18 shown in Figures 2K and 2L is only an example. In some embodiments, the satellite search auxiliary map 405 and the alignment operation prompt 408 are determined according to the azimuth and pitch angles of the terminal device 100 relative to the satellite under actual circumstances. That is, when the above-mentioned azimuth and pitch angles change, the satellite search auxiliary map 405 and the alignment operation prompt 408 also change adaptively. This application does not limit this.
[0140] In some embodiments, as shown in FIG2L , when a satellite is searched for or aligned with a satellite, the status bar displays a satellite icon 101C to prompt the user terminal device 100 that a satellite has been searched for.
[0141] As shown in Figure 2M, when the satellite icon 409 moves the fan-shaped area and the ball moves to the center area of the circle, the terminal device 100 is aimed at the satellite, the satellite signal strength that the terminal device 100 can receive is the largest, and signals can be sent and received between the terminal device 100 and the satellite; the terminal device 100 sends a satellite request message 1 to the Beidou satellite 300, and the satellite request message 1 is used to transmit the message content 1 of the Beidou satellite message 1 that the user has edited, and displays a prompt message 410 to prompt the user that a message is being sent or has been sent.
[0142] As shown in Figure 2N, after sending Beidou satellite message 1, i.e., successfully sending the aforementioned satellite request message 1, terminal device 100 may display the recipient's information interface 21. Information interface 21 may display the recipient's user name, account number (e.g., mobile phone number), and the message content 1 of the sent Beidou satellite message 1. The message content 1 displayed by terminal device 100 includes a compressed preview image of image 1 and the aforementioned text message 1. In another implementation, terminal device 100 may display the original image of image 1 in the sent message content 1, rather than the compressed preview image of image 1. The recipient actually receives the compressed preview image of image 1.
[0143] In some embodiments, satellite search and alignment have been completed before the user clicks the send control 209. After detecting that the user has clicked the send control 209, the terminal device 100 does not need to perform satellite search and alignment again, and directly sends message content 1 of Beidou satellite message 1 to Beidou satellite 300 via satellite request message 1, and displays the recipient information interface 21 shown in Figure 2N. In this embodiment of the present application, the terminal device 100 can also trigger satellite search and alignment through other entrances, which are not specifically limited here.
[0144] It is understood that the message content 1 edited and successfully sent by the sender shown in FIG2N is only an example and should not be construed as limiting the embodiments of the present application. For example, the message content 1 may also not include the text information 1.
[0145] Exemplarily, FIG. 3A to FIG. 3G show a user interface in which a recipient receives the message content 1 sent by a sender through a terminal device 200 .
[0146] In some embodiments, terminal device 200 receives a Beidou satellite message 1 from a sender via the Changlian app. The message content 2 of the Beidou satellite message 1 indicates the message content 1 sent by the sender. As shown in FIG3A , after the Changlian app of terminal device 200 receives the Beidou satellite message 1 from the sender, a message prompt box 501 is displayed above the status bar of the current user interface 22. Message prompt box 501 includes the application identifier of the Changlian app and part or all of the message content of the Beidou satellite message 1.
[0147] As shown in Figures 3A and 3B, after receiving and responding to the user's operation of clicking on the message prompt box 501, the Changlian APP of the recipient's terminal device 200 displays the information interface 23 of the sender of the above-mentioned Beidou satellite message 1; the information interface 23 is used to display the Beidou satellite messages between the recipient and the sender in the Changlian APP, such as Beidou satellite message 1.
[0148] In one implementation, as shown in FIG3B , the message content 2 of the Beidou satellite message 1 displayed by the terminal device 200 includes the text information 1 and a URL link 502 for a compressed preview image of image 1. As shown in FIG3B and FIG3C , upon receiving and responding to a user click on URL link 502, the terminal device 100 retrieves and displays the webpage 24 corresponding to URL link 502. Webpage 24 displays a compressed preview image of image 1, namely, image 2 or image 3 described above. It will be appreciated that the message content 2 received and displayed by the terminal device 200 may be different from the sent message content 1 displayed by the terminal device 100, and that the message content 2 indicates the message content 1.
[0149] In one implementation, as shown in FIG3D , message content 2 of Beidou satellite message 1 includes text information 1 and a schematic diagram 503 of a compressed preview image of image 1. As shown in FIG3D and FIG3E , upon receiving and responding to a user clicking on compressed preview image 503, terminal device 100 displays the compressed preview image of image 1, i.e., image 2 or image 3, in full screen. In one implementation, using image 2 as an example, displaying image 2 in full screen means maximizing image 2 within a preset range and at its original proportions. It will be appreciated that, in this example, message content 2 received and displayed by terminal device 200 and message content 1 displayed by terminal device 100 after sending may be identical.
[0150] In an embodiment of the present application, schematic diagram 503 may be a compressed preview image reduced in size according to its original ratio; or schematic diagram 503 may be a compressed preview image reduced in resolution and then reduced in size according to its original ratio; or schematic diagram 503 may be a compressed preview image reduced in size according to its original ratio and then further reduced in resolution. In one implementation, schematic diagram 503 is a thumbnail of the compressed preview image, the resolution of schematic diagram 503 is smaller than the resolution of the compressed preview image, and the image data volume of schematic diagram 503 is smaller than the image data volume of the compressed preview image; only when the user clicks to view schematic diagram 503 of the compressed preview image does the terminal device 200 request the application server 500 to obtain the original compressed preview image and display the original compressed preview image.
[0151] In some embodiments, terminal device 200 receives Beidou satellite message 1 from a sender via a text messaging app. Message content 3 of Beidou satellite message 1 indicates the content of message 1 sent by the sender. As shown in FIG3F , after receiving Beidou satellite message 1 from the sender, the text messaging app of terminal device 200 displays a message prompt box 504 . Message prompt box 504 includes the application identifier of the text messaging app and part or all of the content of the Beidou satellite message 1.
[0152] As shown in Figures 3F and 3G, after receiving and responding to the user's operation of clicking on the message prompt box 504, the SMS APP of the recipient's terminal device 200 displays the information interface 25 of the sender of Beidou satellite message 1. The information interface 25 can be used to display SMS, MMS and Beidou satellite messages between the recipient and the sender in the SMS APP, such as Beidou satellite message 1.
[0153] The message content 3 of the Beidou satellite message 1 can refer to the relevant description of the message content 2 of the Beidou satellite message 1 of the aforementioned Changlian APP, which will not be repeated here. When the Changlian APP and the SMS APP both receive the Beidou satellite message 1 sent by the sender, the message content 3 displayed by the SMS APP and the message content 2 displayed by the Changlian APP can be the same or different, and there is no specific limitation here. For example, as shown in Figure 3G, the SMS APP displays the URL link of the compressed preview image of Image 1, while the Changlian APP directly displays the schematic diagram of the compressed preview image of Image 1.
[0154] The message prompt of Beidou Satellite Message 1 is not limited to being displayed in the status bar, and the above message prompt can also be displayed in other locations such as the notification center and the lock screen interface, which is not specifically limited here.
[0155] It will be understood that in the embodiments described in Figures 2A to 3G , the Beidou satellite message content 1 edited, sent, and displayed by the sender via the Changlian app on terminal device 100 includes a compressed preview image of image 1. Based on the message content 1, the terminal device 100 sends compressed data a of image 1 to the satellite device. The compressed data a is used to obtain a compressed preview image of image 1. The Beidou satellite message 1 sent by the satellite device to the terminal device 200 via the Changlian app's application server 500 includes a compressed preview image of image 1, or a URL link to the compressed preview image.
[0156] For example, FIG. 4A to FIG. 5D illustrate another user interface for adding rich media information.
[0157] In some embodiments, as shown in Figures 4A and 4B, the new message interface 14 further includes an add control 601. Upon receiving and responding to a user clicking on the add control 601, the terminal device 100 displays one or more rich media information add controls, such as a photo control 602, a capture control 603, a video control 604, a video control 605, and an audio control 606. The photo control 602 is used to trigger the terminal device 100 to display images from the local gallery. The user can select one or more images from the local gallery for compressed preview and add them to the message content 1 being edited. The capture control 603 is used to trigger the terminal device 100 to display the capture preview interface 15. The user can capture one or more images for compressed preview and add them to the message content 1 being edited. The video control 604 is used to trigger the terminal device 100 to display the video preview interface. Through this interface, the terminal device 100 can record a video, compress the video for preview, and add it to the message content 1 being edited.
[0158] 4B to 4N illustrate relevant user interfaces for adding a video via the video control 605 .
[0159] As shown in Figures 4B and 4C , upon receiving and responding to a user clicking on video control 605, the terminal device 100 may display the cover images of each video in the local gallery, such as cover image 608 for Video 1, on the user interface 29. As shown in Figures 4C and 4D , upon receiving and responding to a user clicking on cover image 608, the terminal device 100 may display the compressed preview interface 26 for Video 1. The compressed preview interface 26 includes a cover image 609 for Video 1, a play control 610, a compressed preview control 611, a confirm control 612, and a cancel control 618. The play control 610 is used to play Video 1; the cancel control 618 is used to return to the compressed preview interface 26.
[0160] As shown in Figures 4D and 4E, upon receiving and responding to a user clicking on a compression preview control 611, the Changlian app of terminal device 100 can compress video 1 using a preset compression algorithm to obtain compressed data b. It can then decompress compressed data b using a decompression algorithm corresponding to the preset compression algorithm, obtaining and displaying a cover 613 and play controls 614 for the decompressed video 2 (i.e., the compressed preview video). Play controls 614 are used to trigger terminal device 100 to play the compressed preview video. Through the compressed preview video, the user can preview in advance the actual video corresponding to video 1 that the recipient will receive. In one implementation, compressed data b is lossy compressed data, and video 2 is a lossy version of video 1. Compared to video 1, video 2 lacks details and is visually blurrier, but video 2 and video 1 can contain the same valid information, such as the same subject.
[0161] In some embodiments, the terminal device 100 decompresses the compressed data b using a preset compression algorithm. After obtaining the decompressed video 2, the terminal device 100 enhances the video 2 using a preset video enhancement algorithm to enrich the details of the video 2, increase the clarity of the video 2, and improve the video quality of the video 2, thereby obtaining the enhanced video 3, i.e., the compressed preview video. In response to the user clicking the compressed preview control 611, the terminal device 100 displays the cover 613 and play controls 614 of the decompressed and enhanced video 3. This embodiment of the present application does not specifically limit the above-mentioned video enhancement algorithm.
[0162] In some embodiments, as shown in FIG4E , in response to a user clicking on the compressed preview control 611, the terminal device 100 further displays a comparison control 615. The comparison control 615 is used to compare Video 1 with the compressed preview video corresponding to Video 1, allowing the user to observe the differences between the original video and the video received by the recipient. As shown in FIG4E and FIG4F , clicking on the play control 614 can trigger the terminal device 100 to play the compressed preview video. As shown in FIG4F and FIG4G , at the first moment of playing the compressed preview video, the terminal device 100 receives and responds to a user touch operation on the comparison control 615, and starts playing Video 1 from the first moment of Video 1. As shown in FIG4G and FIG4H , at the second moment of playing Video 1, the terminal device 100 receives and responds to the user stopping the touch operation on the comparison control 615, and continues playing the compressed preview video from the second moment of the compressed preview video.
[0163] As shown in Figures 4H and 4I , after performing the compressed preview, the terminal device 100 receives and responds to the user clicking the confirmation control 612, and displays the video 1 / compressed preview video icon 616 and the delete control 617 in the display area 310 of the new message interface 14, adding the compressed preview video of video 1 to the message content 1 of the Beidou satellite message. The delete control 617 is used to delete the icon 616 in the display area 310 and delete the compressed preview video of video 1 that has been added to the message content 1.
[0164] In some embodiments, the terminal device 100 does not require the user to trigger a compressed preview of video 1; as shown in Figures 4C and 4I, after detecting the user's operation of selecting video 1 (for example, clicking on the cover 608 of video 1), the background automatically performs a compressed preview of video 1 and directly displays the icon 616 of the compressed preview video of the filmed video 1 in the display area 310, that is, the compressed preview video of video 1 is added to the currently edited message content 1.
[0165] As shown in Figures 4I and 4J, after receiving and responding to the user clicking the send control 209, the terminal device 100 sends the Beidou satellite message 1 to the recipient's terminal device 200 via the satellite device, and displays the message content 1 of the sent Beidou satellite message 1 on the recipient's information interface 21. The message content 1 includes a compressed preview video, and the terminal device 100 displays a cover 619 with the compressed preview video.
[0166] In the embodiment of the present application, the terminal device 100 can receive the Beidou satellite message 1 through the Changlian APP / SMS APP. For details, please refer to the relevant descriptions of Figures 3A to 3G.
[0167] Taking the Changlian APP as an example, after obtaining the Beidou satellite message 1, the Changlian APP of the recipient's terminal device 200 displays the message content 2 of the Beidou satellite message 1 on the sender's information interface 23 of the Beidou satellite message 1.
[0168] For example, as shown in Figures 4K and 4L, the message content 2 includes a URL link 620 of a compressed preview video of video 1; in response to receiving and responding to the user's operation of clicking the URL link 620, the terminal device 100 obtains and displays the web page 41 corresponding to the URL link 620. The web page 41 displays the cover and play control 621 of the compressed preview video of video 1. The user clicks the play control 621 to trigger the terminal device 200 to play the compressed preview video on the web page 41.
[0169] Exemplarily, as shown in Figures 4M and 4N, the message content 2 includes a cover 622 of the compressed preview video corresponding to image 1; in response to the user clicking the cover 622, the terminal device 100 plays the compressed preview video of video 1 on the user interface 42.
[0170] 5A to 5L illustrate user interfaces related to adding audio via the recording control 606 .
[0171] As shown in Figures 5A and 5B , upon receiving and responding to a user clicking on the recording control 606, the terminal device 100 may display the recording interface 27, which is used to record audio. Exemplarily, the recording interface 27 includes a recording control 701 and a confirmation control 702. As shown in Figures 5B and 5C , upon detecting a user clicking on the recording control 701, the terminal device 100 begins recording audio 1; upon detecting a user clicking on the recording control 701 again, the terminal device 100 stops recording audio 1. As shown in Figures 5C and 5D , upon receiving and responding to a user clicking on the confirmation control 702, the terminal device 100 may display the compressed pre-listening interface 28 for audio 1. The compressed pre-listening interface 28 includes a playback control component 703 for audio 1, a compressed pre-listening control 704, a confirmation control 705, and a cancel control 710. The playback control component 703 can be used to play audio 1. The cancel control 710 is used to return to the recording interface 27 or the new message interface 14.
[0172] As shown in Figures 5D and 5E , upon receiving and responding to a user's click on the compression preview control 704, the Changlian app on the terminal device 100 can compress audio 1 using a preset compression algorithm to obtain compressed data c. It then decompresses compressed data c using a decompression algorithm corresponding to the preset compression algorithm to obtain decompressed audio 2 (i.e., the compressed preview audio), displaying a playback component 706 and a comparison control 707 for audio 2. Playback component 706 is used to trigger the terminal device 100 to play the compressed preview audio. Through the compressed preview audio, the sender can pre-hear the actual audio corresponding to audio 1 that the recipient will receive. In one implementation, compressed data c is lossy compressed data, and audio 2 is lossy audio 1. Compared to audio 1, audio 2 lacks detail and is relatively ambiguous to the ear, but audio 2 and audio 1 contain the same valid information. For example, the same person's language expression can be heard through audio 2 and audio 1.
[0173] In some embodiments, the terminal device 100 decompresses the compressed data c using a preset compression algorithm, obtains the decompressed audio 2, and then enhances the audio 2 using a preset audio enhancement algorithm to enrich the details of the audio 2, increase the clarity of the audio 2, and improve the audio quality of the audio 2, thereby obtaining the enhanced audio 3, i.e., the compressed pre-listening audio. In response to the user clicking the compression pre-listening control 704, the terminal device 100 displays the playback component of the decompressed and audio-enhanced audio 3. This embodiment of the present application does not specifically limit the above-mentioned audio enhancement algorithm.
[0174] In some embodiments, as shown in FIG5E , in response to the user clicking on the compressed pre-listening control 704, the terminal device 100 further displays a comparison control 707, which is used to compare audio 1 with the compressed pre-listening audio corresponding to audio 1, so that the user can distinguish the difference between the original audio and the audio received by the recipient. In one implementation, after the terminal device 100 is triggered to play the compressed pre-listening audio by the playback component 706, at the first moment of playing the compressed pre-listening audio, the terminal device 100 receives and responds to the user's operation 1 (e.g., a touch operation) on the comparison control 707, and starts playing audio 1 from the first moment of audio 1; at the second moment of playing audio 1, the terminal device 100 receives and responds to the user's operation 2 (e.g., a stop touch operation) on the comparison control 707, and continues playing the compressed pre-listening audio from the second moment of the compressed pre-listening audio.
[0175] As shown in Figures 5E and 5F , after performing the compressed pre-listening, the terminal device 100 receives and responds to the user's click on the confirmation control 705, and displays the icon 708 of Audio 1 and the delete control 709 in the display area 310 of the new message interface 14, adding the compressed pre-listening audio of Audio 1 to the message content 1 of the Beidou satellite message. The delete control 709 is used to delete the icon 708 of Audio 1 in the display area 310 and delete the compressed pre-listening audio of Audio 1 that has been added to the message content 1.
[0176] In some embodiments, the terminal device 100 does not require the user to trigger a compressed preview of audio 1; as shown in Figures 5C and 5F, after detecting the user's operation to confirm audio 1 (for example, clicking the confirmation control 702), the terminal device 100 directly displays the icon 708 of audio 1 in the new message interface 14, that is, adding the compressed preview audio corresponding to audio 1 to the currently edited message content 1.
[0177] As shown in Figures 5F and 5G, in response to the user clicking the send control 209, the terminal device 100 sends a Beidou satellite message 1 to the recipient's terminal device 200 via the satellite device, and displays the message content 1 of the sent Beidou satellite message 1 on the recipient's information interface 21. The message content 1 includes compressed pre-listening audio, and the terminal device 100 displays a playback component 711 for the compressed pre-listening audio. The playback component 711 displays the duration of the compressed pre-listening audio, and the playback component 711 can be used to play the compressed pre-listening audio.
[0178] In the embodiment of the present application, the terminal device 100 can receive Beidou satellite message 1 through the Changlian app / SMS app. For details, please refer to the relevant descriptions of Figures 3A to 3G. Taking the Changlian app as an example, as shown in Figure 5H, after receiving Beidou satellite message 1, the Changlian app of the recipient's terminal device 200 displays the message content 2 of Beidou satellite message 1 on the sender's information interface 23 of the message.
[0179] Exemplarily, as shown in Figures 5H and 5I, the message content 2 includes a URL link 712 of the compressed pre-listening audio of audio 1; in response to the user clicking the URL link 712, the terminal device 100 obtains and displays the web page 43 corresponding to the URL link 712, and the web page 43 displays a playback component 713 of the compressed pre-listening audio of audio 1, and the playback component 713 can be used to play the compressed pre-listening audio.
[0180] For example, as shown in Figure 5J, the message content 2 includes the compressed pre-listening audio of audio 1, and the terminal device 200 displays a playback component 714 of the compressed pre-listening audio; upon receiving and responding to the user's operation of clicking the playback component 714, the terminal device 100 can play the compressed pre-listening audio of audio 1.
[0181] The embodiment of the present application does not specifically limit the display form of the playback component of the compressed pre-listening audio. For example, FIG5K shows another display form of the playback component 711, and FIG5L shows another display form of the playback component 711.
[0182] In the example interfaces of Figures 2A to 5L , the content of Beidou satellite message 1 sent by the sender to the recipient includes both rich media information and non-rich media information, such as text message 1 "I'm trapped, requesting help!" In this embodiment of the present application, the content of Beidou satellite message 1 edited by the sender can include only rich media information.
[0183] For example, in the interface examples of FIG. 6A to FIG. 6F , the message content 1 of the Beidou satellite message 1 sent by the sender to the recipient only includes the image 1 / the compressed preview image of the image 1.
[0184] As shown in FIG6A , a compressed preview image of image 1 is added to the message content 1 of the Beidou satellite message 1 edited by the sender, and no text is edited in the information editing bar 208 ; as shown in FIG6A and FIG6B , upon detecting and responding to the user clicking the send control 209 , the terminal device 100 displays the message content 1 of the sent Beidou satellite message 1 , and the message content 1 only includes the compressed preview image of image 1 .
[0185] In the embodiment of the present application, the terminal device 100 can receive Beidou satellite message 1 through the Changlian app / SMS app. For details, please refer to the relevant descriptions of Figures 3A to 3G. Taking the Changlian app as an example, as shown in Figure 6C, after the Changlian app of the recipient's terminal device 200 receives the Beidou satellite message 1 from the sender, the message content 2 of the Beidou satellite message 1 is displayed on the sender's information interface 23.
[0186] Exemplarily, as shown in Figures 6C and 6D, the message content 2 includes a URL link 502 of a compressed preview image of image 1; in response to the user clicking the URL link 502, the terminal device 100 obtains and displays the web page 24 corresponding to the URL link 502, and the web page 24 displays the compressed preview image of image 1.
[0187] Exemplarily, as shown in FIG6E and FIG6F , the message content 2 includes a schematic diagram 503 of a compressed preview image of the image 1 ; upon receiving and responding to the user clicking on the schematic diagram 503 , the terminal device 100 displays the compressed preview image of the image 1 in full screen.
[0188] Interface Example 2
[0189] In the second interface embodiment, multiple compression levels are set for the rich media information involved in the previous embodiments. The terminal device 100 can provide the sender with multiple compression level options, allowing the user to select the compression level for rich media information 1 and preview the actual rich media information that the recipient will receive. Taking level 1 and level 2 compression as examples, rich media information 1 is compressed at level 1 to obtain compressed data 11, which is then decompressed or decompressed and enhanced to obtain rich media information 2. Rich media information 1 is compressed at level 2 to obtain compressed data 12, which is then decompressed or decompressed and enhanced to obtain rich media information 3. Compared to compressed data 11, compressed data 12 is smaller in size, requiring less transmission time for satellite communication. Compared to rich media information 3, rich media information 2 lacks more details and is relatively blurry.
[0190] It should be noted that the compression of rich media information may include more levels, such as three levels of compression, which is not specifically limited here.
[0191] Exemplarily, taking the rich media information 1 including image 1 as an example, FIG. 7A to FIG. 7D show user interfaces related to the user selecting a compression level.
[0192] 7A , the compression preview interface 16 includes image 1, a level 1 compression preview control 841, and a level 2 compression preview control 842. Optionally, the compression preview interface 16 may further include the data size and estimated transmission time after level 1 compression 843, and the data size and estimated transmission time after level 2 compression 844.
[0193] In some embodiments, the compression preview interface 16 may also include a prompt 845 indicating the data size and estimated transmission time of the original image of Image 1. Alternatively, clicking the confirmation control 307 may allow the user to send Image 1 directly to the recipient without compressing it. In this embodiment of the present application, if the user directly clicks the confirmation control 307, Image 1 may be added to Beidou satellite message 1, and the image data of Image 1 may be subsequently sent to the recipient via the satellite device. If the data size of Image 1 exceeds the data size supported by the satellite device for a single transmission, the image data of Image 1 may be split into multiple data packets and sent separately. It is understood that in this embodiment, the user may choose to send the original image of Image 1 to the recipient.
[0194] As shown in Figures 7A and 7B , upon receiving and responding to a user click on the Level 1 compression preview control 841, the terminal device 100 compresses image 1 using a Level 1 compression algorithm to obtain compressed data a1, then decompresses compressed data a1 to obtain and display a Level 1 compressed preview image. At this point, upon receiving and responding to a user click on the Confirm control 307, the terminal device 100 determines to add the Level 1 compressed preview image of image 1 to message content 1. Upon detecting that the user clicks on the Send control 209, the terminal device 100 can transmit the Level 1 compressed data a1 of image 1 to the satellite device.
[0195] As shown in Figures 7C and 7D , upon receiving and responding to a user click on the Level 2 compression preview control 842, the terminal device 100 compresses image 2 using a Level 2 compression algorithm to obtain compressed data a2, then decompresses compressed data a2 to obtain and display a Level 2 compressed preview image. At this point, upon receiving and responding to a user click on the Confirm control 307, the terminal device 100 determines to add the Level 2 compressed preview image of image 1 to message content 1. Upon detecting that the user clicks on the Send control 209, the terminal device 100 can transmit the Level 2 compressed data a2 of image 1 to the satellite device.
[0196] For how to obtain the compressed preview image based on the compressed data, please refer to the relevant description of the above embodiment, which will not be repeated here.
[0197] It can be understood that in the above embodiment, the sender can comprehensively consider the image quality of the compressed preview image with level 1 compression, the data size after level 1 compression and the expected transmission time, and the image quality of the compressed preview image with level 2 compression, the data size after level 2 compression and the expected transmission time to determine which compression level to select.
[0198] In one implementation, the compression algorithm for each compression level provided in the embodiments of the present application can control the compressed data volume to within the maximum data volume supported by the satellite device for a single transmission. In another implementation, the compressed data volume corresponding to a compression level can be less than or greater than the data volume supported by the satellite for a single transmission. When the data volume exceeds the maximum data volume supported by the satellite for a single transmission, the compressed data can be split into multiple data packets and sent multiple times.
[0199] Similarly, for other rich media information, the terminal device 100 may also provide different compression levels for the user to choose.
[0200] Interface Example 3
[0201] In the third embodiment of the interface, after the terminal device 100 obtains the rich media information 1, it compresses the rich media information 1 and obtains the compressed data of the rich media information 1, specifically including: lossy compression of the non-critical part of the rich media information 1, no compression, lossless compression, or lossy compression with a low loss rate on the critical part of the rich media information 1; the rich media information 1 may include one or more critical parts, and the non-critical part is the part other than the critical part of the rich media information 1. The compressed data 1 of the rich media information 1 includes the compressed data of the critical part and the compressed data of the non-critical part; in the rich media information 2 obtained after decompression of the compressed data 1, the clarity of the critical part is higher than that of the non-critical part. In this way, while reducing the amount of data required for transmission of the rich media information 1, the critical information indicated by the critical part in the rich media information 1 is effectively retained, ensuring that the recipient can obtain the critical information.
[0202] In the embodiment of the present application, the terminal device 100 may automatically identify the key portion in the rich media information 1 , or the user may manually select the key portion in the rich media information 1 .
[0203] Exemplarily, the rich media information 1 is an image 1, and the key part of the image 1 is usually the key area in the image 1 that needs to be kept clear (for the sake of ease of description, it may be referred to as the key area below), and the key area may include the display area of the preset object in the image 1. The above-mentioned preset object may be manually selected by the user, or it may be automatically recognized by the terminal device 100 according to a preset configuration file, and the above-mentioned configuration file records various preset objects that need to keep the image clear. For example, the preset object may include a road sign, and the text and road signs in the road sign may indicate the location of the person to be rescued. For example, the preset object may include a person or an injured part of a person, so that the recipient can clearly observe the health status of the person to be rescued in the image 1. The above-mentioned key area may be an area of a specific shape (such as a rectangle) including the preset object, or it may be an irregular closed area formed by the edge line of the preset object, which is not specifically limited here.
[0204] Exemplarily, the rich media information 1 is video 1, and the key part may include the display area of a preset object in each frame image of video 1. The above-mentioned preset object may be manually selected by the user, or automatically identified by the terminal device 100 according to the above-mentioned preset configuration file. In one implementation, when the terminal device 100 displays a frame image of video 1 (for example, the first frame image), it detects the user's operation (for example, a click operation) on the object 1 in the frame image, and the terminal device 100 determines that the key part of video 1 includes the display area of object 1 in each frame image of video 1. After the user selects the preset object in the first frame image, the terminal device 100 can automatically identify the display area of the preset object (for example, object 1) in each frame image of video 1.
[0205] For example, rich media information 1 is video 1, and the key portion of video 1 may be a specified time period in video 1, which may be user-selected. For example, if video 1 is 15 seconds long, the key portion may be between 5 and 10 seconds of video 1.
[0206] For example, the rich media information 1 is audio 1, and the key portion of the audio 1 may be the sound emitted by a preset object (e.g., a person) in the audio 1. The terminal device 100 may automatically identify the sounds emitted by various preset objects in the audio 1 according to a preset configuration file; the configuration file records various preset objects, such as people, whose sounds need to be kept clear.
[0207] For example, the rich media information 1 is audio 1, and the key portion of audio 1 may be the audio of a specified time period in audio 1, which may be selected by the user. For example, if audio 1 is 12 seconds long, the key portion may be the audio between 5 seconds and 12 seconds of audio 1.
[0208] The following takes the rich media information 1 being image 1 as an example to introduce the relevant user interfaces of the third interface embodiment in detail.
[0209] For example, FIG8A to FIG9G show relevant user interfaces for a user to manually select a key area of an image 1. ...
[0210] 8A to 8O illustrate an implementation scheme in which a user manually selects a key area of an image 1 .
[0211] As shown in Figures 8A and 8B , upon detecting and responding to a user clicking on a capture control 304 on the capture preview interface 15, the terminal device 100 captures an image 1 and displays a user interface 31. The user interface 31 includes the image 1, a confirmation control 801, and a return control 802; the return control 802 is used to return to the capture preview interface 15. The user interface 31 allows the user to confirm whether the captured image is suitable. If not, the user can return to the capture preview interface 15 and retake the image.
[0212] As shown in Figures 8B and 8C , upon receiving and responding to a user clicking on the confirmation control 801, the terminal device 100 displays the compressed preview interface 32. The compressed preview interface 32 includes the image 1, the compressed preview control 803, prompt information 804, prompt information 805, a selection control 806, a confirmation control 807, and a return control 808. In another implementation, as shown in Figures 8A and 8C , upon detecting a user clicking on the capture control 304 of the capture preview interface 15, the terminal device 100 may directly display the compressed preview interface 32, i.e., without displaying the user interface 31.
[0213] The compression preview control 803 is used to trigger the terminal device 100 to compress and decompress the image 1 and obtain a compressed preview image of the image 1. The prompt information 4 is used to prompt "the user manually selects the area that he wants to keep clear (i.e., the key area), and the image information in the area will be retained to the greatest extent when transmitting the satellite message." The prompt information 805 is used to prompt "when the selection control 806 is selected, the user can instantly preview the compressed preview image of the image 1 after a preset time (e.g., 3 seconds) each time he adjusts the selection box of the key area." The image clarity of the area corresponding to the above selection box in the compressed preview image (i.e., the key area) is higher than the image clarity of the area outside the above selection box (i.e., the non-key area). As shown in Figure 8C, the selection control 806 is currently in the selected state. The user can control the selection control 806 to switch between the selected state and the unselected state by acting on the preset operation (e.g., clicking operation) on the selection control 806. The return control 808 is used to return to the shooting preview interface 15.
[0214] In some embodiments, when the user does not select the selection control 806, it is necessary to trigger the terminal device 100 to compress and decompress the image 1 through the compression preview control 803, and obtain and display the compressed preview image of the image 1. When the user selects the selection control 806, even if the compression preview control 803 is not operated, the terminal device 100 may also automatically display the compressed preview image of the image 1 after the selection box of the key area is initially generated and the preset time period for each user to adjust the selection box; when the user selects the selection control 806, the user may also trigger the terminal device 100 to display the compressed preview image of the image 1 through the compression preview control 803 after the selection box of the key area is initially generated and the preset time period for each user to adjust the selection box.
[0215] As shown in Figures 8C and 8D , upon detecting a user's sliding operation on image 1, terminal device 100 displays a selection box 809 for the key area. The upper left corner of selection box 809 represents the starting point of the sliding operation on image 1, and the lower right corner of selection box 809 represents the most recent contact point of the sliding operation on image 1. After terminal device 100 displays selection box 809, the user can adjust the position, size, and shape of selection box 809 within image 1, namely, by dragging selection box 809 on image 1, enlarging selection box 809, shrinking selection box 809, changing the length, or changing the width of selection box 809 through specific operations.
[0216] In another implementation, after the user clicks the confirmation control 801, the terminal device 100 automatically displays the initial selection box 809 on the image 1 when displaying the compressed preview interface 32, without the user having to generate the selection box 809 through the above sliding operation.
[0217] As shown in FIG8E , after the user adjusts the position, size, and shape of selection box 809, selection box 809 now includes the street sign in image 1. As shown in FIG8F , after the user stops adjusting selection box 809 for the preset duration, terminal device 100 performs a compressed preview of image 1 based on selection box 809, obtains and displays a compressed preview image of image 1. In the compressed preview image, the image clarity of the area corresponding to selection box 809 is higher than that of other areas, allowing the recipient to effectively obtain the address information indicated by the street sign within selection box 809.
[0218] In one implementation, as shown in FIG8F , when terminal device 100 displays the compressed preview image corresponding to image 1, it may also display a reselection control 810 and a comparison control 811. As shown in FIG8F and FIG8G , upon detecting and responding to a user clicking on reselection control 810, terminal device 100 may redisplay image 1 and selection box 809, allowing the user to continue adjusting the position, size, and shape of selection box 809. Comparison control 811 is used to compare image 1 with the compressed preview image. For details, please refer to the description of comparison control 308 and will not be repeated here.
[0219] As shown in Figures 8H and 8I, when the terminal device 100 displays the compressed preview image corresponding to image 1, it detects and responds to the user's click on the confirmation control 807, displays the compressed preview image icon 817 in the display area 310 of the new message interface 14, and adds the above-mentioned compressed preview image to the message content 1 of the Beidou satellite message 1.
[0220] As shown in FIG8I , upon receiving and responding to a user clicking the send control 209, the terminal device 100 sends the edited Beidou satellite message 1, message content 1, to the recipient's terminal device 200 via the satellite communication system 10. As shown in FIG8J , after the message is sent, the terminal device 100 may display the recipient's information interface 21. Information interface 21 may display the message content 1 of the sent Beidou satellite message 1, including a compressed preview image of image 1.
[0221] In the embodiment of the present application, the terminal device 100 can receive Beidou satellite message 1 through the Changlian app / SMS app. The message content of Beidou satellite message 1 displayed by the terminal device 200 may include a compressed preview image of image 1, a schematic diagram of the compressed preview image, or a URL link of the compressed preview image. For details, please refer to the relevant descriptions of Figures 3A to 3G.
[0222] For example, taking the Changlian app as an example, as shown in FIG8K , after receiving Beidou satellite message 1, the Changlian app on the recipient's terminal device 200 displays the message content 2 of Beidou satellite message 1 on the sender's information interface 23. Message content 2 includes a URL link 812 for a compressed preview image of image 1. As shown in FIG8K and FIG8L , upon receiving and responding to a user clicking on URL link 812, the terminal device 100 obtains and displays the webpage 33 corresponding to URL link 812. Webpage 33 displays a compressed preview image corresponding to image 1. The image clarity of the key areas of the compressed preview image is higher than that of the non-key areas. Road signs are displayed in the key areas, allowing the recipient to effectively obtain the address information indicated by the road signs.
[0223] In some embodiments, as shown in FIG8M , after the terminal device 100 obtains and displays the compressed preview image corresponding to the image 1 according to the position of the selection box 809 , the user can continue to select the key area that he wants to keep clear.
[0224] As shown in Figures 8M and 8N , upon detecting a user's sliding operation on the compressed preview image, terminal device 100 displays a selection box 809 for a key area and a selection box 813 for another key area on Image 1. The upper left corner of selection box 813 marks the starting point of the sliding operation on the screen, and the lower right corner of selection box 809 marks the most recent contact point of the sliding operation on the screen. After terminal device 100 displays selection box 813, the user can adjust the position, size, and shape of selection box 813 within Image 1.
[0225] As shown in Figure 8O, selection box 813 includes the person in image 1. After the user stops adjusting the preset length of selection box 813, the terminal device 100 compresses and previews image 1 based on selection box 809 and selection box 813, obtains and displays the compressed preview image corresponding to image 1. The image clarity of the areas corresponding to selection box 809 and selection box 813 in the compressed preview image 1 is higher than the image clarity of other areas. The recipient can effectively observe the status of the person in the area corresponding to selection box 813, such as whether he is injured, mental state, etc.
[0226] 9A to 9G illustrate another implementation scheme in which a user manually selects a key portion of an image 1 .
[0227] In some embodiments, as shown in FIG9A , the compressed preview interface 32 may include an add control 816 , and the prompt 804 is used to prompt the user to manually select the area that they want to keep clear by clicking “+” (i.e., add control 816 ). As shown in FIG9A and FIG9B , after detecting that the user clicks on the add control 816 , the terminal device 100 displays a selection box 814 for the key area. As shown in FIG9C and FIG9D , similar to the aforementioned selection box 809 , the user can adjust the position, size, and shape of the selection box 814 so that it includes the road sign in image 1; after the user stops adjusting the preset length of the selection box 814, the terminal device 100 obtains and displays a compressed preview image of image 1 based on the position of the selection box 814 , and the image clarity of the area corresponding to the selection box 814 in the compressed preview image is higher than the image clarity of other areas.
[0228] As shown in Figures 9D and 9E , after detecting that the user has clicked on add control 816 again, terminal device 100 displays a selection box 815 for another key area. As shown in Figure 9F , the user can adjust the position, size, and shape of selection box 815 to include the person in image 1. As shown in Figure 9G , after the user stops adjusting selection box 815 for the preset duration, terminal device 100 obtains and displays a compressed preview image of image 1 based on the positions of selection boxes 814 and 815. The image clarity of the areas corresponding to selection boxes 814 and 815 in the compressed preview image is higher than that of other areas.
[0229] In an embodiment of the present application, the terminal device 100 performs compression preview processing on image 1 to obtain a compressed preview image of image 1, including: compressing image 1 using a preset compression algorithm to obtain compressed data a of image 1; decompressing the compressed data a of image 1 to obtain a compressed preview image of image 1. In the third interface embodiment, during the process of compressing image 1, the terminal device 100 does not compress the key area within the selection box, performs lossless compression or lossy compression with a second loss rate, and performs lossy compression with a first loss rate on the non-key area outside the selection box, where the first loss rate is higher than the second loss rate. In this way, the image clarity of the key area corresponding to the selection box in the compressed preview image is higher than that of the non-key area, and the user can effectively obtain the image information in the key area.
[0230] In some embodiments, when a user selects a box to adjust a key area that they want to keep clear, the terminal device 100 provides different compression level options for the key area corresponding to the box; for example, the level 1 compression option 821 and the level 2 compression option 822 shown in Figure 10A. Compared to the level 2 compression, the key area corresponding to the box in the compressed preview image after level 1 compression has higher clarity.
[0231] For example, as shown in FIG10A , prompt information 804 may also be used to prompt whether to perform level 1 or level 2 compression on the key area within the selection box. Prompt information 805 may also be used to prompt that when the selection control 806 is selected, each time the preset duration of the selection box is adjusted, the terminal device 100 may automatically perform level 2 compression on the key area within the selection box. It is understood that the user may also manually select the compression level of the key area using the level 1 compression option 821 and the level 2 compression option 822.
[0232] In one implementation, the option 821 of the level 1 compression is used to indicate that the key area is not to be compressed, and the option 822 of the level 2 compression is used to indicate that the key area is to be losslessly compressed.
[0233] For example, as shown in Figures 10A and 10B, after the user adjusts checkbox 809 and receives and responds to a click on option 821 for level 1 compressed preview, terminal device 100 performs a compressed preview process on image 1, obtaining a compressed preview image corresponding to image 1; this compressed preview image is identical to the image of the key area corresponding to checkbox 809 in image 1. In one implementation, terminal device 100 obtains compressed data a of image 1, including: performing lossy compression on a non-key area of image 1 using a preset compression algorithm to obtain compressed data a1 of the non-key area of image 1; and obtaining image data a2 of the key area of image 1, wherein compressed data a of image 1 includes compressed data a1 and image data a2. Terminal device 100 decompresses compressed data a of image 1 to obtain a compressed preview image corresponding to image 1, including: decompressing compressed data a1 of the non-key area using a preset compression algorithm, and synthesizing the compressed preview image based on the decompressed image data and image data a2.
[0234] For example, as shown in Figures 10C and 10D , after the user adjusts checkbox 813, the terminal device 100 receives and responds to a click on option 822 for level 2 compression preview, performing compression preview processing on image 1 to obtain a compressed preview image of image 1. The key area corresponding to checkbox 813 in the compressed preview image has higher image clarity than the non-key area of the compressed preview image. The key area corresponding to checkbox 813 has lower image clarity than the key area corresponding to checkbox 809. In one implementation, the terminal device 100 obtains compressed data a of image 1 by: performing lossy compression on the non-key area of image 1 using a preset compression algorithm 1 to obtain compressed data a1 for the non-key area of image 1; performing lossless compression on the key area of image 1 using a preset compression algorithm 2 for level 2 compression to obtain compressed data a3 for the key area of image 1. The compressed data a of image 1 includes compressed data a1 and compressed data a3. The terminal device 100 decompresses the compressed data a of image 1 to obtain a compressed preview image of image 1, including: decompressing the compressed data a1 of the non-critical area using the preset compression algorithm 1 to obtain image data 1 of the non-critical area; decompressing the compressed data a3 of the critical area using the preset compression algorithm 2 to obtain image data 3 of the critical area; and synthesizing a compressed preview image based on image data 1 and image data 3.
[0235] In another implementation, option 821 of level 1 compression is used to indicate that the key area is not compressed, and option 822 of level 2 compression is used to indicate that the key area is lossily compressed with a second loss rate, which is lower than the first loss rate.
[0236] In another implementation, option 821 for level 1 compression is used to indicate lossy compression of the key area with a loss rate of 1, and option 822 for level 2 compression is used to indicate lossy compression of the key area with a loss rate of 2, where loss rate 1 is lower than loss rate 2, and loss rate 2 is lower than the first loss rate.
[0237] For example, FIG. 11A to FIG. 11D illustrate user interfaces related to the terminal device 100 automatically identifying key areas of the image 1 .
[0238] As shown in Figures 11A and 11B , after the user clicks the confirmation control 801, the terminal device 100 displays a compressed preview interface 32 including the image 1, a compressed preview control 831, a prompt message 832, and a selection control 833. Prompt message 832 indicates that "when the selection control 833 is selected, the terminal device 100 can automatically identify key areas and preserve the image information of these areas to the greatest extent possible." As shown in Figure 8C , the selection control 833 is currently selected. The user can control the selection control 833 to switch between a selected and unselected state by performing a preset operation (e.g., a click) on the selection control 833.
[0239] As shown in FIG11B , upon detecting and responding to a click on the compressed preview control 831 , the terminal device 100 displays a key area selection box 809 . The terminal device 100 automatically identifies the key area in image 1 and obtains and displays a compressed preview image of image 1 as shown in FIG11C or FIG11D . The image clarity of the key area in the compressed preview image is higher than that of other areas. In a solid line approach, the terminal device 100 automatically identifies the key area in image 1 based on a preset profile, where the preset profile indicates one or more preset objects. Exemplarily, the preset objects indicated by the preset profile include road signs but not people. The terminal device 100 displays the compressed preview image shown in FIG11C , where the key area of the compressed preview image displays a road sign. Exemplarily, the preset objects indicated by the preset profile include road signs and people. The terminal device 100 displays the compressed preview image shown in FIG11D , where the compressed preview image includes two key areas, one of which displays a road sign and one of which displays a person.
[0240] Interface Example 4
[0241] In the fourth interface embodiment, terminal device 100 can extract text information 2 from key portion 1 of rich media information 1 and display text information 2 on a compressed preview interface, and / or include text information 2 in a Beidou satellite message sent to a recipient. Rich media information 1 can include one or more key portions, and key portion 1 is any one of the one or more key portions.
[0242] Exemplarily, taking the rich media information 1 as an example, FIG. 12A to FIG. 12H illustrate relevant user interfaces of the terminal device 100 extracting text information of a key area of the image 1 .
[0243] As shown in FIG12A , the compressed preview interface 32 may further include prompt information 901 and a selection control 902. Prompt information 901 indicates that "when selection control 902 is selected, the terminal device 100 may extract the text information in the area that the user wants to keep clear and include the text information when sending the message." As shown in FIG12A , selection control 902 is currently selected, and the user can control selection control 806 to switch between a selected state and an unselected state through input operations (e.g., a click operation).
[0244] As shown in Figures 12A and 12B, the selection box 809 of the key area includes the road sign in image 1. When it is detected that the user stops adjusting the selection box 809 for a preset period of time or the user clicks the compressed preview control 803, the terminal device 100 performs a compressed preview process on image 1 based on the position of the selection box 809, obtains and displays the compressed preview image of image 1, and simultaneously extracts and displays the text information 903 of the key area within the selection box 809. Optionally, as shown in Figure 12B, the terminal device 100 can display the text information 903 in the prompt information 901.
[0245] As shown in Figures 12B and 12C, when the terminal device 100 displays the compressed preview image of image 1, it receives and responds to the user's operation of clicking the confirmation control 807, displays the icon 309 of the compressed preview image in the display area 310 of the new message interface 14, and adds the above-mentioned compressed preview image to the message content 1 of the Beidou satellite message 1.
[0246] As shown in FIG12C , in response to a user clicking the send control 209, the terminal device 100 sends the edited Beidou satellite message 1 (content 1) to the recipient's terminal device 200 via the satellite communication system 10. As shown in FIG12D , after the message is sent, the terminal device 100 may display the recipient's information interface 21. Information interface 21 displays the message content 1 of the sent Beidou satellite message 1, which includes a compressed preview image of image 1 and the text information 903 in the key area.
[0247] In the embodiment of the present application, the terminal device 100 can receive Beidou satellite message 1 through the Changlian app / SMS app. For details, please refer to the relevant descriptions of Figures 3A to 3G. Taking the Changlian app as an example, after receiving Beidou satellite message 1, the Changlian app of the recipient's terminal device 200 displays the message content 2 of Beidou satellite message 1 on the sender's information interface 23.
[0248] For example, as shown in Figures 12E and 12F , message content 2 includes a URL link 904 for a compressed preview image of image 1 and text information 903 in the key area. Upon receiving and responding to a user clicking on URL link 904, terminal device 100 retrieves and displays web page 35 corresponding to URL link 904. Web page 35 displays a compressed preview image of image 1 and text information 903 in the key area of the compressed preview image. Alternatively, web page 35 may not display text information 903.
[0249] For example, as shown in Figures 12G and 12H , message content 2 includes a schematic diagram 905 of a compressed preview image of image 1 and text information 903 in the key area. Upon receiving and responding to a user clicking on schematic diagram 905 , terminal device 100 displays the compressed preview image of image 1 and text information 903 in the key area on user interface 36. Optionally, user interface 36 may not display text information 903.
[0250] In some embodiments, the text information 2 extracted from the key portion 1 of the rich media information 1 can also be used to assist in obtaining the rich media information 2, so as to enhance the accuracy and clarity of the text in the key portion 1 of the rich media information 2. In one implementation, the terminal device 100 decompresses the compressed data of the rich media information 1, which may include: decompressing the compressed data of the rich media information 1 using a decompression algorithm corresponding to a preset compression algorithm to obtain rich media information 3; and identifying and enhancing the text in the key portion 1 of the rich media information 3 using a text enhancement algorithm and the text information 2 to obtain the enhanced rich media information 4. Optionally, the rich media information 4 is the aforementioned rich media information 2. Optionally, a preset rich media information enhancement algorithm (such as the aforementioned image enhancement algorithm, video enhancement algorithm, audio enhancement algorithm) can also be used to perform overall enhancement on the rich media information 4 to obtain the overall enhanced rich media information 2.
[0251] It is understood that the position of key portion 1 is the same in rich media information 1, rich media information 2, rich media information 3, and rich media information 4. When the preset compression algorithm is a lossy compression algorithm, the text indicated by key portion 1 in rich media information 3 is relatively blurry compared to rich media information 1. Using the previously extracted text information 2 for enhancement processing can improve the accuracy and clarity of the text. The above-mentioned text enhancement algorithm can be a trained neural network algorithm, and the present embodiment does not specifically limit the text enhancement algorithm.
[0252] It can be understood that when the rich media information 1 is an image 1 or a video 1, the text information 2 can be the text displayed in the key part of the image 1 or the video 1, and the text information 2 can be used to improve the accuracy and clarity of the text displayed in the key part; when the rich media information 1 is a video 1 or an audio 1, the text information 2 can be the voice played in the key part of the video 1 or the audio 1, and the text information 2 can be used to improve the accuracy and clarity of the voice played in the key part.
[0253] In the fourth interface embodiment, the terminal device 100 may uniformly use the same lossy compression algorithm for the key part and the non-key part of the rich media information 1, or may use lossy compression algorithms with different loss rates, which is not specifically limited here.
[0254] Similarly, when the rich media information 1 is video 1, the terminal device 100 can extract the text information in the key part of video 1; when the rich media information 1 is audio 1, the terminal device 100 can provide the text information corresponding to the key part of audio 1 (such as the sound emitted by the preset object).
[0255] It should be noted that the relevant user interfaces and technical solutions described in Interface Example 2 to Interface Example 4 can also be adaptively expanded to be applicable to video and audio. The specific details will not be repeated here. In Interface Example 2 to Interface Example 4, the specific embodiments of the same interface can be combined with each other. Referring to Figures 2A to 12H, the user interfaces involved in Interface Example 1 to Interface Example 4 are exemplary interfaces provided in the embodiments of the present application and should not constitute a limitation on the embodiments of the present application; the same user interface in the embodiments of the present application may include more or fewer interface elements.
[0256] The operations involved in the embodiments of the present application (such as click operations, touch operations) are exemplary operations used to implement specified functions. The terminal device 100 / terminal device 200 can also implement the above-mentioned specified functions through other operations; for example, the above-mentioned other operations can also be other touch operations, stylus operations, double-click operations, gesture operations, voice commands and other operations. The embodiments of the present application do not specifically limit the above-mentioned other operations.
[0257] In combination with the aforementioned satellite communication system and application scenarios, the satellite communication method provided in the embodiments of the present application is described in detail below.
[0258] For example, FIG13 shows a flowchart of a satellite communication method provided by an embodiment of the present application. The above method includes some or all of steps S101 to S115. The following is a detailed description of possible implementations of the method.
[0259] S101. The Changlian APP of the terminal device 100 receives a first input operation.
[0260] S102 . In response to the first input operation, the Changlian APP of the terminal device 100 obtains rich media information 1 .
[0261] In this embodiment of the present application, a user can edit Beidou Satellite Message 1 through the Changlian app on terminal device 100. Text information, location information, and rich media information, such as Rich Media Message 1, can be added to Beidou Satellite Message 1. Rich media information can include images, videos, audio, animations, and other types, which are not specifically limited in this embodiment of the present application. Beidou Satellite Message 1 can contain one or more rich media information, and any two of these multiple rich media information can be of the same or different types. For example, Beidou Satellite Message 1 may include multiple images; for example, Beidou Satellite Message 1 may include both an image and a video.
[0262] For example, referring to the descriptions of Figures 2A to 2I , a sender can create a Beidou satellite message 1 through the Changlian app on the terminal device 100, select a recipient of the Beidou satellite message 1 on the new message interface 14, and edit the message content 1 of the Beidou satellite message 1. When editing the message content 1, rich media information 1 can be obtained so that a compressed preview of the rich media information 1 (i.e., rich media information 2) can be added to the message content 1.
[0263] 2E to 2I , the rich media information 1 may be an image 1 captured in real time, and the first input operation is for capturing the image 1. As shown in FIG2E , the new information interface 14 may include a camera control 210. The user may use the camera control 210 to trigger the terminal device 100 to display a capture preview interface 15. The capture preview interface 15 includes a capture control 304. The first input operation may include an operation acting on the capture control 304 (e.g., a click operation).
[0264] Referring to the relevant description of FIG4B , the rich media information 1 may also be an image in a local gallery, a video in a local gallery, a real-time shot video, a real-time recorded audio, and the like.
[0265] 4A to 4I , the rich media information 1 may be a video 1 in a local gallery, and the first input operation is used to select video 1 from the local gallery. The new information interface 14 may include a video control 605, through which the user may trigger the terminal device 100 to display the cover of each video in the local gallery, such as the cover 608 of video 1. The first input operation may include an operation acting on the cover 608 of video 1 (e.g., a click operation).
[0266] 5A to 5F , rich media information 1 may include user-recorded audio 1, and a first input operation is used to obtain real-time recorded audio 1. New message interface 14 may include a recording control 606, through which a user may trigger terminal device 100 to display recording interface 27, which is used to record audio. Recording interface 27 includes a confirmation control 702, which is used to confirm recorded audio 1. The first input operation may include an operation (e.g., a click) on confirmation control 702.
[0267] S103 , the Changlian APP of the terminal device 100 compresses and encodes the rich media information 1 using a preset compression algorithm to obtain compressed data 1 .
[0268] In some embodiments, the terminal device 100 may provide multiple compression algorithms, and the terminal device 100 may select an appropriate compression algorithm according to a preset strategy to compress and encode the rich media information 1 .
[0269] In one implementation, the plurality of compression algorithms include compression algorithms for images, videos, and audio, respectively. The terminal device 100 may select a preset compression algorithm from the plurality of compression algorithms based on the type of the rich media information 1. For example, if the rich media information 1 is image 1, the preset compression algorithm is a compression algorithm for images.
[0270] In some embodiments, the preset compression algorithm is a large-scale compression encoding algorithm, and the data size of the compressed data 1 can be controlled within 1KB or even smaller. In one implementation, the preset compression algorithm uses a biological vision information processing engine (NVPE), which is a processing engine trained using a large number of images. When the input of the engine is rich media information 1, the output is compressed data 1. The embodiments of the present application may also sample other compression algorithms, which are not specifically limited here.
[0271] In some embodiments, the preset compression algorithm is a lossy compression algorithm, the compressed data 1 is lossy compressed data, and the rich media information 2 obtained by decompressing the compressed data 1 can be regarded as lossy rich media information 1 .
[0272] In some embodiments, the terminal device 100 provides a lossy compression algorithm and a lossless compression algorithm; the compressed data after losslessly compressing the rich media information 1 using the lossless compression algorithm can be directly decompressed into the rich media information 1. When the terminal device 100 determines that the data size of the compressed data after the lossless compression of the rich media information 1 is less than the maximum data size supported by the satellite device for a single transmission, the terminal device 100 compresses the rich media information 1 using the lossless compression algorithm; otherwise, the terminal device 100 compresses the rich media information 1 using the lossy compression algorithm so that the data size of the lossy compressed data is less than the maximum data size supported by the satellite device for a single transmission.
[0273] S104 . The Changlian APP of the terminal device 100 decompresses the compressed data 1 , obtains and displays the rich media information 2 , and the rich media information 2 is used by the sender to preview the rich media information corresponding to the rich media information 1 actually received by the recipient.
[0274] In some embodiments, step S104 specifically includes: the terminal device 100 decompresses the compressed data 1 using a decompression algorithm corresponding to a preset compression algorithm to obtain decompressed rich media information 2. Rich media information 2 is lossy rich media information 1; compared to rich media information 1, rich media information 2 lacks details, but rich media information 1 and rich media information 2 may contain the same valid information.
[0275] In some embodiments, step S104 specifically includes: the terminal device 100 decompresses the compressed data using a decompression algorithm corresponding to a preset compression algorithm, obtains the decompressed rich media information, and then enhances the decompressed rich media information using a preset enhancement algorithm to obtain the enhanced rich media information 2.
[0276] In some embodiments, in response to a first input operation, the terminal device 100 executes S103, compresses and encodes the rich media information 1, and obtains compressed data 1; upon receiving and responding to a third input operation, the terminal device 100 executes S104, decompresses the compressed data 1, and obtains compressed preview information of the rich media information 1, i.e., rich media information 2.
[0277] In some embodiments, in response to the first input operation, the terminal device 100 executes S103 and S104, i.e., compresses and decompresses the rich media information 1 to obtain the rich media information 2. It is understood that after obtaining the rich media information 1, the terminal device 100 automatically uses a preset compression algorithm to compress and decompress the obtained rich media information 1 to obtain the rich media information 2.
[0278] In some embodiments, the Changlian APP of the terminal device 100 receives a third input operation; in response to the third input operation, the terminal device 100 executes S103 and S104, that is, compresses and decompresses the rich media information 1 to obtain the rich media information 2.
[0279] In the aforementioned first interface embodiment, referring to the descriptions in Figures 2G and 2H , rich media information 1 may be image 1, rich media information 2 may be image 2 / image 3, and the third input operation may include an operation (e.g., a click) on the compressed preview control 306. Referring to the descriptions in Figures 4D to 4H , rich media information 1 may be video 1, rich media information 2 may be video 2 / video 3, and the third input operation may include an operation (e.g., a click) on the compressed preview control 611. Referring to the descriptions in Figures 5D and 5E , rich media information 1 may be audio 1, rich media information 2 may be audio 2 / audio 3, and the third input operation may include an operation (e.g., a click) on the compressed preview control 704.
[0280] In the aforementioned second interface embodiment, taking the case where rich media information 1 is image 1 as an example, as described in the relevant descriptions of Figures 7A to 7D , terminal device 100 provides multiple compression levels, and the aforementioned multiple compression algorithms include compression algorithms corresponding to the aforementioned multiple compression levels; in steps S103 and S104, terminal device 100 may perform compression encoding and decompression processing on image 1 according to the compression algorithm corresponding to the compression level selected by the user. For example, referring to Figures 7C and 7D , if the user selects level 2 compression, the third input operation may include an operation (e.g., a click) on level 2 compression preview control 842, and the preset compression algorithm is a level 2 compression algorithm.
[0281] In the aforementioned third interface embodiment, referring to the relevant descriptions of Figures 8A to 9G , the rich media information 1 includes one or more key parts and non-key parts; taking the rich media information 1 as an example, the image 1 includes a key area 1 and a non-key area. The third input operation may include an operation of generating / adjusting a selection box for the key area 1; or, after generating / adjusting a selection box for the key area 1, the third input operation may include an operation (e.g., a click operation) acting on the compression preview control 803. In step S103, the terminal device 100 uses a preset compression algorithm 1 to perform lossy compression on the non-key area of the image 1 at a first loss rate, obtaining compressed data a1 of the non-key area. The compressed data a of the image 1 includes compressed data a1; in step S104, the terminal device 100 uses the preset compression algorithm 1 to decompress the compressed data a1, obtaining the decompressed image data a1 of the non-key area. The terminal device 100 may not compress the key area 1 of the image 1, perform lossless compression, or perform lossy compression at a second loss rate; the second loss rate is lower than the first loss rate. For details, see the following implementations one to three.
[0282] In implementation method one, the terminal device 100 does not compress the key area 1 of image 1, and the compressed data a of image 1 also includes the image data of the key area 1 of image 1; in step S104, the terminal device 100 synthesizes the compressed preview image of image 1 based on the image data a1 of the non-key area and the image data of the key area 1 of image 1.
[0283] In implementation method 2, the terminal device 100 uses a preset compression algorithm 2 to losslessly compress the key region 1 of the image 1, obtaining compressed data a2 of the key region 1. The compressed data 1 of the image 1 includes the compressed data a1 of the non-key region and the compressed data a2 of the key region 1. In step S104, the terminal device 100 decompresses the compressed data a2 using the preset compression algorithm 2 to obtain image data a2 of the key region 1. The terminal device 100 synthesizes a compressed preview image of the image 1 based on the image data a1 of the non-key region and the image data a2 of the key region 1. The image 1 and the image in the key region 1 of the compressed preview image are identical.
[0284] In implementation method three, the terminal device 100 uses a preset compression algorithm 3 to perform lossy compression at a second loss rate on the key region 1 of the image 1, obtaining compressed data a2 of the key region 1. The second loss rate is lower than the first loss rate. The compressed data 1 of the image 1 includes compressed data a1 of the non-key region and compressed data a2 of the key region 1. In step S104, the terminal device 100 decompresses the compressed data a2 using the preset compression algorithm 2 to obtain image data a2 of the key region 1. The terminal device 100 synthesizes a compressed preview image of the image 1 based on the image data a1 of the non-key region and the image data a2 of the key region 1. Compared to the non-key regions of the compressed preview image, the key region 1 in the compressed preview image has higher image clarity; however, compared to the image 1, the key region 1 in the compressed preview image has lower image clarity.
[0285] In some embodiments, before step S104, terminal device 100 further extracts text information from the key portion of rich media information 1, for example, extracting first text information from the first key portion of rich media information 1. This first text information can be used to assist in obtaining rich media information 2 during the decompression process, thereby enhancing the accuracy and clarity of the text indicated by the first key portion of rich media information 2. For details, please refer to the relevant description of interface embodiment 4, which will not be repeated here.
[0286] In the aforementioned interface embodiment 3, referring to the relevant descriptions of FIG. 10A to FIG. 10D , multiple compression levels may be provided for key areas, and the terminal device 100 may compress and decompress the key areas according to the compression algorithm corresponding to the compression level selected by the user.
[0287] In the embodiment of the present application, terminal device 100 obtains and displays rich media information 2, allowing the sender to preview in advance the compressed preview information of rich media information 1 that the recipient can actually receive, namely, rich media information 2, to determine whether rich media information 2 conveys the valid information in rich media information 1. Step S104 is optional, and terminal device 100 may not need to obtain and preview the compressed preview information of rich media information 1, namely, rich media information 2.
[0288] S105 : The terminal device 100 receives a second input operation, where the second input operation is used to send a Beidou satellite message 1 edited by the user, where the message content 1 of the Beidou satellite message 1 includes rich media information 2 .
[0289] Exemplarily, referring to the relevant description of FIG. 2I , the second input operation includes an operation acting on the send control 209 (eg, a click operation).
[0290] S106 . The terminal device 100 sends a satellite request message 1 to the satellite device. The satellite request message 1 includes compressed data 1 of the rich media information 1 . The compressed data 1 is used to obtain the rich media information 2 . The satellite request message 1 is used to transmit the message content 1 of the Beidou satellite message 1 to the recipient.
[0291] In some embodiments, the satellite device includes a Beidou satellite 300 and a satellite ground station 400; the terminal device 100 sends a satellite request message 1 to the satellite device, including: the terminal device 100 sends a satellite request message 1 to the Beidou satellite 300; the Beidou satellite 300 sends a satellite request message 1 to the satellite ground station 400.
[0292] In some embodiments, the amount of compressed data 1 obtained using a preset compression algorithm is less than the maximum amount of data supported by the Beidou satellite 300 for a single transmission.
[0293] In some embodiments, the amount of compressed data 1 obtained using a preset compression algorithm may be greater than the maximum amount of data supported by a single transmission of Beidou satellite 300. When the amount of compressed data 1 is greater than the maximum amount of data supported by a single transmission, the compressed data 1 is split into multiple data packets, each with a smaller amount of data than the single transmission. In step S106, the multiple data packets are sequentially transmitted to Beidou satellite 300 multiple times.
[0294] In this embodiment of the present application, satellite request message 1 includes compressed data 1 of rich media information 1, which is used to obtain rich media information 2 from message content 1. Satellite request message 1 may also include the sender's and recipient's accounts of Beidou satellite message 1. Satellite request message 1 may also include non-rich media information from message content 1, such as text information and location information. Satellite request message 1 may also include an algorithm identifier for a preset compression algorithm. The aforementioned account may be a Changlian app account or a mobile phone number.
[0295] In some embodiments, terminal device 100 extracts the text information indicated by the key portion of rich media information 1, and satellite request message 1 also includes the text information. For example, as shown in FIG12B , rich media information 1 is image 1, and the key portion of image 1 includes a road sign indicating the following text information: "Town A (26 km), Village B (5 km), Mountain C (10 km)."
[0296] In an embodiment of the present application, when a user edits the message content 1 of a Beidou satellite message 1, multiple rich media information may be obtained. The terminal device 100 may compress each of the multiple rich media information, obtain the compressed data corresponding to each rich media information, and carry the compressed data of each rich media information in the satellite request message 1. For example, if the multiple rich media information includes image 1 and video 1, the satellite request message 1 may include compressed data a of image 1 and compressed data b of video 1.
[0297] In some embodiments, application layer encoding is performed on compressed data 1 of rich media information 1 and non-rich media information (such as text information, location information, etc.) in message content 1 based on the communication protocol of Beidou satellite 300 to generate satellite request message 1. For example, taking rich media information 1 as an example, Table 1 shows some fields of satellite request message 1.
[0298] Table 1
[0299] In some embodiments, after the second input operation triggers the Changlian app to send Beidou Satellite Message 1, before the terminal device 100 sends Satellite Request Message 1, the sender performs device calibration, satellite search, and alignment according to the interface instructions of the terminal device 100. After the satellite is aligned, the Satellite Request Message 1 is sent to the satellite ground station 400 via the Beidou satellite 300. For example, Figures 2J to 2M illustrate a set of user interfaces for device calibration, satellite search, and alignment.
[0300] S107. The satellite device sends an application request message 1 to the application server 500. The application request message 1 is determined based on the satellite request message 1. The application request message 1 includes compressed data 1 of the rich media information 1. The compressed data 1 is used to obtain the rich media information 2. The application request message 1 is used to request the transmission of the message content 1 of the Beidou satellite message 1 to the recipient.
[0301] In some embodiments, the satellite ground station 400 receives the satellite request message 1 sent by the Beidou satellite 300, generates an application request message 1, and sends the application request message 1 to the application server 500. The application request message 1 and the satellite request message 1 may contain the same valid information.
[0302] In an embodiment of the present application, the application request message 1 includes compressed data 1 of rich media information 1, and the compressed data 1 of rich media information 1 is used to obtain rich media information 2 in the message content 1; the application request message 1 may also include some or all of the following: the sender's account number of the Beidou satellite message 1, the recipient's account number, the non-rich media information in the message content 1, and the text information indicated by the key part of the rich media information 1.
[0303] Exemplarily, the application request message 1 also includes the fields shown in Table 1.
[0304] In one implementation, the application request message 1 is a short inbound message.
[0305] S108 . The application server 500 sends a confirmation message 1 to the satellite device. The confirmation message 1 is used to confirm receipt of the application request message 1 .
[0306] In some embodiments, the application server 500 sends a confirmation message 1 to the satellite ground station 400 .
[0307] In one implementation, confirmation message 1 is a system receipt corresponding to application request message 1, indicating confirmation of receipt of application request message 1. In one implementation, application request message 1 carries a message identifier (e.g., a message ID) of application request message 1; confirmation message 1 also carries the message identifier of application request message 1 to indicate application request message 1.
[0308] In some embodiments, the satellite ground station 400 determines whether a confirmation message 1 is received within a preset time duration 1 of sending the satellite request message 1 to the application server 500 of the Changlian APP; if not, the application request message 1 is sent to the application server 500 again to avoid the application server 500 not receiving the application request message 1. Step S108 is optional.
[0309] S109 . The application server 500 decompresses the compressed data 1 based on a preset compression algorithm, obtains the rich media information 2 , and determines that the message content 1 of the Beidou satellite message 1 includes the rich media information 2 .
[0310] In some embodiments, after receiving application request message 1, application server 500 of the Changlian app obtains message content 1 of Beidou satellite message 1 based on application request message 1. Specifically, application server 500 extracts non-rich media information (e.g., text information 1) and compressed data of rich media information (e.g., compressed data 1 of rich media information 1) of Beidou satellite message 1 from application request message 1. Application server 500 then decompresses compressed data 1 using a decompression algorithm corresponding to a preset compression algorithm to obtain rich media information 2. Application server 500 determines that message content 1 of Beidou satellite message 1 includes the aforementioned non-rich media information and rich media information 2. Exemplarily, rich media information 1 is image 1, and rich media information 2 is image 2 or image 3, with images 2 and 3 using common image formats, such as jpeg or png.
[0311] In some embodiments, both satellite request message 1 and application request message 1 carry an algorithm identifier for a preset compression algorithm. Application server 500 determines the preset compression algorithm based on the algorithm identifier and then decompresses compressed data 1 using a decompression algorithm corresponding to the preset compression algorithm. In some embodiments, satellite request message 1 and application request message 1 do not need to carry the algorithm identifier for the preset compression algorithm; relevant devices in the satellite communication system compress and decompress rich media information using the specified preset compression algorithm.
[0312] For step S110 , reference may be made to the implementation of decompressing the compressed data 1 in step S104 , which will not be described in detail here.
[0313] S110 , the application server 500 of the Changlian APP sends a confirmation message 2 to the satellite device. The confirmation message 2 is used to indicate that the application server 500 has obtained the message content 1 of the Beidou satellite message 1 indicated by the application request message 1 .
[0314] In some embodiments, the application server 500 of the Changlian APP sends a confirmation message 2 to the satellite device, including: the application server 500 sends a confirmation message 2 to the satellite ground station 400, and the satellite ground station 400 sends a confirmation message 2 to the Beidou satellite 300.
[0315] In one implementation, the confirmation message 2 is an application receipt receipt from the application server 500 .
[0316] In one implementation, the application request message 1 carries the message identifier of the application request message 1 , and the confirmation message 2 also carries the message identifier of the application request message 1 to indicate the application request message 1 .
[0317] S111 . The satellite device sends a confirmation message 3 to the terminal device 100 . The confirmation message 3 is used to indicate that the application server 500 has obtained the message content 1 of the Beidou satellite message 1 indicated by the satellite request message 1 .
[0318] In one implementation, satellite request message 1 carries the message identifier of satellite request message 1, and confirmation message 3 also carries the message identifier of satellite request message 1, indicating satellite request message 1. Terminal device 100 confirms, based on confirmation message 3, that application server 500 has obtained message content 1 of Beidou satellite message 1 indicated by satellite request message 1. Steps S110 and S111 are optional.
[0319] S112 , the application server 500 of the Changlian APP sends the message content 2 of the Beidou satellite message 1 to the Changlian APP of the terminal device 200 , where the message content 2 indicates the message content 1 of the Beidou satellite message 1 , including the rich media information 2 .
[0320] S113 , the Changlian APP of the terminal device 200 displays the message content 2 of the Beidou satellite message 1 .
[0321] In some embodiments, the Changlian APP provides a service number for Beidou satellite messages. In step S112, an identifier 1 is also sent along with the message content 2, and the identifier 1 indicates that the message content 2 comes from the Beidou satellite message; the Changlian APP of the terminal device 200 displays the message content 2 of the Beidou satellite message 1 through the service number of the Beidou satellite message based on the above identifier 1.
[0322] In some embodiments, after the application server 500 obtains the message content 1 of the Beidou satellite message 1 according to the application request message 1, it generates the message content 2 based on the message content 1. The message content 2 includes a URL link, such as a Uniform Resource Locator (URL), to the rich media information 2 in the message content 1. After step S113, upon receiving and responding to an operation (e.g., a click operation) on the URL link, the terminal device 200 may display the webpage corresponding to the URL link, which is used to display or play the rich media information 2.
[0323] For example, referring to the description related to Figures 3B and 3C , the message content 1 of Beidou satellite message 1 sent by the sender includes a compressed preview image of image 1 (e.g., image 2). The Changlian app of terminal device 200 displays message content 2 of Beidou satellite message 1 as shown in Figure 3B . Message content 2 includes a URL link 502 for image 2. After detecting that a user clicks on URL link 502, terminal device 200 displays image 2 on web page 24 corresponding to URL link 502. It will be understood that in this example, the message content of Beidou satellite message 1 displayed by terminal device 200 (i.e., message content 2) is different from the message content of Beidou satellite message 1 displayed by terminal device 100 (i.e., message content 1).
[0324] In some embodiments, before step S110, application server 500 sends a request to web server 700 for obtaining the rich media information 2. The request is used to obtain the URL link of rich media information 2. Web server 700 stores rich media information 2 and sends the URL link of rich media information 2 to application server 500. For example, as shown in FIG14 , after step S113, steps S116 to S119 may also be included.
[0325] S116 : The message content 2 includes a website link of the rich media information 2 , and the terminal device 200 receives a fourth input operation acting on the website link.
[0326] S117 . In response to the fourth input operation, the terminal device 200 sends a webpage request message to the webpage server 700 , requesting to obtain the webpage corresponding to the above-mentioned website link.
[0327] S118 . The web page server 700 sends the web page corresponding to the above-mentioned website link to the terminal device 200 .
[0328] S119 , the terminal device 200 displays the web page corresponding to the above-mentioned website link, and the web page displays rich media information 2 .
[0329] In some embodiments, before step S110, the application server 500 stores the rich media information 2 and generates a URL link for the rich media information 2; after step S113, the terminal device 200 may request the application server 500 to obtain the web page corresponding to the above URL link to view the rich media information 2 on the web page.
[0330] In one implementation, the message content 2 of the Beidou satellite message 1 displayed by the terminal device 200 is the same as the message content 1 of the Beidou satellite message 1 displayed by the terminal device 100 .
[0331] For example, referring to the relevant descriptions of Figures 3D and 3E , the message content 1 of the Beidou satellite message 1 sent by the sender includes text information 1 and a compressed preview image of image 1 (e.g., image 2). The Changlian app of terminal device 200 displays the message content 2 of Beidou satellite message 1 shown in Figure 3D , which includes image 2 and text information 1. It can be understood that in this example, the message content of Beidou satellite message 1 (i.e., message content 2) displayed by terminal device 200 can be equivalent to the message content of Beidou satellite message 1 (i.e., message content 1) displayed by terminal device 100.
[0332] In one implementation, the terminal device 100 can extract the text information 2 indicated by the key portion 1 of the rich media message 1. The text information 2 is included in the satellite request message 1, the application request message 1, and the message content 2. The message content 2 of the Beidou satellite message 1 displayed by the terminal device 200 also includes the text information 2. This ensures that the recipient can accurately obtain the text information indicated by the key portion of the rich media message 1.
[0333] For example, referring to the relevant descriptions of Figures 12A to 12H, taking the rich media information 1 as image 1 as an example, after the user adjusts the selection box 809 of the key area of image 1, the terminal device 100 can extract the text information 903 indicated by the road sign in the key area of image 1 and add the text information 903 to the Beidou satellite message 1 sent to the recipient; the message content 2 of the Beidou satellite message 1 received and displayed by the terminal device 200 includes the text information 903.
[0334] S114 . The application server 500 of the Changlian APP sends the message content 3 of the Beidou satellite message 1 to the SMS APP of the terminal device 200 . The message content 3 indicates the message content 1 of the Beidou satellite message 1 , including the rich media information 2 .
[0335] S115 . The SMS APP of the terminal device 200 displays the message content 3 of the Beidou satellite message 1 .
[0336] In some embodiments, the application server 500 of the Changlian APP sends a text message 1 to the terminal device 200 through the operator's network device 600 (eg, a short message gateway).
[0337] For possible implementations of message content 3, please refer to the relevant description of message content 2.
[0338] 3F and 3G , the SMS APP may display a URL link of the rich media information 2 (eg, a compressed preview image of image 1), or directly display the rich media information 2. For details, please refer to the description of step S113, which will not be repeated here.
[0339] In some embodiments, the application server 500 of the Changlian APP executes S112 and S113 (i.e., sending Beidou satellite message 1 to the Changlian APP of the terminal device 200), and also executes S114 and S115 (i.e., sending Beidou satellite message 1 to the SMS APP of the terminal device 200).
[0340] In some embodiments, when the Changlian APP determines that the recipient's mobile phone number has been registered with the Changlian APP account, S112 and S113 are executed; when the Changlian APP determines that the recipient's mobile phone number has not been registered with the Changlian APP account, S114 and S115 are executed.
[0341] In implementing the embodiments of the present application, the message format supported by the satellite device for sending and receiving messages includes a field for rich media information (such as compressed data of an image), and the satellite device has a mechanism for sending and receiving rich media information; the sender's terminal device 100 can compress high-data-volume rich media information (such as an image) and transmit the low-data-volume compressed data through the satellite device, effectively reducing the amount of data required to be transmitted by the satellite device. For specific application scenarios without a network (such as a rescue scenario), the sender can transmit richer and more diverse information to the recipient through the satellite device, effectively improving the user experience. Furthermore, in the embodiments of the present application, after the sender triggers the terminal device 100 through the first application to send compressed data 1 of rich media information 1 to the application server 500 of the first application through the satellite device, the application server 500 decompresses the compressed data 1 to obtain rich media information 2, and then sends the rich media information 2 to the recipient. In this way, the recipient's terminal device 200 does not need to integrate the relevant algorithm library for decompression processing and does not need to have decompression processing capabilities, which increases the device range of the recipient's terminal device 200 to which the embodiments of the present application are applicable. Furthermore, in the embodiment of the present application, in the compressed preview information of the rich media information 1 (i.e., the rich media information 2), the clarity of the key portion is higher than the clarity of the non-key portion; thus, while reducing the amount of data of the rich media information 1 required to be transmitted by the satellite device, the key portion of the rich media information 1 is retained as much as possible, ensuring that the recipient can effectively obtain the key portion of the information. In addition, in the embodiment of the present application, the terminal device 100 can extract the text information indicated by the key portion to improve the accuracy and clarity of the text in the key portion during the decompression process, and can also carry the text information in the Beidou satellite message transmitted to the recipient, so that the recipient can accurately obtain the text information indicated by the key portion of the rich media information 1.
[0342] In some embodiments, the application server 500 is not required to decompress the compressed data 1; the satellite ground station 400 decompresses the rich media information in the satellite request message 1, obtains the rich media information 2, and then obtains the message content 1 of the Beidou satellite message 1, and sends it to the terminal device 200 through the application server 500.
[0343] In some embodiments, the application server 500 does not need to decompress the compressed data 1. After the application server 500 sends the compressed data 1 to the terminal device 200, the terminal device 200 decompresses the compressed data 1 to obtain the rich media information 2, and then obtains and displays the message content 1 of the Beidou satellite message 1.
[0344] The present application provides a satellite communication method, which is applied to a satellite communication system. The satellite communication system includes a first terminal device, a first server, and a second terminal device. The method includes some or all of steps S201 to S207.
[0345] In an embodiment of the present application, the first terminal device may be the aforementioned terminal device 100, the second terminal device may be the aforementioned terminal device 200, the first server may be the aforementioned application server 500, and the satellite device may include the aforementioned Beidou satellite 300 and satellite ground station 400.
[0346] S201: A first application of a first terminal device receives a first input operation.
[0347] S202. In response to a first input operation, a first application of a first terminal device obtains first rich media information; the first application of the first terminal device obtains compressed data of the first rich media information.
[0348] In the embodiment of the present application, the first application may be the aforementioned Changlian APP or SMS APP, and the first rich media information may be the aforementioned rich media information 1.
[0349] S203: The first application of the first terminal device receives a second input operation.
[0350] S204: In response to the second input operation, the first terminal device sends a first request message to the first server through the satellite device, where the first request message includes compressed data of the first rich media information.
[0351] In the embodiment of the present application, the first request message may be the aforementioned satellite request message 1.
[0352] S205: The first server decompresses the compressed data of the first rich media information to obtain second rich media information.
[0353] S206: The first server sends the first message content to the second terminal device, where the first message content indicates the second rich media information.
[0354] S207. The second terminal device displays second rich media information based on the first message content.
[0355] In the embodiment of the present application, the second rich media information may be the aforementioned rich media information 2, and the first message content may be the aforementioned message content 2 or message content 3.
[0356] In one implementation, the first message content includes second rich media information.
[0357] In one implementation, the first message content includes a first URL link corresponding to the second rich media information; the above-mentioned second terminal device displays the second rich media information based on the first message content, including: in response to an input operation on the first URL link, the second terminal device displays the second rich media information on the first web page corresponding to the first URL link.
[0358] In one implementation, the first server sends the first message content to the second terminal device, including: the first server sends the first message content to the second application of the second terminal device; the second application includes an instant messaging application and / or a text message application.
[0359] In one implementation, before the first application of the first terminal device receives the second input operation, the method also includes: the first terminal device displays the first user interface of the first application, and the first user interface includes first rich media information; in response to the third input operation, the first terminal device decompresses the compressed data of the first rich media information, obtains and displays the decompressed second rich media information.
[0360] In one implementation, the first rich media information includes a non-critical portion and N critical portions; the second rich media information generated based on the first rich media information also includes a non-critical portion and N critical portions, where N is a positive integer greater than zero; the clarity of the critical portion of the second rich media information is higher than the clarity of the non-critical portion of the second rich media information; and the clarity of the non-critical portion of the second rich media information is lower than the clarity of the non-critical portion of the first rich media information.
[0361] In one implementation, the first terminal device obtains compressed data of the first rich media information, including: the first terminal device performs lossy compression with a first loss rate on a non-critical part of the first rich media information, obtains first compressed data of the non-critical part of the first rich media information, and the compressed data of the first rich media information includes the first compressed data; the first terminal device does not compress the critical part of the first rich media information, and the compressed data of the first rich media information includes the original data of the critical part of the first rich media information; or, the first terminal device performs lossless compression on the critical part of the first rich media information, obtains second compressed data of the critical part of the first rich media information, and the compressed data of the first rich media information includes the second compressed data; or, the first terminal device performs compression with a second loss rate on the critical part of the first rich media information, obtains third compressed data of the critical part of the first rich media information, and the compressed data of the first rich media information includes the third compressed data, and the second loss rate is lower than the first loss rate.
[0362] Exemplarily, the first rich media information may be the aforementioned image 1, and the second compressed data and the third compressed data may be the aforementioned compressed data a2.
[0363] In one implementation, the first user interface includes a first control, the third input operation acts on the first control, and the first control is used to trigger the first terminal device to obtain second rich media information corresponding to the first rich media information.
[0364] In an embodiment of the present application, the first user interface may be the aforementioned compressed preview interface or compressed pre-listening interface, and the first control may be the aforementioned compressed preview control or compressed pre-listening control. For example, referring to the descriptions of Figures 8A to 9G , the first control of the first user interface may be compressed preview control 803 of compressed preview interface 32.
[0365] In one implementation, the first rich media information is a first image, and the third input operation is used to generate a first selection box on the first image or adjust the first selection box on the first image, the area within the first selection box in the first image is the key part, and the area outside the selection box in the first image is the non-key part.
[0366] Exemplarily, the first image may be the aforementioned image 1, and the first selection box may be the aforementioned selection box 809, selection box 813, selection box 814 or selection box 815.
[0367] In one implementation, the key portion includes a preset object, and the key portion is automatically recognized by the first terminal device based on the preset object. For example, the preset object may include a road sign, a person, and the like.
[0368] In one implementation, the method also includes: the first terminal device extracts the first text information indicated by the first key part of the first rich media information, where the first key part is any one of N key parts; the first request message also includes the first text information; the first message content includes the first text information; and the second terminal device displays the first text information based on the first message content.
[0369] Illustratively, the first key part may be the aforementioned key part 1; when the first rich media information is the aforementioned image 1, the first key part may be the aforementioned key area 1, and the first text information may be the aforementioned text information 2.
[0370] In one implementation, the method also includes: the first terminal device extracts the first text information indicated by the first key part of the first rich media information, where the first key part is any one of N key parts; the first request message also includes the first text information; the first text information is used to decompress the compressed data of the first rich media information.
[0371] In one implementation, the method further includes: the first terminal device displays a first user interface of the first application; the first user interface is used to preview the second rich media information, the first user interface includes a second control and a third control, the second control is used to perform primary compression on the first rich media information, and the third control is used to perform secondary compression on the first rich media information, the data volume of the compressed data after the secondary compression is smaller than the data volume of the compressed data after the primary compression; in response to an input operation on the second control, the second rich media information is obtained and displayed based on the compressed data of the primary compression of the first rich media information; or, in response to an input operation on the third control, the second rich media information is obtained and displayed based on the compressed data of the secondary compression of the first rich media information.
[0372] In one implementation, the first user interface also includes first indication information and second indication information; the first indication information is used to indicate the data volume of the compressed data after first-level compression, and the estimated transmission time for sending the first message content to the second terminal using the compressed data with first-level compression; the first indication information is used to indicate the data volume of the compressed data after second-level compression, and the estimated transmission time for sending the first message content to the second terminal using the compressed data with first-level compression.
[0373] Exemplarily, the first user interface can be the aforementioned compression preview interface or compression pre-listening interface. Referring to Figures 7A to 7D , the second control for first-level compression can be the aforementioned first-level compression preview control 841, and the first indication information can include the data size after level 1 compression and the estimated transmission duration 843. The third control for second-level compression can be the aforementioned second-level compression preview control 842, and the second indication information can include the data size after level 2 compression and the estimated transmission duration 844.
[0374] In one implementation, the first request message includes the sender's account number and the recipient's account number, and the recipient's account number is used to determine the recipient's second terminal device.
[0375] In one implementation, the first request message includes a first field, a second field, a third field, and a fourth field. The first field indicates whether the first request message carries an image. The second field indicates the first compression algorithm used for the first image. The third field indicates the length of the compressed data of the first image. The fourth field indicates the compressed data of the first image. For example, the description of the four fields in the first request message can be found in Table 1.
[0376] In one implementation, the second user interface of the first application includes a fourth control; before the first application of the first terminal device receives the first input operation, the method also includes: in response to the input operation for the fourth control, the first application displays a shooting preview interface, and the shooting preview interface includes a preview image captured by the camera; in response to the first input operation, the first application of the first terminal device obtains the first rich media information, including: in response to the first input operation, the first application of the first terminal device calls the camera to capture the first image; the first rich media information is the first image, and the second rich media information is the image obtained after decompressing the compressed data of the first image.
[0377] Exemplarily, the fourth control of the second user interface may be the camera control 210 of the aforementioned new information interface 14 , or the shooting control 603 of the aforementioned new information interface 14 .
[0378] In one implementation, the first input operation is used to capture a first image, and the first rich media information is the first image; or, the first input operation is used to select a first image from a local gallery, and the first rich media information is the first image; or, the first input operation is used to capture a first video, and the first rich media information is the first video; or, the first input operation is used to select a first video from a local gallery, and the first rich media information is the first video; or, the first input operation is used to record a first audio, and the first rich media information is the first audio. For example, the first image may be the aforementioned image 1, the first video may be the aforementioned video 1, or the first audio may be the aforementioned audio 1.
[0379] In one implementation, the compressed data of the first rich media information is obtained by the first terminal device after compressing and encoding the first rich media information using a first compression algorithm; the application server decompresses the compressed data of the first rich media information to obtain the second rich media information, including: the application server decompresses the first rich media information using a decompression algorithm corresponding to the first compression algorithm to obtain the decompressed second rich media information; or the application server decompresses the first rich media information using a decompression algorithm corresponding to the first compression algorithm to obtain the decompressed third rich media information; and the application server enhances the third rich media information using a first enhancement algorithm to obtain the enhanced second rich media information. Exemplarily, the first compression algorithm may be the aforementioned preset compression algorithm, and the first enhancement algorithm may include one or more of the aforementioned image enhancement algorithm, video enhancement algorithm, audio enhancement algorithm, and text enhancement algorithm.
[0380] The following describes the structure of a terminal device 100 provided in an embodiment of the present application. The structure of the terminal device 200 can refer to the terminal device 100 and will not be described in detail.
[0381] 15 shows a schematic structural diagram of a terminal device 100. The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0382] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0383] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0384] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0385] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0386] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0387] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the terminal device 100.
[0388] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.
[0389] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0390] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.
[0391] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the terminal device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the terminal device 100.
[0392] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0393] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the terminal device 100, or to transfer data between the terminal device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices.
[0394] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt a different interface connection method from the above embodiment, or a combination of multiple interface connection methods.
[0395] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the terminal device 100. While charging the battery 142, the charging management module 140 can also power the electronic device through the power management module 141.
[0396] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0397] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0398] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0399] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0400] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0401] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), satellite communication module, frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. applied to the terminal device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0402] The satellite communication module can be used to communicate with satellite devices. For example, in the satellite communication system 10, the satellite communication module can communicate with the Beidou satellite 300. The satellite communication module can use Beidou satellite short message communication technology to support short message transmission between the Beidou satellite 300 and the Beidou satellite 300.
[0403] In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Beidou satellite short message communication technology, BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0404] The terminal device 100 implements display functions through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0405] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, terminal device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0406] The terminal device 100 can realize the shooting function through the ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0407] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise and brightness. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0408] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0409] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0410] Video codecs are used to compress or decompress digital video. Terminal device 100 may support one or more video codecs. This allows terminal device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0411] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in the terminal device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0412] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).
[0413] Random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation DDR SDRAM is generally referred to as DDR5 SDRAM), etc.; non-volatile memory may include disk storage devices and flash memory.
[0414] Flash memory can be divided into NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operating principle; single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to the storage cell potential level; universal flash storage (UFS) and embedded multi media card (eMMC) can be divided into UFS and eMMC according to the storage specification.
[0415] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data.
[0416] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .
[0417] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the terminal device 100. The external non-volatile memory communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, files such as music and videos can be stored in the external non-volatile memory.
[0418] The terminal device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0419] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0420] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or listen to hands-free calls through the speaker 170A.
[0421] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.
[0422] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.
[0423] The headphone jack 170D is used to connect a wired headphone.
[0424] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc.
[0425] The gyro sensor 180B may be used to determine the motion posture of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor 180B.
[0426] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.
[0427] The magnetic sensor 180D includes a Hall sensor, and the terminal device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case.
[0428] The acceleration sensor 180E can detect the magnitude of the acceleration of the terminal device 100 in various directions (generally three axes).
[0429] The distance sensor 180F is used to measure distance. The terminal device 100 can measure distance by infrared or laser.
[0430] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode.
[0431] The ambient light sensor 180L is used to sense the brightness of the ambient light. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness.
[0432] The fingerprint sensor 180H is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0433] The temperature sensor 180J is used to detect temperature. In some embodiments, the terminal device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy.
[0434] The touch sensor 180K is also called a "touch control device." The touch sensor 180K can be provided on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be provided on the surface of the terminal device 100, at a location different from that of the display screen 194.
[0435] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone mass in a human vocal part.
[0436] The buttons 190 include a power button, a volume button, etc. The buttons 190 can be mechanical buttons or touch buttons.
[0437] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback.
[0438] The indicator 192 may be an indicator light, which may be used to indicate charging status, power level changes, messages, missed calls, etc.
[0439] The SIM card interface 195 is used to connect a SIM card.
[0440] The following describes the structure of an application server 500 provided in an embodiment of the present application. FIG16 exemplarily shows the structure of a server 500 provided in an embodiment of the present application.
[0441] As shown in Figure 16, the application server 500 may include: one or more processors 1001, memory 1002, communication interface 1003, transmitter 1005, receiver 1006, coupler 1007, and antenna 1008. These components may be connected via a bus 1004 or other means, with Figure 16 using a bus connection as an example.
[0442] The communication interface 1003 can be used for the application server 500 to communicate with other communication devices, such as the terminal device 100. Specifically, the communication interface 1003 can be a 3G communication interface, a 4G communication interface, a 5G communication interface, or a communication interface of a future new air interface. Not limited to a wireless communication interface, the application server 500 can also be configured with a wired communication interface 1003, such as a local access network (LAN) interface. The transmitter 1005 can be used to transmit and process the signal output by the processor 1001. The receiver 1006 can be used to receive and process the mobile communication signal received by the antenna 1008.
[0443] In some embodiments of the present application, transmitter 1005 and receiver 1006 can be considered a wireless modem. In application server 500, the number of transmitters 1005 and receivers 1006 can be one or more. Antenna 1008 can be used to convert electromagnetic energy in a transmission line into electromagnetic waves in free space, or vice versa. Coupler 1007 is used to split the mobile communication signal received by antenna 1008 into multiple paths and distribute them to multiple receivers 1006.
[0444] Memory 1002 is coupled to processor 1001 and is used to store various software programs and / or multiple sets of instructions. Specifically, memory 1002 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 1002 may store a network communication program that can be used to communicate with one or more additional devices, one or more terminal devices, or one or more network devices.
[0445] In some embodiments of the present application, the memory 1002 may be used to store an implementation program of the application distribution method provided in one or more embodiments of the present application on the application server 500. For implementation of the application distribution method provided in one or more embodiments of the present application, please refer to the above embodiments.
[0446] The processor 1001 may be configured to read and execute computer-readable instructions. Specifically, the processor 1001 may be configured to call a program stored in the memory 1002, such as an implementation program of the application distribution method provided in one or more embodiments of the present application on the application server 500 side, and execute the instructions contained in the program.
[0447] It should be noted that the application server 500 shown in FIG16 is only one implementation of the embodiment of the present application. In actual applications, the application server 500 may also include more or fewer components, which is not limited here.
[0448] For more details about the functions and working principles of the application server 500, please refer to the relevant content in the above embodiments and will not be repeated here.
[0449] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.
[0450] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0451] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0452] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.
Claims
1. A satellite communication method, applied to a satellite communication system, characterized in that: The satellite communication system includes a first terminal device, a first server and a second terminal device, and the method includes: The first application of the first terminal device receives a first input operation; In response to the first input operation, the first application of the first terminal device obtains first rich media information; The first application of the first terminal device obtains compressed data of the first rich media information; The first application of the first terminal device receives a second input operation; In response to the second input operation, the first terminal device sends a first request message to the first server through the satellite device, where the first request message includes compressed data of the first rich media information; The first server decompresses the compressed data of the first rich media information to obtain second rich media information; The first server sends a first message content to the second terminal device, where the first message content indicates the second rich media information; The second terminal device displays the second rich media information based on the first message content.
2. The method according to claim 1, characterized in that The first message content includes the second rich media information.
3. The method according to claim 1, characterized in that The first message content includes a first website link corresponding to the second rich media information; The second terminal device displays the second rich media information based on the first message content, including: In response to an input operation on the first website link, the second terminal device displays the second rich media information on a first web page corresponding to the first website link.
4. The method according to claim 1, characterized in that: The first server sends a first message content to the second terminal device, including: The first server sends the first message content to the second application of the second terminal device; the second application includes an instant messaging application and / or a text message application.
5. The method according to claim 1, characterized in that Before the first application of the first terminal device receives a second input operation, the method further includes: The first terminal device displays a first user interface of the first application, where the first user interface includes first rich media information; In response to the third input operation, the first terminal device decompresses the compressed data of the first rich media information, and obtains and displays the decompressed second rich media information.
6. The method according to any one of claims 1 to 5, characterized in that: The first rich media information includes a non-critical part and N critical parts, and the second rich media information generated according to the first rich media information also includes a non-critical part and N critical parts, where N is a positive integer greater than zero; the clarity of the critical part of the second rich media information is higher than the clarity of the non-critical part of the second rich media information; The definition of the non-critical part of the second rich media information is lower than the definition of the non-critical part of the first rich media information.
7. The method according to claim 6, characterized in that The first terminal device obtains compressed data of the first rich media information, including: The first terminal device performs lossy compression with a first loss rate on a non-critical part of the first rich media information to obtain first compressed data of the non-critical part of the first rich media information, where the compressed data of the first rich media information includes the first compressed data; The first terminal device does not compress the key part of the first rich media information, and the compressed data of the first rich media information includes the original data of the key part of the first rich media information; or, the first terminal device losslessly compresses the key part of the first rich media information and obtains second compressed data of the key part of the first rich media information, and the compressed data of the first rich media information includes the second compressed data; or, the first terminal device compresses the key part of the first rich media information with a second loss rate and obtains third compressed data of the key part of the first rich media information, and the compressed data of the first rich media information includes the third compressed data, and the second loss rate is lower than the first loss rate.
8. The method according to claim 5 or 6, characterized in that: The first user interface includes a first control, the third input operation acts on the first control, and the first control is used to trigger the first terminal device to obtain the second rich media information corresponding to the first rich media information.
9. The method according to claim 6, characterized in that The first rich media information is a first image, and the third input operation is used to generate a first selection box on the first image or adjust the first selection box on the first image, the area within the first selection box in the first image is the key part, and the area outside the selection box in the first image is the non-key part.
10. The method according to claim 6, characterized in that The key part includes a preset object, and the key part is automatically recognized by the first terminal device according to the preset object.
11. The method according to claim 6, characterized in that Also includes: Extracting, by the first terminal device, first text information indicated by a first key part of the first rich media information, where the first key part is any one of the N key parts; The first request message also includes the first text information; the first message content includes the first text information; The second terminal device displays the first text information based on the first message content.
12. The method according to claim 6, characterized in that Also includes: Extracting, by the first terminal device, first text information indicated by a first key part of the first rich media information, where the first key part is any one of the N key parts; The first request message also includes the first text information; The first text information is used to decompress compressed data of the first rich media information.
13. The method according to claim 1, characterized in that The first request message includes a sender's account number and a recipient's account number, and the recipient's account number is used to determine the recipient's second terminal device.
14. The method according to claim 1, characterized in that The first request message includes a first field, a second field, a third field, and a fourth field; The first field is used to indicate whether the first request message carries an image; The second field is used to indicate a first compression algorithm adopted by the first image; The third field is used to indicate the data length of the compressed data of the first image; The fourth field is used to indicate compressed data of the first image.
15. The method according to claim 6, characterized in that The second user interface of the first application includes a fourth control; before the first application of the first terminal device receives the first input operation, the method further includes: In response to an input operation on the fourth control, the first application displays a shooting preview interface, where the shooting preview interface includes a preview image captured by a camera; In response to the first input operation, the first application of the first terminal device obtains first rich media information, including: In response to the first input operation, the first application of the first terminal device calls a camera to capture a first image; the first rich media information is the first image, and the second rich media information is an image obtained by decompressing compressed data of the first image.
16. A satellite communication method, characterized in that: The method comprises: A first application of the first terminal device receives a first input operation; In response to the first input operation, the first application of the first terminal device obtains first rich media information; The first application of the first terminal device obtains compressed data of the first rich media information; The first application of the first terminal device receives a second input operation; In response to the second input operation, the first terminal device sends a first request message to the first server through the satellite device, and the first request message includes compressed data of the first rich media information; the first server is used to decompress the compressed data of the first rich media information, obtain second rich media information, and send a first message content to the second terminal device, and the first message content indicates the second rich media information.
17. The method according to claim 16, characterized in that The first message content includes the second rich media information.
18. The method according to claim 16, characterized in that The first message content includes a first website link corresponding to the second rich media information, and a first web page corresponding to the first website link is used to display the second rich media information.
19. The method according to claim 16, characterized in that The first application includes an instant messaging application or a text messaging application.
20. The method according to claim 16, characterized in that Before the first application of the first terminal device receives a second input operation, the method further includes: The first terminal device displays a first user interface of the first application, where the first user interface includes first rich media information; In response to the third input operation, the first terminal device decompresses the compressed data of the first rich media information, and obtains and displays the decompressed second rich media information.
21. The method according to any one of claims 16 to 20, characterized in that The first rich media information includes a non-critical part and N critical parts, and the second rich media information generated according to the first rich media information also includes a non-critical part and N critical parts, where N is a positive integer greater than zero; the clarity of the critical part of the second rich media information is higher than the clarity of the non-critical part of the second rich media information; The definition of the non-critical part of the second rich media information is lower than the definition of the non-critical part of the first rich media information.
22. The method according to claim 21, characterized in that The first terminal device obtains compressed data of the first rich media information, including: The first terminal device performs lossy compression with a first loss rate on a non-critical part of the first rich media information to obtain first compressed data of the non-critical part of the first rich media information, where the compressed data of the first rich media information includes the first compressed data; The first terminal device does not compress the key part of the first rich media information, and the compressed data of the first rich media information includes the original data of the key part of the first rich media information; or, the first terminal device losslessly compresses the key part of the first rich media information and obtains second compressed data of the key part of the first rich media information, and the compressed data of the first rich media information includes the second compressed data; or, the first terminal device compresses the key part of the first rich media information with a second loss rate and obtains third compressed data of the key part of the first rich media information, and the compressed data of the first rich media information includes the third compressed data, and the second loss rate is lower than the first loss rate.
23. The method according to claim 20 or 21, characterized in that The first user interface includes a first control, the third input operation acts on the first control, and the first control is used to trigger the first terminal device to obtain the second rich media information corresponding to the first rich media information.
24. The method according to claim 21, characterized in that The first rich media information is a first image, and the third input operation is used to generate a first selection box on the first image or adjust the first selection box on the first image, the area within the first selection box in the first image is the key part, and the area outside the selection box in the first image is the non-key part.
25. The method according to claim 21, characterized in that The key part includes a preset object, and the key part is automatically recognized by the first terminal device according to the preset object.
26. The method according to claim 21, characterized in that Also includes: Extracting, by the first terminal device, first text information indicated by a first key part of the first rich media information, where the first key part is any one of the N key parts; The first request message also includes the first text information; the first message content includes the first text information.
27. The method according to claim 21, characterized in that Also includes: Extracting, by the first terminal device, first text information indicated by a first key part of the first rich media information, where the first key part is any one of the N key parts; The first request message also includes the first text information; The first text information is used to decompress compressed data of the first rich media information.
28. The method according to claim 16, characterized in that The first request message includes a sender's account number and a recipient's account number, and the recipient's account number is used to determine the recipient's second terminal device.
29. The method according to claim 16, characterized in that The first request message includes a first field, a second field, a third field, and a fourth field; The first field is used to indicate whether the first request message carries an image; The second field is used to indicate a first compression algorithm adopted by the first image; The third field is used to indicate the data length of the compressed data of the first image; The fourth field is used to indicate compressed data of the first image.
30. The method according to claim 21, characterized in that The second user interface of the first application includes a fourth control; before the first application of the first terminal device receives the first input operation, the method further includes: In response to an input operation on the fourth control, the first application displays a shooting preview interface, where the shooting preview interface includes a preview image captured by a camera; In response to the first input operation, the first application of the first terminal device obtains first rich media information, including: In response to the first input operation, the first application of the first terminal device calls a camera to capture a first image; the first rich media information is the first image, and the second rich media information is an image obtained by decompressing compressed data of the first image.
31. A satellite communication method, characterized in that: The method comprises: The second terminal device receives the first message content sent by the first server, where the first message content indicates second rich media information; the second rich media information is obtained by the first server after decompressing compressed data of the first rich media information, and the compressed data of the first rich media information is sent to the first server by the first terminal device through the satellite device using the first request message; The second terminal device displays the second rich media information based on the first message content.
32. The method according to claim 31, characterized in that The first message content includes the second rich media information.
33. The method according to claim 31, characterized in that The first message content includes a first website link corresponding to the second rich media information; The second terminal device displays the second rich media information based on the first message content, including: In response to an input operation on the first website link, the second terminal device displays the second rich media information on a first web page corresponding to the first website link.
34. The method according to claim 31, characterized in that The second terminal device receives the first message content sent by the first server, including: The second application of the second terminal device receives the first message content sent by the first server; the second application includes an instant messaging application and / or a text message application.
35. The method according to any one of claims 31 to 34, characterized in that The first rich media information includes a non-critical part and N critical parts, and the second rich media information generated according to the first rich media information also includes a non-critical part and N critical parts, where N is a positive integer greater than zero; the clarity of the critical part of the second rich media information is higher than the clarity of the non-critical part of the second rich media information; The definition of the non-critical part of the second rich media information is lower than the definition of the non-critical part of the first rich media information.
36. The method according to claim 35, characterized in that The key part is selected by a user from the first rich media information.
37. The method according to claim 35, characterized in that The key part includes a preset object, and the key part is automatically recognized by the first terminal device according to the preset object.
38. The method according to claim 35, characterized in that The first request message also includes the first text information, the first message content includes the first text information; the first text information is text information indicated by the first key part of the first rich media information, the first key part is any one of the N key parts, and the method further includes: The second terminal device displays the first text information based on the first message content.
39. A terminal device, characterized in that: include: A processor and a memory, wherein the memory is coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, and when the processor reads the computer instructions from the memory, the terminal device executes the satellite communication method as described in any one of claims 16 to 30 or claims 31 to 38.
40. A computer-readable storage medium, characterized in that The method comprises computer instructions, which, when executed on a computer, cause the computer to execute the satellite communication method according to any one of claims 1 to 15, claims 16 to 30 or claims 31 to 38.