A method, electronic device and system for content storage

Abstract

The application provides a content storage method, an electronic device and a system. The method comprises: a first electronic device displays a first interface; a second electronic device sends first indication information to the first electronic device in response to detecting a first input of a user, the first indication information being used to indicate that the first electronic device and the second electronic device are displayed in a spliced manner; the first electronic device displays first partial image information and sends second partial image information to the second electronic device in response to receiving the first indication information; the second electronic device displays the second partial image information; the first electronic device sends first content associated with the first interface to the second electronic device in response to detecting a second input of the user; or the first electronic device sends the first content to the first electronic device after receiving second indication information sent by the second electronic device. The embodiments of the application help to improve the efficiency of content transmission between electronic devices, thereby helping to improve the experience of the user.

Description

TECHNICAL FIELD

[0001] The present application relates to the terminal field, and more particularly, to a content storage method, electronic device and system. BACKGROUND

[0002] At present, when files (for example, photos, videos, etc.) are transmitted between electronic devices, a user generally needs to search for another electronic device using one of the electronic devices first, and then confirm after searching. After the user confirms, the information transmission between the electronic devices can be realized.

[0003] Such a file transmission process is relatively complex, the user learning cost is relatively high, and then the efficiency of content transmission between two electronic devices is relatively low. SUMMARY

[0004] The present application provides a content storage method, electronic device and system, which helps to improve the efficiency of content transmission between electronic devices, thereby helping to improve the user experience.

[0005] In a first aspect, a system is provided, the system comprising a first electronic device and a second electronic device, the first electronic device being in communication with the second electronic device through a close-range wireless connection, the first electronic device being configured to display a first interface; the second electronic device being configured to, in response to detecting a first input of a user, send first indication information to the first electronic device, the first indication information being used to indicate that the first electronic device and the second electronic device are to be displayed in a spliced manner; the first electronic device being further configured to, in response to receiving the first indication information, display first partial image information and send second partial image information to the second electronic device according to position information of the first electronic device and the second electronic device, the first partial image information and the second partial image information being associated with the first interface; the second electronic device being further configured to, in response to receiving the second partial image information, display the second partial image information; the first electronic device being further configured to, in response to detecting a second input of the user with respect to the first partial image information, send first content associated with the first interface to the second electronic device; or the second electronic device being further configured to, in response to detecting a third input of the user, send second indication information to the first electronic device, the second indication information being used to indicate that the second electronic device detects the third input, the third input being an input with respect to the second partial image information; the first electronic device being further configured to, in response to receiving the second indication information, send the first content to the second electronic device.

[0006] In the embodiments of the present application, after the first electronic device and the second electronic device trigger splicing display, the user can trigger saving the first content in the second electronic device on the first electronic device, or the user can also trigger saving the first content in the second electronic device on the second electronic device. In this way, the operation of searching for the electronic device and confirming before content transmission is saved, which helps to improve the efficiency of content transmission between electronic devices, thereby helping to improve the user experience.

[0007] In some possible implementation manners, the first content can be content saved locally by the first electronic device.

[0008] With reference to the first aspect, in some implementation manners of the first aspect, the first electronic device is specifically configured to: in response to detecting the second input, prompting the user to save the first content in the second electronic device; and in response to the operation of the user determining to save the first content in the second electronic device, sending the first content to the second electronic device.

[0009] In the embodiments of the present application, when the first electronic device detects the second input of the user, the first electronic device can prompt the user to save the first content in the second electronic device, and when the first electronic device detects the operation of the user confirming to save the first content in the second electronic device, the first electronic device can send the first content to the second electronic device. In this way, the operation of searching for the electronic device and confirming before content transmission is saved, which helps to improve the efficiency of content transmission between electronic devices, thereby helping to improve the user experience.

[0010] With reference to the first aspect, in some implementation manners of the first aspect, the second electronic device is specifically configured to: in response to detecting the third input, prompting the user to save the first content in the second electronic device; and in response to the operation of the user determining to save the first content in the second electronic device, sending the second indication information to the first electronic device.

[0011] In the embodiments of the present application, when the second electronic device detects the third input of the user, the second electronic device can prompt the user to save the first content in the second electronic device, and when the second electronic device detects the operation of the user confirming to save the first content in the second electronic device, the second electronic device can send the second indication information to the first electronic device, thereby triggering the first electronic device to send the first content to the second electronic device. In this way, the operation of searching for the electronic device and confirming before content transmission is saved, which helps to improve the efficiency of content transmission between electronic devices, thereby helping to improve the user experience.

[0012] With reference to the first aspect, in some implementations of the first aspect, the second electronic device is further configured to, in response to successfully receiving the first content, prompt the user that the first content has been successfully saved in the second electronic device.

[0013] In the embodiments of the present application, the second electronic device can prompt the user when the receiving of the first content is completed, which helps the user to explicitly know that the first content has been saved in the second electronic device.

[0014] With reference to the first aspect, in some implementations of the first aspect, the first electronic device is further configured to, in response to completing the sending of the first content, prompt the user that the first content has been successfully saved in the second electronic device.

[0015] In the embodiments of the present application, the first electronic device can prompt the user when the sending of the first content is completed, which helps the user to explicitly know that the first content has been saved in the second electronic device.

[0016] In some possible implementations, the system further includes a third electronic device, the third electronic device being configured to, in response to detecting a fourth input of the user, send third indication information to the first electronic device, the third indication information being used to instruct the first electronic device, the second electronic device and the third electronic device to perform splicing display; the first electronic device is further configured to, in response to receiving the third indication information, display third partial image information according to the positional information of the first electronic device, the second electronic device and the third electronic device, send fourth partial image information to the second electronic device and send fifth partial image information to the third electronic device, the third partial image information, the fourth partial image information and the fifth partial image information being associated with the first interface; the second electronic device is further configured to, in response to receiving the fourth partial image information, display the fourth partial image information; the third electronic device is further configured to, in response to receiving the fifth partial image information, display the fifth partial image information; the second electronic device is further configured to, in response to detecting an input of the user for the fourth partial image information, prompt the user to save the first content in the second electronic device and / or the third electronic device; the second electronic device is further configured to, in response to detecting a fifth input of the user, send fourth indication information to the first electronic device, the fourth indication information being used to instruct the second electronic device to detect the fifth input, the fifth input being an input of the user selecting to save the first content in the third electronic device; and the first electronic device is further configured to, in response to receiving the fourth indication information, send the first content to the third electronic device.

[0017] In the embodiments of this application, when the first electronic device, the second electronic device and the third electronic device trigger splicing display, if the second electronic device detects the input of the user, the user can be prompted to save the first content in the second electronic device and / or the third electronic device. When the second electronic device detects the input of the user, the second electronic device can send fourth indication information to the first electronic device, so as to trigger the first electronic device to send the first content to the second electronic device. In this way, it is not necessary to trigger saving the first content in the third electronic device on the first electronic device which saves the first content, and the second electronic device which does not save the first content can trigger it, which helps to improve the efficiency of content transmission between electronic devices, thereby helping to improve the user experience.

[0018] In some possible implementation manners, the third electronic device is further configured to, in response to successfully receiving the first content, prompt the user that the first content has been successfully saved in the third electronic device.

[0019] In some possible implementation manners, the first electronic device is further configured to, in response to completing the sending of the first content, send fifth indication information to the second electronic device, where the fifth indication information is used to indicate that the sending of the first content has been completed; and the second electronic device is further configured to, in response to receiving the fifth indication information, prompt the user that the first content has been successfully saved in the third electronic device.

[0020] With reference to the first aspect, in some implementation manners of the first aspect, the first electronic device is further configured to: receive first information sent by the second electronic device before the image information corresponding to the first interface is enlarged, where the first information is used to indicate the size of the display screen of the second electronic device; and the first electronic device is specifically configured to: according to the number of electronic devices for splicing display, the size of the display screen of the first electronic device and the size of the display screen of the second electronic device, enlarge the image information corresponding to the first interface.

[0021] In the embodiments of this application, the first electronic device and the second electronic device can first trigger splicing display in the full-screen mode, and the first electronic device can send the first content to the second electronic device when splicing display in the full-screen mode is triggered, which saves the operation of searching for an electronic device and confirming content transmission by the user, helps to improve the efficiency of content transmission between electronic devices, and thereby helps to improve the user experience.

[0022] With reference to the first aspect, in some implementations of the first aspect, the display screen of the first electronic device has a first size in a first direction and a second size in a second direction, the display screen of the second electronic device has a third size in the first direction, and the first direction and the second direction are perpendicular, and the first electronic device is specifically configured to: when the first electronic device and the second electronic device are displayed in a splicing manner along the first direction, the first electronic device enlarges the image information corresponding to the first interface to have a fourth size in the first direction and keeps the image information corresponding to the first interface unchanged in the second direction, and the fourth size is a sum of the first size and the third size.

[0023] With reference to the first aspect, in some implementations of the first aspect, the enlarged image information is further divided into sixth image information, the sixth image information is located between the first image information and the second image information, and the sixth image information is determined by the first electronic device according to a distance between the first electronic device and the second electronic device.

[0024] In the embodiments of the present application, the first electronic device can select a division manner or a masking manner to divide the enlarged image information. In some possible implementations, when the distance between the first electronic device and the second electronic device is less than or equal to a preset distance (for example, 3 cm), the first electronic device can be displayed in a splicing manner with the second electronic device by using the masking manner; and when the distance between the first electronic device and the second electronic device is greater than the preset distance, the first electronic device can be displayed in a splicing manner with the second electronic device by using the division manner.

[0025] With reference to the first aspect, in some implementations of the first aspect, the first content includes first page content and second page content, the first image information is the first page content, and the second image information is the second page content.

[0026] In the embodiments of the present application, the first electronic device and the second electronic device can first trigger the splicing display in the paging mode, and the first electronic device can send the first content to the second electronic device when the splicing display in the paging mode is triggered, so that the operation of searching for the electronic device and confirming the content transmission by the user is omitted, which helps to improve the efficiency of content transmission between the electronic devices, and thus helps to improve the user experience.

[0027] In a second aspect, a method for content storage is provided. The method is applied in a first electronic device which communicates with a second electronic device through a short-range wireless connection. The method comprises: displaying, by the first electronic device, a first interface; receiving, by the first electronic device, first indication information sent by the second electronic device, the first indication information being used to indicate that the first electronic device and the second electronic device are to be displayed in a spliced manner; in response to receiving the first indication information, displaying, by the first electronic device, first partial image information and sending, by the first electronic device, second partial image information to the second electronic device according to position information of the first electronic device and the second electronic device, the first partial image information and the second partial image information being associated with the first interface; and in response to detecting a first input of a user with respect to the first partial image information, sending, by the first electronic device, first content associated with the first interface to the second electronic device.

[0028] With reference to the second aspect, in some implementations of the second aspect, in response to detecting the first input of the user with respect to the first partial image information, the first electronic device sends the first content associated with the first interface to the second electronic device, comprising: in response to detecting the first input, prompting, by the first electronic device, the user to save the first content in the second electronic device; and in response to an operation of the user determining to save the first content in the second electronic device, sending, by the first electronic device, the first content to the second electronic device.

[0029] With reference to the second aspect, in some implementations of the second aspect, the method further comprises: in response to completing the sending of the first content, prompting, by the first electronic device, the user that the first content has been successfully saved in the second electronic device.

[0030] With reference to the second aspect, in some implementations of the second aspect, the method further comprises: receiving, by the first electronic device, first information sent by the second electronic device, the first information being used to indicate a size of a display screen of the second electronic device; and before displaying the first partial image information and sending the second partial image information to the second electronic device, the method comprises: according to a number of electronic devices to be displayed in a spliced manner, a size of a display screen of the first electronic device, and a size of a display screen of the second electronic device, enlarging and dividing image information corresponding to the first interface to obtain the first partial image information and the second partial image information.

[0031] With reference to the second aspect, in some implementations of the second aspect, the display screen of the first electronic device has a first size in a first direction and a second size in a second direction, the display screen of the second electronic device has a third size in the first direction, the first direction and the second direction are perpendicular, and the first electronic device enlarges the image information corresponding to the first interface according to the number of electronic devices that are displayed in a spliced manner, the size of the display screen of the first electronic device, and the size of the display screen of the second electronic device, including: when the first electronic device and the second electronic device are displayed in the spliced manner along the first direction, the first electronic device enlarges the size of the image information corresponding to the first interface in the first direction to a fourth size and keeps the size of the image information corresponding to the first interface in the second direction unchanged, the fourth size being the sum of the first size and the third size.

[0032] With reference to the second aspect, in some implementations of the second aspect, the image information after being enlarged is further divided into third image information, the third image information is located between the first image information and the second image information, and the third image information is determined by the first electronic device according to the distance between the first electronic device and the second electronic device.

[0033] With reference to the second aspect, in some implementations of the second aspect, the first interface displays first page content of the first content, and the first content further includes second page content, the first image information is the first page content, and the second image information is the second page content.

[0034] In a third aspect, a content storage method is provided, which is applied to a second electronic device that communicates with a first electronic device through a close-range wireless connection. The method includes: in response to detecting a first input of a user, the second electronic device sends first indication information to the first electronic device, the first indication information being used to instruct the first electronic device and the second electronic device to be displayed in a spliced manner; the second electronic device receives second image information sent by the first electronic device, the second image information being associated with a first interface, the first interface being a display interface of the first electronic device when the first electronic device receives the first indication information; in response to receiving the second image information, the second electronic device displays the second image information; in response to detecting a second input of a user, the second electronic device sends second indication information to the first electronic device, the second indication information being used to instruct the second electronic device that the second input is detected, the second input being an input to the second image information; and the second electronic device receives first content associated with the first interface sent by the first electronic device.

[0035] With reference to the third aspect, in some implementations of the third aspect, in response to detecting the second input of the user, the second electronic device sends second indication information to the first electronic device, including: in response to detecting the second input, the second electronic device prompts the user to save the first content in the second electronic device; in response to the user determining to save the first content in the second electronic device, the second electronic device sends the second indication information to the first electronic device.

[0036] With reference to the third aspect, in some implementations of the third aspect, the method further includes: in response to successfully receiving the first content, the second electronic device prompts the user that the first content has been successfully saved in the second electronic device.

[0037] With reference to the third aspect, in some implementations of the third aspect, the second part of image information is image information obtained by the first electronic device enlarging and dividing the image information corresponding to the first interface.

[0038] With reference to the third aspect, in some implementations of the third aspect, the first interface displays first page content of the first content and the first content further includes second page content, the first part of image information is the first page content, and the second part of image information is the second page content.

[0039] The fourth aspect provides a device, including: a display unit configured to display a first interface; a receiving unit configured to receive first indication information sent by a second electronic device, the first indication information being used to indicate that the first electronic device and the second electronic device are to be displayed in a spliced manner; the display unit is further configured to, in response to the receiving unit receiving the first indication information, display first part of image information and send second part of image information to the second electronic device according to orientation information of the first electronic device and the second electronic device, the first part of image information and the second part of image information being associated with the first interface; a detecting unit configured to detect a first input of a user with respect to the first part of image information; and a sending unit configured to, in response to the detecting unit detecting the first input, send first content associated with the first interface to the second electronic device.

[0040] In a fifth aspect, an apparatus is provided, which includes: a detecting unit configured to detect a first input of a user; a sending unit configured to, in response to the detecting unit detecting the first input, send first indication information to a first electronic device, the first indication information being used to instruct the first electronic device and the apparatus to perform splicing display; a receiving unit configured to receive second partial image information sent by the first electronic device, the second partial image information being associated with a first interface, the first interface being a display interface of the first electronic device when the first electronic device receives the first indication information; and a display unit configured to, in response to the receiving unit receiving the second partial image information, display the second partial image information. The detecting unit is further configured to detect a second input of a user. The sending unit is further configured to send second indication information to the first electronic device, the second indication information being used to instruct the second electronic device to detect the second input, the second input being an input to the second partial image information. The receiving unit is further configured to receive first content associated with the first interface sent by the first electronic device.

[0041] In a sixth aspect, an electronic device is provided, which includes: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and include instructions. When the instructions are executed by the electronic device, the electronic device performs the method in any possible implementation of the second aspect.

[0042] In a seventh aspect, an electronic device is provided, which includes: one or more processors; a memory; and one or more computer programs. The one or more computer programs are stored in the memory, and include instructions. When the instructions are executed by the electronic device, the electronic device performs the method in any possible implementation of the third aspect.

[0043] In an eighth aspect, a computer program product is provided, which includes instructions. When the computer program product is run on a first electronic device, the electronic device performs the method of the second aspect. When the computer program product is run on a second electronic device, the electronic device performs the method of the third aspect.

[0044] In a ninth aspect, a computer readable storage medium is provided, which includes instructions. When the instructions are run on a first electronic device, the electronic device performs the method of the second aspect. When the instructions are run on a second electronic device, the electronic device performs the method of the third aspect.

[0045] In a tenth aspect, a chip is provided for executing instructions, when the chip is running, the chip executes the method of the second aspect described above; or the chip executes the method of the third aspect described above. BRIEF DESCRIPTION OF DRAWINGS

[0046] Figure 1 is a hardware structure schematic diagram of an electronic device provided by an embodiment of the present application.

[0047] Figure 2 is a software structure block diagram provided by an embodiment of the present application.

[0048] Figure 3 is a set of graphical user interfaces provided by an embodiment of the present application.

[0049] Figure 4 is another set of graphical user interfaces provided by an embodiment of the present application.

[0050] Figure 5 is another set of graphical user interfaces provided by an embodiment of the present application.

[0051] Figure 6 is another set of graphical user interfaces provided by an embodiment of the present application.

[0052] Figure 7 is another set of graphical user interfaces provided by an embodiment of the present application.

[0053] Figure 8 is another set of graphical user interfaces provided by an embodiment of the present application.

[0054] Figure 9 is another set of graphical user interfaces provided by an embodiment of the present application.

[0055] Figure 10 is another set of graphical user interfaces provided by an embodiment of the present application.

[0056] Figure 11 is another set of graphical user interfaces provided by an embodiment of the present application.

[0057] Figure 12 is a schematic structure diagram of a source device and a sink device provided by an embodiment of the present application.

[0058] Figure 13 is a schematic flow chart of a method for displaying by a source device and a sink device provided by an embodiment of the present application.

[0059] Figure 14 is a process of cutting by a source device provided by an embodiment of the present application in a split mode and displaying the cut canvas on a virtual screen.

[0060] Figure 15 is a process of cropping by the source device through the mask mode and displaying the cropped canvas on the virtual screen provided by the embodiments of the present application.

[0061] Figure 16 is another process of cropping by the source device through the split mode and displaying the cropped canvas on the virtual screen provided by the embodiments of the present application.

[0062] Figure 17 is another process of cropping by the source device through the mask mode and displaying the cropped canvas on the virtual screen provided by the embodiments of the present application.

[0063] Figure 18 is a schematic flow chart of a method of displaying by the source device and the sink device through the paging mode provided by the embodiments of the present application.

[0064] Figure 19 is a schematic diagram of displaying by the source device through the paging mode provided by the embodiments of the present application.

[0065] Figure 20 is a schematic flow chart of a method of displaying by the source device and the sink device through the parallel mode provided by the embodiments of the present application.

[0066] Figure 21 is a process of opening a certain active page in the application layer sequence in the parallel mode provided by the embodiments of the present application.

[0067] Figure 22 is a schematic flow chart of a method of displaying by the source device and the sink device through the dual application mode provided by the embodiments of the present application.

[0068] Figure 23 is a schematic flow chart of a method of content storage provided by the embodiments of the present application.

[0069] Figure 24 is another schematic flow chart of a method of content storage provided by the embodiments of the present application.

[0070] Figure 25 is another schematic flow chart of a method of content storage provided by the embodiments of the present application.

[0071] Figure 26 is a schematic structural diagram of an apparatus provided by the embodiments of the present application.

[0072] Figure 27 is another schematic structural diagram of an apparatus provided by the embodiments of the present application.

[0073] Figure 28 FIG. 2 is another structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0074] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; in this document, "and / or" is merely a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "plurality" or "multiple" means two or more than two.

[0075] Hereinafter, the terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" can explicitly or implicitly include one or more of the features. In the description of the embodiments, unless otherwise specified, the meaning of "multiple" is two or more than two.

[0076] The method provided by the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, notebook computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiments of the present application do not make any limitation on the specific type of electronic device.

[0077] Exemplary, Figure 1A structural diagram of the electronic device 100 is shown. The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0078] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0079] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.

[0080] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching instructions and executing instructions.

[0081] The processor 110 can also include memory that stores instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The cache memory can hold instructions or data that the processor 110 has recently used or is likely to use again. If the processor 110 needs to use the instructions or data again, it can be retrieved directly from the cache memory. This avoids repeated accesses to the main memory, reducing the latency of the processor 110 and thus improving the efficiency of the system.

[0082] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0083] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface, realizing the touch function of the electronic device 100.

[0084] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled with the audio module 170 through the I2S buses to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface to enable the function of answering a phone call through a Bluetooth earphone.

[0085] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 can be coupled with the wireless communication module 160 through a PCM bus interface. In some embodiments, the audio module 170 can also deliver audio signals to the wireless communication module 160 through the PCM interface to enable the function of playing music through a Bluetooth earphone. Both the I2S interface and the PCM interface can be used for audio communication.

[0086] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to enable Bluetooth functionality. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the UART interface to enable the function of playing music through a Bluetooth earphone.

[0087] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to enable the camera function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to enable the display function of the electronic device 100.

[0088] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0089] The USB interface 130 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0090] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection modes or combinations of multiple interface connection modes in the above embodiments.

[0091] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through the wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 while also supplying power to the electronic device through the power management module 141.

[0092] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0093] The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0094] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0095] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer the same to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor, and radiate the same as electromagnetic waves through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.

[0096] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and disposed in the same device as the mobile communication module 150 or other functional modules.

[0097] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and radiate it as an electromagnetic wave via the antenna 2.

[0098] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0099] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0100] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0101] The electronic device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.

[0102] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0103] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0104] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0105] The video codec is used to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0106] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 100 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0107] The external memory interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external storage card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external storage card.

[0108] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various function applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0109] The electronic device 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.

[0110] The audio module 170 is configured to convert digital audio information into an analog audio signal output, and to convert an analog audio input into a digital audio signal. The audio module 170 can also be configured to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some of the functional modules of the audio module 170 can be disposed in the processor 110.

[0111] The speaker 170A, also referred to as a "loudspeaker", is configured to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0112] The receiver 170B, also referred to as a "earpiece", is configured to convert an audio electrical signal into a sound signal. When the electronic device 100 receives a call or a voice message, the user can listen to the voice by holding the receiver 170B close to the ear.

[0113] The microphone 170C, also referred to as a "microphone", "sound collector", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can make a sound by holding the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, noise reduction functions can also be realized. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, to realize the collection of sound signals, noise reduction, and also to identify the source of the sound, to realize the directional recording function, etc.

[0114] The earphone interface 170D is configured to connect a wired earphone. The earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0115] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The pressure sensor 180A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0116] The gyroscope sensor 180B can be configured to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shaking of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the electronic device 100 by reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.

[0117] The barometric pressure sensor 180C is configured to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude, assists positioning and navigation by using the air pressure value measured by the barometric pressure sensor 180C.

[0118] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can detect the opening and closing of a flip cover by using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Further, according to the detected opening and closing state of the cover or the flip cover, the electronic device 100 can set a feature such as automatic unlocking of the flip cover.

[0119] The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the acceleration sensor 180E can detect the magnitude and direction of gravity. The acceleration sensor 180E can also be used to identify the attitude of the electronic device, and can be applied to landscape / portrait screen switching and pedometer applications.

[0120] Distance sensor 180F is configured to measure distance. Electronic device 100 can measure distance by infrared or laser. In some embodiments, electronic device 100 can utilize distance sensor 180F to measure distance for fast focusing when taking a picture.

[0121] Proximity light sensor 180G can include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode can be an infrared light emitting diode. Electronic device 100 emits infrared light outwardly through the light emitting diode. Electronic device 100 detects infrared reflected light from nearby objects using the photodiode. When sufficient reflected light is detected, electronic device 100 can determine that there is an object near electronic device 100. When insufficient reflected light is detected, electronic device 100 can determine that there is no object near electronic device 100. Electronic device 100 can utilize proximity light sensor 180G to detect that a user is holding electronic device 100 close to the ear for a phone call, so as to automatically turn off the screen to save power. Proximity light sensor 180G can also be used for automatic unlocking and locking of the screen in a holster mode or a pocket mode.

[0122] Ambient light sensor 180L is configured to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display 194 according to the sensed ambient light brightness. Ambient light sensor 180L can also be used to automatically adjust white balance when taking a picture. Ambient light sensor 180L can also cooperate with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touch.

[0123] Fingerprint sensor 180H is configured to collect a fingerprint. Electronic device 100 can utilize the collected fingerprint characteristics to implement fingerprint unlocking, access application lock, fingerprint picture taking, fingerprint call answering, and the like.

[0124] Temperature sensor 180J is configured to detect temperature. In some embodiments, electronic device 100 utilizes the temperature detected by temperature sensor 180J to implement temperature handling strategies. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 implements performance reduction of a processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, electronic device 100 heats battery 142 to avoid abnormal shutdown of electronic device 100 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold, electronic device 100 implements voltage boosting of the output voltage of battery 142 to avoid abnormal shutdown caused by low temperature.

[0125] Touch sensor 180K, also referred to as "touch panel". Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 together form a touch screen, also referred to as "touch panel". Touch sensor 180K is configured to detect touch operations applied to or near the touch sensor 180K. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position of display screen 194.

[0126] Bone conduction sensor 180M can obtain vibration signals. In some embodiments, bone conduction sensor 180M can obtain vibration signals of the human body's vocal vibration bone block. Bone conduction sensor 180M can also contact the human body pulse to receive blood pressure pulsation signals. In some embodiments, bone conduction sensor 180M can also be disposed in a headset to form a bone conduction headset. Audio module 170 can analyze voice signals based on the vibration signals of the vocal vibration bone block obtained by the bone conduction sensor 180M to realize voice functions. The application processor can analyze heart rate information based on the blood pressure pulsation signals obtained by the bone conduction sensor 180M to realize heart rate detection functions.

[0127] Keys 190 include power on / off keys, volume keys, and the like. Keys 190 can be mechanical keys. They can also be touch keys. Electronic device 100 can receive key input and generate key signal input related to user settings and function control of electronic device 100.

[0128] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts and also for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. Touch operations applied to different regions of display screen 194 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminders, received messages, alarms, games, etc.) can also correspond to different vibration feedback effects. Touch vibration feedback effects can also be customizable.

[0129] Indicator 192 can be an indicator light, which can be used to indicate charging status, power changes, and also to indicate messages, missed calls, notifications, and the like.

[0130] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an embedded SIM (eSIM) card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0131] It should be understood that the phone cards in the embodiments of this application include, but are not limited to, SIM cards, eSIM cards, universal subscriber identity modules (USIM), universal integrated circuit cards (UICC), etc.

[0132] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0133] Figure 2 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.

[0134] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0135] The application framework layer provides an application programming interface (API) and programming framework for applications of the application layer. The application framework layer includes some pre-defined functions.

[0136] As shown in Figure 2 the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0137] The window manager is used to manage window programs. The window manager can acquire the size of the display screen, determine whether there is a status bar, lock the screen, and intercept the screen, etc.

[0138] The content provider is used to store and acquire data, and make the data accessible to applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, phone books, etc.

[0139] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0140] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of call status (including call connection, call hang-up, etc.).

[0141] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0142] The notification manager enables applications to display notification information in the status bar, which can be used to convey notification type messages that can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloading, message reminders, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application running in the background, or a notification in the form of a dialog window appearing on the screen. For example, prompting text information in the status bar, issuing a prompt sound, the electronic device vibrating, the indicator light flashing, etc.

[0143] The Android runtime includes a core library and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.

[0144] The core library includes two parts: one part is the function function required by the java language to call, and the other part is the core library of Android.

[0145] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0146] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0147] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0148] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0149] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0150] A 2D graphics engine is a graphics engine for 2D drawing.

[0151] It should be understood that the technical solutions in the embodiments of this application can be used in systems such as Android, iOS, and HarmonyOS.

[0152] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0153] Figure 3 This is a set of graphical user interfaces (GUIs) provided in the embodiments of this application.

[0154] See Figure 3 The GUI is shown in (a) above. Phone A displays the video application's playback interface, which shows the video playback screen 301. At the same time, phone B displays its desktop.

[0155] When the mobile phone B is close to the mobile phone A, the mobile phone A and the mobile phone B can form a network through a near field wireless connection mode. The network formation mode includes but is not limited to an access point (AP) network formation and a peer-to-peer (P2P) network formation. The AP network formation is that devices under the same AP (for example, a home Wi-Fi router) can communicate with each other through the AP device, thereby forming a many-to-many network formation. For example, the mobile phone A and the mobile phone B can be located under the same home router, and when the mobile phone B is close to the mobile phone A, the mobile phone A can use a received signal strength indication (RSSI) technology to calculate the distance between the device A and the device B according to the strength of the received signal. When the distance is less than or equal to a preset distance, the mobile phone A and the mobile phone B can form an AP network.

[0156] Wi-Fi direct (Wi-Fi direct): also known as Wi-Fi peer to peer (Wi-Fi P2P), is a point-to-point connection mode. It can enable multiple Wi-Fi devices to form a peer-to-peer network (P2P network) to communicate with each other without an access point (AP). One station (STA) can act as an AP in the traditional sense, called a group owner (GO); another STA can be called a group client (GC), which can be connected to the GO like connecting to the AP. Among them, one STA can play the role of GO (i.e., act as an AP), and other STAs play the role of GC. In the embodiments of the present application, when a device is close to another device, the device on the left side can be the GO by default, and the device on the right side can be the GC. For example, the mobile phone A can be the GO, and the mobile phone B can be the GC. Alternatively, when a device detects a user's right sliding operation, the device can be the GC and the device can select another device on the left side as the GO; or when a device detects a user's left sliding operation, the device can be the GC and the device can select another device on the right side as the GO.

[0157] To build a peer-to-peer (P2P) network, one electronic device must first be able to scan for and detect another electronic device using the P2P protocol; this process is called the discovery phase. Only after discovery can the establishment of a P2P connection be triggered. When phone B approaches phone A, phone A can use RSSI technology to calculate the distance between device A and device B based on the RSSI. When this distance is less than or equal to a preset distance, phone A and phone B can form a P2P network.

[0158] Wi-Fi P2P technology forms the foundation for upper-layer services. Currently, P2P applications built on top of P2P mainly include Miracast and WLAN Direct. In a Miracast application scenario, a P2P-enabled electronic device can scan for and connect to a P2P-enabled large-screen device, then directly display its video, images, and other resources on the large-screen device. Leveraging P2P technology greatly enriches the Wi-Fi experience.

[0159] When phone B detects that the user swipes right on the desktop, phone B sends an instruction message to phone A, which indicates that phone B wants to enter full-screen mode.

[0160] See Figure 3 The GUI is shown in (b). After receiving the instruction information sent by mobile phone B, mobile phone A can enlarge the size of the canvas displayed in the current playback interface by 1 time. Mobile phone A can crop the enlarged canvas to obtain two areas of the same size (area 302 and area 303). Mobile phone A can display the canvas shown in area 302 on its screen and project the canvas of area 303 onto mobile phone B, so that mobile phone B can display the canvas of area 303 on its screen.

[0161] In one embodiment, the display interface of mobile phone B also includes an exit control. When mobile phone B detects that the user clicks the exit control, mobile phone B can send an instruction message to mobile phone A, which instructs mobile phone A to exit full-screen mode.

[0162] In one embodiment, the exit control can be drawn by mobile phone B. When mobile phones A and B enter full-screen mode, the exit control can be drawn and displayed on the screen of mobile phone B.

[0163] See Figure 3 As shown in (c) of the GUI, when mobile phone A detects a long press operation by the user on the screen, mobile phone A can display a reminder box 304, which includes the prompt message "Please confirm whether to save the video to mobile phone B".

[0164] In one embodiment, the video displayed in full-screen mode on both phone A and phone B is a video locally saved on phone A. When phone A detects a long press operation by the user, phone A can prompt the user whether to save the video to phone B.

[0165] In one embodiment, the video displayed on both phone A and phone B in full-screen mode can also be a video played online by phone A through a video app. In this case, when phone A detects a long press operation by the user, phone A can prompt the user to save the video to either phone A or phone B.

[0166] See Figure 3 As shown in (d) of the GUI, in response to a user clicking control 305, mobile phone A can send the video content to mobile phone B. In response to receiving the video content from mobile phone A, mobile phone B can save the video locally on mobile phone B.

[0167] See Figure 3 As shown in (e) of the GUI, after mobile phone B successfully receives the video sent by mobile phone A, mobile phone B can indicate to mobile phone A that it has successfully received the video. Mobile phone A can then display a notification box 306, which includes the message "The video has been saved to mobile phone B".

[0168] In one embodiment, after mobile phone B successfully receives the video sent by mobile phone A, mobile phone B can notify the user that the video has been saved on mobile phone B.

[0169] In this embodiment, multiple devices can be combined to form a larger screen via near-field wireless connection without the need for additional hardware. The source device can dynamically modify the size of the display canvas and distribute it to various sink devices after cropping, thus improving the user experience. Simultaneously, when phone A detects user input on a specific display content, it can send that content to phone B, saving it there. This eliminates the need for the user to locate and send files to the target device via near-field wireless communication, simplifying the user experience and enhancing overall user satisfaction.

[0170] Figure 4 This is another set of GUIs provided in the embodiments of this application.

[0171] See Figure 4 As shown in (a) of the GUI, when mobile phone B detects a long press operation by the user, mobile phone B can display a reminder box 401, which includes the prompt message "Please confirm whether to save the video to mobile phone B".

[0172] In one embodiment, the video displayed in full-screen mode on both phone A and phone B is a video locally saved on phone A. When phone B detects a long press operation by the user, phone B can prompt the user whether to save the video to phone B.

[0173] In one embodiment, the video displayed on both phone A and phone B in full-screen mode can also be a video played online by phone A through a video app. In this case, when phone B detects a long press operation by the user, phone B can prompt the user to save the video to either phone A or phone B.

[0174] See Figure 4 As shown in (b) of the GUI, in response to a user clicking control 402, mobile phone B can send an instruction message to mobile phone A, instructing mobile phone A to send the video content to mobile phone B. In response to receiving the instruction message from mobile phone B, mobile phone A can send the video content to mobile phone B. In response to receiving the video content from mobile phone A, mobile phone B can save the video content locally on mobile phone B.

[0175] See Figure 4 As shown in (c) of the GUI, when mobile phone B successfully receives the video content, mobile phone B can also display a reminder box 403, which includes the message "The video has been saved in mobile phone B".

[0176] In this embodiment, when mobile phone A and mobile phone B enter full-screen mode, the user can quickly save content to the user-specified device through operations on mobile phone A or mobile phone B. This eliminates the need for the user to find the target device and send files to the target device via short-range wireless communication, simplifying the user's operation and helping to improve the user experience.

[0177] Figure 5 This is another set of GUIs provided in the embodiments of this application.

[0178] See Figure 5 As shown in GUI (a), when phone C is close to phone A, phones A, B, and C can form an AP network or a P2P network. When phone C detects a user swiping to the right, phone C can send an instruction message to phone A, indicating that phone C wants to enter full-screen mode.

[0179] In one embodiment, when mobile phone C is close to mobile phone B, mobile phone B can determine that the distance between mobile phone C and mobile phone B is less than or equal to a preset distance by RSSI ranging. Mobile phone A, mobile phone B and mobile phone C can form an AP network, or mobile phone A, mobile phone B and mobile phone C can form a P2P network.

[0180] In one embodiment, when mobile phone C is close to mobile phone B, mobile phones A and B can determine the distance between mobile phone A and mobile phone C, and the distance between mobile phone B and mobile phone C, respectively, using RSSI ranging. When the distance between mobile phone A and mobile phone C is less than or equal to a first preset distance, and the distance between mobile phone B and mobile phone C is less than or equal to a second preset distance, mobile phones A, B, and C can form an AP network, or mobile phones A, B, and C can form a P2P network.

[0181] See Figure 5 As shown in (b) of the GUI, after receiving the instruction information sent by phone C, phone A can enlarge the size of the canvas displayed on the current playback interface by 2 times. Phone A can crop the enlarged canvas to obtain three areas of the same size (area 501, area 502, and area 503). Phone A can display the canvas shown in area 501 on its screen. Phone A can also project the canvas shown in area 502 onto phone B and the canvas shown in area 503 onto phone C, so that phone B displays the canvas shown in area 502 on its screen, and phone C displays the canvas shown in area 503 on its screen.

[0182] In one embodiment, the display interface of mobile phone C also includes an exit control. When mobile phone C detects that the user clicks the exit control, mobile phone C can send an instruction message to mobile phone A, which instructs mobile phone A to exit full-screen mode.

[0183] In one embodiment, the exit control can be drawn by mobile phone C. When mobile phones A, B, and C enter full-screen mode, mobile phone C can draw the exit control and display it on its screen. At this time, mobile phones B and C can both include the exit control.

[0184] See Figure 5 As shown in (c) of the GUI, when mobile phone B detects the user's long press operation, mobile phone B can display a reminder box 504, which includes the prompt message "Please confirm which of the following devices the video will be saved on" and device information (mobile phone A, mobile phone B and mobile phone C).

[0185] In one embodiment, after mobile phones A, B, and C form a network, they can exchange their device name information. For example, mobile phone A can send its device name information (e.g., Lily's Mate 40) to mobile phones B and C, mobile phone B can send its device name information (e.g., Lily's P40) to mobile phones A and C, and mobile phone C can send its device name information (e.g., Tom's Mate 40) to mobile phones A and B. The device name information of each mobile phone can then be displayed in the reminder box 504, which helps the user determine which device to save the file on.

[0186] See Figure 5 As shown in (d) of the GUI, when mobile phone B detects that the user has selected mobile phone B and clicked the control 505, mobile phone B can send an instruction message to mobile phone A. This instruction message instructs mobile phone A to send the content of the currently playing video to mobile phone B. In response to receiving the instruction message sent by mobile phone B, mobile phone A can send the content of the video to mobile phone B, so that mobile phone B can save the content of the video locally.

[0187] See Figure 5 As shown in (e) of the GUI, when mobile phone B successfully receives the video content, mobile phone B can display a reminder box 506, which includes the message "The video has been saved to mobile phone B!".

[0188] It should be understood that in this embodiment of the application, the process by which mobile phone B determines whether it has successfully received the video content can refer to existing file transfer protocols (FTP) or secret file transfer protocols (SFTP). Mobile phone B can know the total size of the file and the size that has been received, so that mobile phone B can know whether the file has been successfully received.

[0189] In one embodiment, such as Figure 5 As shown in (d), when mobile phone B detects that the user has selected both mobile phone B and mobile phone C and clicked control 505, mobile phone B can send an instruction message to mobile phone A. This instruction message instructs mobile phone A to send the content of the currently displayed video to mobile phone B and mobile phone C respectively. In response to receiving the instruction message sent by mobile phone B, mobile phone A can send the content of the video to mobile phone B and mobile phone C respectively.

[0190] The mobile phone B can save the content of the video in the mobile phone B in response to receiving the content of the video. After the mobile phone B completes receiving the content of the video, the mobile phone B can prompt the user that the video has been successfully saved in the mobile phone B. The mobile phone C can save the content of the video in the mobile phone C in response to receiving the content of the video. After the mobile phone C completes receiving the content of the video, the mobile phone C can prompt the user that the video has been successfully saved in the mobile phone B.

[0191] In the embodiments of the present application, when the mobile phone A, the mobile phone B and the mobile phone C enter the full screen mode, the user can quickly save the file in the device designated by the user through the operation on the mobile phone A, the mobile phone B or the mobile phone C, which saves the process of searching for the target device and sending the file to the target device through the close-range wireless communication, simplifies the operation of the user and helps to improve the user experience.

[0192] The above Figures 3 to 5 It is shown that the mobile phone A enlarges the canvas, evenly divides the size of the canvas according to the number of the devices and presents the canvas on each device completely, which can also be considered as a division mode. Considering that there is a distance between the mobile phone A and the mobile phone B or between the mobile phone B and the mobile phone C, the mobile phone A regards the joint between the devices as a mask element after enlarging the canvas, and the canvas is partially blocked by the mask element. The mobile phone A can also process the enlarged canvas through the mask mode. The process of processing through the mask mode is introduced below with reference to the GUI shown in Figure 6

[0193] Figure 6 is another group of GUIs provided by the embodiments of the present application.

[0194] Referring to the GUI shown in (a) of Figure 6 The mobile phone A displays the play interface of the video application, and the play interface displays the video play screen. At this time, the mobile phone B displays the desktop of the mobile phone B.

[0195] When the mobile phone B approaches the mobile phone A, the mobile phone A and the mobile phone B can form a network through the close-range wireless connection mode. When the mobile phone B detects the operation of swiping to the right on the desktop, the mobile phone B sends the indication information to the mobile phone A, and the indication information is used to indicate that the mobile phone B wants to enter the full screen mode.

[0196] Referring to Figure 6 ​The GUI is shown in (b). After receiving the instruction information sent by mobile phone B, mobile phone A can enlarge the size of the canvas displayed in the current playback interface by 1 time. Mobile phone A can crop the enlarged canvas according to the distance between mobile phone A and mobile phone B to obtain the canvases shown in areas 601, 602, and 603. Mobile phone A can display the canvas shown in area 601 on its screen and project the canvas shown in area 603 onto mobile phone B, so that mobile phone B can display the canvas shown in area 603 on its screen.

[0197] The pixel value of region 602 is determined based on the distance between mobile phone A and mobile phone B. One possible implementation is as follows: if the physical screen size of mobile phone A is X (6cm) and the screen resolution is M (1080)*N (2340), and assuming the physical width of region 602 is Y (e.g., 0.5cm), then the pixel value to be cropped is Z = (Y / X)*M = 90, meaning 90 pixels need to be removed. In this embodiment, the physical width of region 602 can be calculated by mobile phone A using RSSI to measure the distance between mobile phone A and mobile phone B; alternatively, the physical width of region 602 can be the sum of the physical border dimensions of mobile phone A and mobile phone B when they are fully fitted together.

[0198] In one embodiment, if the distance between mobile phone A and mobile phone B is greater than a preset distance (e.g., 3cm), mobile phone A can use a segmentation method to crop the enlarged canvas; if the distance between mobile phone A and mobile phone B is less than or equal to the preset distance, mobile phone A can use a masking method to crop the enlarged canvas.

[0199] See Figure 6 The GUI is shown in (c). When phone C is close to phone B, phones A, B, and C can form an AP network or a P2P network. When phone C detects a user swiping to the right, it can send an instruction to phone A, indicating that phone C wants to enter full-screen mode.

[0200] In one embodiment, mobile phone C can also indicate the distance between mobile phone B and mobile phone C to mobile phone A.

[0201] See Figure 6 As shown in (d) of the GUI, after receiving an instruction from phone C, phone A can enlarge the canvas displayed on the current playback interface by a factor of 2. Phone A can then crop the enlarged canvas based on the distance between phone A and phone B, and the distance between phone B and phone C. For example... Figure 6In step (d), mobile phone A can crop the expanded canvas into regions 604, 605, 606, 607, and 608. The pixel values ​​of regions 605 and 607 can be determined by the distance between mobile phone A and mobile phone B, and the distance between mobile phone B and mobile phone C. The specific determination process can be found in the description of the above embodiments, and for simplicity, it will not be repeated here. Mobile phone A can display the canvas shown in region 604 on its screen, project the canvas shown in region 606 onto mobile phone B, and project the canvas shown in region 608 onto mobile phone C. This allows mobile phone B to display the canvas shown in region 606 on its screen, and mobile phone C to display the canvas shown in region 608 on its screen.

[0202] See Figure 6 As shown in (e) of the GUI, when mobile phone C detects a long press operation by the user, mobile phone C can display a reminder box 609, which includes the prompt message "Please confirm which of the following devices the video will be saved on" and device information (mobile phone A, mobile phone B, and mobile phone C).

[0203] In one embodiment, after mobile phones A, B, and C form a network, they can exchange their device name information. For example, mobile phone A can send its device name information (e.g., Lily's Mate 40) to mobile phones B and C, mobile phone B can send its device name information (e.g., Lily's P40) to mobile phones A and C, and mobile phone C can send its device name information (e.g., Tom's Mate 40) to mobile phones A and B. The device name information of each mobile phone can then be displayed in the reminder box 609, which helps the user determine which device to save the file on.

[0204] See Figure 6 In the GUI shown in (f), when mobile phone C detects that the user has selected mobile phone C and clicked the control 610, mobile phone C can send an instruction message to mobile phone A. This instruction message instructs mobile phone A to send the content of the currently playing video to mobile phone C. In response to receiving the instruction message sent by mobile phone C, mobile phone A can send the content of the video to mobile phone C. In response to receiving the video content sent by mobile phone A, mobile phone C can save the content of the video locally on mobile phone C.

[0205] See Figure 6 As shown in (g) of the GUI, when mobile phone C successfully receives the video content, mobile phone C can display a reminder box 611, which includes the message "The video has been saved in mobile phone C!".

[0206] In the embodiments of the present application, when the mobile phone A, the mobile phone B and the mobile phone C enter the full screen mode, the user can quickly save the file in the device designated by the user through the operation on the mobile phone A, the mobile phone B or the mobile phone C, thereby saving the process of searching for the target device and sending the file to the target device through the close-range wireless communication, simplifying the operation of the user and helping to improve the user experience.

[0207] Figure 7 is another group of GUIs provided by the embodiments of the present application.

[0208] Referring to the GUI shown in (a) of Figure 7 , the mobile phone A, the mobile phone B and the mobile phone C are playing a video in the full screen mode, and the mobile phone A is the source device, and the mobile phone B and the mobile phone C are the sink devices. When the mobile phone B detects the long-press operation of the user, the mobile phone B can display a prompt box 701, wherein the prompt box 701 includes the prompt information "Please determine to save the video in which of the following devices" and the device information (the mobile phone B and the mobile phone C).

[0209] In one embodiment, when the mobile phone B detects the long-press operation of the user, the mobile phone B can send a query request to the source device (the mobile phone A), and the query request is used to query whether the video currently being played is the video saved locally by the mobile phone A. In response to receiving the query request sent by the mobile phone B, the mobile phone A can send a query response to the mobile phone B, and the query response is used to indicate that the video currently being played is the video locally saved by the mobile phone A. In response to receiving the query response sent by the mobile phone A, the mobile phone B can display the device names of the device B and the device C in the device list of the prompt box 701 without displaying the device name of the device A.

[0210] Referring to the GUI shown in (b) of Figure 7 , in response to detecting the operation of selecting the mobile phone B and clicking the control 702 by the user, the mobile phone B can send indication information to the mobile phone A, and the indication information is used to instruct the mobile phone A to send the content of the video currently being played to the mobile phone C. In response to receiving the indication information sent by the mobile phone B, the mobile phone A can send the content of the video to the mobile phone B. In response to receiving the content of the video sent by the mobile phone A, the mobile phone C can save the content of the video locally.

[0211] Referring to the GUI shown in (c) of Figure 7 , when the mobile phone C successfully receives the indication information sent by the mobile phone A, the mobile phone C can indicate to the mobile phone A that it has successfully received the content of the video. Thus, the mobile phone A can indicate that the mobile phone B has successfully sent the content of the video to the mobile phone C. In response to receiving the indication of the mobile phone A, the mobile phone B can display a prompt box 703, wherein the prompt box 703 includes the prompt information "The photo has been saved in the mobile phone C!".

[0212] In one embodiment, the notification box 703 can be displayed on phone C instead of phone B. For example, after phone C successfully receives the video content, it can notify the user that the photo has been saved on phone C.

[0213] In this embodiment, when mobile phones A, B, and C enter full-screen mode and display files on mobile phone A, users can quickly save files to mobile phone B or C through operations on mobile phone A, B, or C. This eliminates the need for users to find and send files to the target device via short-range wireless communication, simplifying user operations and improving user experience.

[0214] Figure 8 This is another set of GUIs provided in the embodiments of this application.

[0215] See Figure 8 In the GUI shown in (a), phones A, B, and C are in full-screen mode, displaying photos saved locally on phone A. Phone A is the source device, and phones B and C are the sink devices. When phone B detects a long press by the user, it displays a notification box 801. The notification box 801 includes the message "Please confirm which of the following devices you want to save the photos to," and icons 802-804 representing the devices in different positions. Icon 802, located on the far left, represents phone A (located on the left); icon 803, located in the middle, represents phone B (located in the middle); and icon 804, located on the far right, represents phone C (located on the right). Notably, icon 802 cannot be checked, indicating that the currently displayed video cannot be saved to the leftmost device.

[0216] It should be understood that in this embodiment, mobile phone A can determine the distance and location information between mobile phone A and mobile phone B, and between mobile phone A and mobile phone C through positioning technologies such as Bluetooth, ultra-wideband (UWB), and ultrasound; mobile phone B can determine the distance and location information between mobile phone B and mobile phone A, and between mobile phone B and mobile phone C through positioning technologies such as Bluetooth, UWB, and ultrasound; mobile phone C can determine the distance and location information between mobile phone C and mobile phone A, and between mobile phone C and mobile phone B through positioning technologies such as Bluetooth, UWB, and ultrasound. The specific implementation process can be referred to the prior art, and for the sake of simplicity, it will not be described in detail here.

[0217] In one embodiment, when mobile phone B detects a long-press operation by the user, mobile phone B can send a query request to the source device (mobile phone A). This query request is used to check whether the currently displayed photo is a photo saved locally on mobile phone A. In response to receiving the query request from mobile phone B, mobile phone A can send a query response to mobile phone B, which indicates that the currently displayed photo is a photo stored locally on mobile phone A. In response to receiving the query response from mobile phone A, mobile phone B can set icon 802 to be uncheckable in the reminder box 801.

[0218] See Figure 8 In the GUI shown in (b), in response to detecting that the user has checked the rightmost icon 804 and clicked control 805, mobile phone B can send an instruction message to mobile phone A. This instruction message instructs mobile phone A to send the content of the currently displayed photo to the rightmost device. In response to receiving the instruction message from mobile phone A, mobile phone A can send the content of the photo to the rightmost device (mobile phone C). In response to receiving the content of the photo sent by mobile phone A, mobile phone C can save the content of the photo locally on mobile phone C.

[0219] See Figure 8 As shown in GUI (c), after mobile phone C successfully receives the instruction information sent by mobile phone A, mobile phone C can indicate to mobile phone A that it has successfully received the content of the photo. Thus, mobile phone A can indicate to mobile phone B that it has successfully sent the content of the photo to mobile phone C. In response to receiving the instruction from mobile phone A, mobile phone B can display a notification box 806, which includes the message "The photo has been saved to the rightmost device!"

[0220] In this embodiment of the application, when multiple devices have the same device information (e.g., device name), in order to help users better distinguish which device to save the file on, the location information of the device can be prompted to the user. This allows the user to accurately save the file to the device that needs to be saved, which helps to improve the user experience.

[0221] Figure 9 This is another set of GUIs provided in the embodiments of this application. This GUI illustrates the process of switching from full-screen mode to paginated mode.

[0222] See Figure 9 As shown in (a) of the GUI, both phones A and B are in full-screen mode. When phone B detects that the user has clicked on the pagination mode, it displays as shown in [image / description]. Figure 9 The GUI shown in (b) is shown in the image.

[0223] See Figure 9As shown in (b) of the GUI, in response to phone B detecting that the user has clicked the pagination mode icon, phone B can send an instruction message to phone A. This instruction message indicates that phone B has detected that the user has clicked the pagination mode icon. Phone A can then switch from full-screen mode to pagination mode based on this instruction message. Phone A displays its desktop, which includes three desktop pages; currently, phone A displays the first desktop page. Phone A projects the canvas corresponding to its second desktop page onto phone B, causing phone B to display phone A's second desktop page. When phone A detects that the user has clicked the App5 icon, it displays as shown... Figure 9 The GUI shown in (c) is shown in the image.

[0224] See Figure 9 The GUI shown in (c) responds to a user tapping the App5 icon on phone A. Phone A can then display the App5 interface, which is the interface for document 1, which consists of 8 pages. Phone A can display the content of page 1 of document 1, and simultaneously project the content of page 2 of document 1 onto phone B, causing phone B to display the content of page 2 of document 1.

[0225] In one embodiment, when mobile phone A detects a user's swipe operation on the display screen (e.g., swipe up), mobile phone A can display the content of page 3 of document 1, and at the same time, mobile phone A projects the content of page 4 of document 1 onto mobile phone B, so that mobile phone B displays the content of page 4 of document 1.

[0226] In response to a detected long-press operation by the user, phone B can display a notification box 901, which includes the message "Please confirm whether you can save document 1 to phone B". In response to a detected user tapping control 902, phone B can send an instruction message to phone A, instructing phone A to send the contents of document 1 to phone B.

[0227] See Figure 9 As shown in (d) of the GUI, in response to receiving an instruction message from mobile phone B, mobile phone A can send the content of document 1 to mobile phone B. In response to successfully receiving the content of document 1, mobile phone B can display a notification box 903 including the message "Document 1 has been saved in mobile phone B!".

[0228] In this embodiment, mobile phone A and mobile phone B can display two pages of a file on mobile phone A in pagination mode, which can improve the efficiency of users reading files. Simultaneously, in pagination mode, when mobile phone B detects user input for a specific file, it can instruct mobile phone A to send the file content to mobile phone B, thereby saving the file content on mobile phone B. This eliminates the cumbersome content sharing process between devices, simplifies user operations, and helps improve the user experience.

[0229] Figure 10 Another set of GUIs provided in an embodiment of this application is shown. This GUI illustrates the process of switching from full-screen mode to dual-application mode.

[0230] See Figure 10 As shown in (a) of the GUI, both phones A and B are in full-screen mode. When phone B detects that the user has clicked on the dual-application mode operation, it displays as shown below. Figure 10 The GUI shown in (b) is shown in the image.

[0231] See Figure 10 As shown in (b) of the diagram, in response to phone B detecting that the user has clicked the dual-application mode icon, phone B can send an instruction message to phone A. This instruction message indicates that phone B has detected that the user has clicked the dual-application mode icon. Upon receiving the instruction message from phone A, phone A displays its own desktop and sends the canvas corresponding to its desktop to phone B, so that phone B also displays phone A's desktop. When phone A detects that the user has clicked the App3 icon, it displays as shown... Figure 10 The GUI shown in (c) is shown in the image.

[0232] See Figure 10 The GUI shown in (c) responds to a user tapping the App3 icon on phone A. Phone A can then display the App3 interface, while phone B displays phone A's home screen. When phone B detects a user tapping the App4 icon, it displays... Figure 10 The GUI shown in (d) is shown in the image.

[0233] In this embodiment of the application, App3 can be a video app, and App4 can be a photo app.

[0234] See Figure 10As shown in (d) of the diagram, in response to phone B detecting a user tapping the App4 icon, phone B can send a touch event and coordinate information to phone A. The touch event indicates that phone B detected the user's tap, and the coordinate information indicates the coordinates of the tap. Phone A can then determine that the user tapped the App4 icon on phone B based on this coordinate information. Therefore, phone A can launch App4 in the background and project its interface onto phone B, allowing phone B to display the App4 interface.

[0235] See Figure 10 As shown in (e) of the GUI, in response to detecting a user's click on photo 1001, mobile phone B can send a touch event and coordinate point information to mobile phone A. The touch event indicates that mobile phone B has detected the user's click operation, and the coordinate point information indicates the coordinate point at which the user clicked. Mobile phone A can determine that the user clicked on photo 1001 on mobile phone B based on this coordinate point information. Therefore, mobile phone A can start the display interface of photo 1001 in the background and project the display interface of photo 1001 onto mobile phone B, thus allowing mobile phone B to display the display interface of photo 1001.

[0236] In response to a long press operation by the user on phone B, phone B can display a reminder box 1002, which includes the prompt message "Please confirm whether to save the photo to phone B". In response to detecting a user clicking control 1003, phone B can send an instruction message to phone A, which instructs phone A to send the photo 1001 to phone B.

[0237] See Figure 11 As shown in (f) of the GUI, in response to receiving an instruction message from mobile phone B, mobile phone A can send the photo 1001 to mobile phone B. In response to mobile phone B successfully receiving the photo 1001, mobile phone B can display a notification box 1004, which includes the message "The photo has been saved to mobile phone B!".

[0238] In this embodiment, when mobile phone A and mobile phone B are in dual-application mode, the user can launch different applications on mobile phone A on both mobile phone A and mobile phone B, which helps improve the user experience. Simultaneously, in dual-application mode, when mobile phone B detects user input for a specific display content, mobile phone B can instruct mobile phone A to send that content to mobile phone B, thereby saving the content on mobile phone B. This eliminates the cumbersome content sharing process between devices, simplifies user operations, and helps improve the user experience.

[0239] Figure 11Another set of GUIs provided in an embodiment of this application is shown. This GUI illustrates the process of switching from full-screen mode to parallel mode.

[0240] See Figure 11 The GUI shown in (a) indicates that both phones A and B are in full-screen mode. When phone B detects that the user has clicked on the parallel mode operation, it displays as shown below. Figure 11 The GUI shown in (b) is shown in the image.

[0241] See Figure 11 As shown in (b) of the diagram, in response to phone B detecting that the user has clicked the parallel mode icon, phone B can send an instruction message to phone A. This instruction message indicates that phone B has detected that the user has clicked the parallel mode icon. Phone A can then determine whether to switch from full-screen mode to parallel mode based on this instruction message. Phone A displays its own desktop, and phone B displays its own desktop. When phone A detects that the user has clicked the App6 icon, it displays as shown in the diagram. Figure 11 The GUI shown in (c) is shown in the image.

[0242] It should be understood that, such as Figure 11 As shown in (a), when phone A switches from full-screen mode to parallel mode, the content displayed on phone B is not limited. Phone B can display its own desktop; or, when phone A and phone B enter parallel mode, phone A can project its own desktop onto phone B, thus allowing phone B to display phone A's desktop.

[0243] See Figure 11 The GUI shown in (c) responds to the user's tapping of the App 6 icon on phone A. Phone A can then open App 6 and display its homepage. When phone A detects the user tapping photo 1101, it displays as shown... Figure 11 The GUI shown in (d) is shown in the image.

[0244] It should be understood that App6 can be a photo app.

[0245] See Figures 3 to 11 As shown in (d), in response to the user's click on photo 1101 detected by mobile phone A, mobile phone A can continue to display the home page of App 6, and mobile phone A can project the display interface of photo 1101 onto mobile phone B, so that mobile phone B can display the display interface of photo 1101.

[0246] In response to detecting the long press operation of the user, the phone B can display a prompt box 1102, wherein the prompt box 1102 includes prompt information "Please confirm whether to save the photo in the phone B". In response to detecting an operation of clicking the control 1103, the phone B can send indication information to the phone A, the indication information being used to instruct the phone A to send the content of the photo 1101 to the phone B. In response to receiving the indication information, the phone A can send the content of the photo 1101 to the phone B, so that the phone B saves the photo 1101 in the phone B.

[0247] In one embodiment, the phone B can prompt the user that the photo has been successfully saved in the phone B after successfully receiving the photo 1101.

[0248] It should be understood that in the above embodiments, the prompt box is displayed after detecting the long press operation of the user on the phone A, the phone B or the phone C, so as to prompt the user to save the content in which device. The embodiments of the present application are not limited thereto. For example, the phone B can also send the indication information to the phone A after receiving the voice instruction of the user, so as to instruct the phone A to send the content to the phone B. For another example, the phone B can also send the indication information to the phone A after detecting the gesture of the user.

[0249] The embodiments of the present application provide a parallel display mode of upper and lower activity pages of an application program, and the application program can adjust to display two activity pages simultaneously in the mode, so as to bring better user experience when multiple devices are spliced. Meanwhile, in the parallel mode, the phone B can instruct the phone A to send the content to the phone B when the phone B detects the input of the user to the display content, so as to save the content in the phone B. In this way, the cumbersome content sharing process between devices is saved, the operation of the user is simplified, and the user experience is improved.

[0250] The above GUIs shown in Figure 12 The above GUIs shown in

[0251] Figure 3 The above GUIs shown in Figure 3 The above GUIs shown in Figure 12 The above GUIs shown in

[0252] The source device includes an application (App) layer, an application framework (Framework) layer, a native (Native) layer, and a server (Server) layer. The App layer can include multiple applications. The Framework layer includes a layer management and an input subsystem. The layer management is used to manage layer information corresponding to an application interface, and the input subsystem is used to process a user input event or a reverse input event. The Native layer includes a layer synthesis module and a layer clipping module. The layer synthesis module is used to synthesize an image according to layer information, and the layer clipping module is used to clip a canvas according to layer information. The Server layer includes an audio / video stream grabbing module, a virtual screen management module, and a network module. The audio / video stream grabbing module is used to grab an audio stream or a video stream. The virtual screen management module is used to manage creation and release of a virtual display. The network module is used to transmit an audio stream or a video stream to a sink device and receive a reverse input event sent by the sink device.

[0253] It should be understood that Figure 2 The functions implemented by the modules in the native layer and the server layer of the source device can be dependent on Figure 2 system libraries and kernel layers or drive hardware. For example, the layer synthesis module and the layer clipping module in the native layer can be dependent on Figure 2 media libraries, three-dimensional graphics processing libraries, and image processing libraries in system libraries. The audio / video stream grabbing module and the virtual screen management module in the server layer can be dependent on Figure 12 display drivers and audio drivers in kernel layers and three-dimensional graphics processing libraries and image processing libraries in system libraries.

[0254] The sink device includes an application (App) layer, an application framework (Framework) layer, a native (Native) layer, and a server (Server) layer. The Framework layer includes a sound system, an input system, and a display system. The sound system is used to play sound after audio decoding. The display system is used to display an interface after video decoding. The input system is used to receive a touch operation of a user. The Native layer includes a video rendering module, an audio / video decoding module, and a reverse input event grabbing module. The audio / video decoding module is used to decode an audio stream or a video stream received from the source device. The video rendering module is used to render and display the decoded video stream. The reverse input event grabbing module is used to grab a reverse input event of a user. The Server layer includes a network module. The network module is used to receive an audio stream or a video stream sent by the source device and send a reverse input event to the source device.

[0255] It should be understood that Figure 2 The functionality implemented by modules in the local layer of the sink device can depend on and Figure 2 Modules or drivers in the system libraries and kernel layer. For example, a video rendering module might depend on... Figure 2 The system library includes 3D graphics processing libraries, image processing libraries, and display drivers in the kernel layer. Audio and video decoding modules may depend on... Figure 2 The system library includes 3D graphics processing libraries, image processing libraries, etc. The reverse input event capture module can depend on... Figure 13 Touch panel (TP) drivers and other hardware-level components.

[0256] Figure 3 A schematic flowchart of method 1100 for displaying source and sink devices in full-screen mode is shown. Method 1300 includes:

[0257] S1301, the source device establishes a wireless connection with sink device 1.

[0258] For example, such as Figure 3 As shown in (a), when mobile phone A detects that the distance between mobile phone A and mobile phone B is less than or equal to a preset distance, mobile phone A and mobile phone B can form a network through near-field wireless connection, thereby establishing a wireless connection between mobile phone A and mobile phone B. For example, mobile phone A and mobile phone B can form an AP network, or mobile phone A and mobile phone B can form a P2P network.

[0259] S1302, after sink device 1 detects the user's first operation, sink device 1 instructs source device to enter full-screen mode.

[0260] For example, such as Figure 14 As shown in (a), phone A is the source device and phone B is the sink device 1. When phone B detects a user swiping to the right, phone B can send an instruction message to phone A, which indicates that phone B wants to enter full-screen mode.

[0261] In this embodiment, when sink device 1 detects a user swiping to the right, sink device 1 can determine that the device to its left is the source device; when sink device 1 detects a user swiping to the left, sink device 1 can determine that the device to its right is the source device.

[0262] It should be understood that in the embodiments of the present application, the source end device can determine the distance between the source end device and the sink end device 1 and the orientation information between the source end device and the sink end device 1 through Bluetooth, ultra-wideband (UWB), ultrasonic wave and other positioning technologies. The specific implementation process can refer to the prior art, and for the sake of brevity, will not be repeated here.

[0263] For example, the source end device is provided with a Bluetooth / Wi-Fi antenna array (or the source end device is provided with an angle of arrival (AOA) calculation capability), and the sink end device 1 is provided with a Bluetooth / Wi-Fi antenna array (or the sink end device 1 is provided with an AOA calculation capability). The source end device can calculate the orientation of the sink end device 1. The Bluetooth / Wi-Fi antenna array of the source end device can receive the wireless signal of the sink end device 1, and calculate the orientation of the sink end device 1 according to formulas (1) and (2):

[0264]

[0265]

[0266] wherein d is the distance between the Bluetooth / Wi-Fi antenna array of the source end device and the Bluetooth / Wi-Fi antenna of the sink end device 1, is the phase difference between the Bluetooth / Wi-Fi antenna array of the source end device and the Bluetooth / Wi-Fi antenna of the sink end device 1, λ is the wavelength of the Bluetooth signal sent by the sink end device 1, and θ is the angle of arrival. It should be understood that in the embodiments of the present application, the source end device calculates the orientation of the sink end device 1, and it can also be understood that the source end device can calculate the orientation of the line connecting the Bluetooth / Wi-Fi antenna array of the source end device and the Bluetooth / Wi-Fi antenna of the sink end device 1.

[0267] It should be understood that the sink end device 1 can also use the above formulas (1) and (2) to calculate the orientation of the source end device.

[0268] In one embodiment, when the sink device 1 detects the first operation of the user, the sink device 1 can send a user datagram protocol (UDP) packet to the source device, and the UDP packet can carry the indication information, which is used to indicate that the sink device 1 wants to enter the full screen mode. The UDP packet includes a data part of an IP datagram. The data part of the IP datagram can include an extensible bit. The sink device 1 and the source device can agree on the content of the extensible bit. When the extensible bit is 1, the source device can know that the sink device 1 wants to enter the full screen mode.

[0269] In one embodiment, when the sink device 1 detects the first operation of the user, the sink device 1 can send a transmission control protocol (TCP) packet to the source device, and the TCP packet can carry the indication information, which is used to indicate that the sink device 1 wants to enter the full screen mode. The TCP packet includes a TCP header and a TCP data part, and the TCP header includes a reserved field. The sink device 1 and the source device can agree on the content of the reserved field. When the bit of the reserved field is 1, the source device can know that the sink device 1 wants to enter the full screen mode.

[0270] S1303, in response to receiving the indication of the sink device 1, the source device expands the canvas on the current interface by one time.

[0271] For example, the original display canvas size of the source device is 1080x2340. After the source device receives the indication information of the sink device 1, the source device can determine that the sink device 1 wants to form a dual-screen splicing with the source device, and then the source device expands the display canvas size of the main device to (1080x2)x2340, i.e., 2160x2340.

[0272] It should be understood that in the embodiments of the present application, after the source device receives the indication information of the sink device 1, if the source device and the sink device 1 are horizontally distributed (or, left and right distributed), the source device can expand the display canvas size of the master device to 2160x2340. If the source device determines that the source device and the sink device 1 are vertically distributed (or, top and bottom distributed), the source device can also expand the display canvas size of the master device to 1080x(2340x2), that is, 1080x4680. The following is described by taking the source device and the sink device 1 (and the sink device 2) as horizontally distributed as an example.

[0273] In S1304, the source device crops the canvas after expansion by one time, and displays a part of the cropped canvas on the source device and puts another part into a virtual screen (display1) created by the source device.

[0274] In the embodiments of the present application, the cropping manner of the source device to the expanded canvas can include but is not limited to a splitting manner and a mask manner.

[0275] Figure 15 The process that the source device crops by the splitting manner and displays the cropped canvas on the virtual screen is shown. The layer information corresponding to each display screen is managed by the Android component SurfaceFlinger. Since there is no application started in the display, the display has no layer information. SurfaceFlinger composes each display in turn each time it composes a screen. For example, when SurfaceFlinger composes display0, the layer is cropped, and the cropping area 1 is [0, 0, 1080, 2340]. The source device can put the canvas shown by the cropping area 1 into display0, so that the source device can display display0; when SurfaceFlinger composes display1, it copies all the layer information from display0 and then crops, and the cropping area 2 is [1080, 0, 2160, 2340], and the cropped area 2 is put into display1 after being left shifted by 1080. The source device can project display1 onto the sink device 1.

[0276] Figure 6The process that the source device crops by the mask method and displays the cropped canvas on the virtual screen is shown. The source device first determines the region that needs to be cropped (for example, the region 602 shown in (b) in FIG. 6) according to the distance between the source device and the sink device 1. It should be understood that the process that the source device determines the pixel value of the region that needs to be cropped can refer to the description in the above embodiments, which will not be described here for brevity. It is assumed that the pixel value that the source device determines to be cropped is x. Figure 5

[0277] For example, when SurfaceFlinger composites display0, the layer is cropped, and the cropping region 3 is [0, 0, 1080, 2340]. The source device can put the canvas shown in the cropping region 3 into display0, so that the source device can display display0; when SurfaceFlinger composites display1, all layer information is copied from display0, and then cropped, and the cropping region 4 is [1080+x, 0, 2160, 2340], and the cropped region is put into display1 after being shifted left by 1080+x. The source device can project display1 onto the sink device 1.

[0278] It should be understood that if the physical size of the screen of the sink device 1 is inconsistent with that of the source device, the sink device 1 can adaptively display according to the size of its screen. For example, when the canvas size projected by the source device onto the sink device 1 is (1080+x)*2340, and the screen resolution of the sink device 1 is 1080*2340, the sink device 1 can fill the left and right sides of the canvas on the screen and leave black borders on the top and bottom.

[0279] S1305, the source device projects display1 onto the sink device 1.

[0280] In one embodiment, if the screen resolution of the sink device 1 is 1080x2340, when the sink device 1 receives the canvas information corresponding to the cropping region 4 sent by the source device, the sink device 1 can display the canvas in the center and leave black borders with a size of x / 2 on both sides of the screen.

[0281] In one embodiment, when the sink device 1 receives the canvas information corresponding to the cropping region 4 sent by the source device, the sink device 1 can also display the canvas on the left side of the screen and leave a black border with a size of x on the right side of the screen.

[0282] ​In one embodiment, when the sink device 1 receives the canvas information corresponding to the cropped region 4 sent by the source device, the sink device 1 can also display the canvas on the right side of the screen and leave a black border with a size of x on the left side of the screen.

[0283] In one embodiment, when the sink device 1 receives the canvas information corresponding to the cropped region 4 sent by the source device, the sink device 1 can also display the canvas on the right side of the screen and leave a black border with a size of x on the left side of the screen.

[0284] It should be understood that the process of the source device casting the display 1 to the sink device 1 can refer to the existing casting technology, and thus will not be described herein for brevity.

[0285] In one embodiment, the sink device 1 can trigger the source device and the sink device to enter the full-screen mode in S1302, or the source device can trigger the source device and the sink device 1 to enter the full-screen mode. For example, when the source device detects a user operation of swiping from the left side of the screen to the right side, the source device can send a part of the split image information and indication information to the sink device 1, where the indication information is used to indicate the source device and the sink device 1 to enter the full-screen mode. The sink device 1 displays the image information in response to receiving the part of the split image information and the indication information.

[0286] S1306, the source device and the sink device 2 establish a wireless connection.

[0287] For example, as shown in FIG. 13, the source device can send a part of the image information and indication information to the sink device 1, where the indication information is used to indicate the source device and the sink device 1 to enter the full-screen mode. Figure 5As shown in (a), when mobile phone C is close to mobile phone B, mobile phone B can determine through RSSI ranging that the distance between mobile phone C and mobile phone B is less than or equal to a preset distance. Then, mobile phones A, B, and C can form a network via near-field wireless connection, thus establishing a wireless connection. For example, mobile phones A, B, and C can form an AP network, or they can form a P2P network.

[0288] S1307, when sink device 2 detects the user's second operation, sink device 2 instructs source device to enter full-screen mode.

[0289] For example, such as Figure 16 As shown in (a), phone A is the source device, phone B is the sink device 1, and phone C is the sink device 2. When phone C detects a user swiping to the right, phone C can send an instruction message to phone A, which indicates that phone C wants to enter full-screen mode.

[0290] It should be understood that the process of sink device 2 sending indication information to source device (indication information used to indicate that sink device 2 wants to enter full-screen mode) can be referred to the description of S1302 above, and will not be repeated here.

[0291] In this embodiment, when the sink device 2 detects a user swiping to the right, the sink device 2 can determine that the device to its left is the source device. If the sink device 2 detects that there are multiple devices to its left, then the sink device 2 can designate the leftmost device as the source device.

[0292] When sink device 2 detects a user swiping left, it can determine that the device to its right is the source device. If sink device 2 detects multiple devices to its right, it can designate the rightmost device as the source device.

[0293] In one embodiment, sink device 2 can also send distance information between sink device 1 and sink device 2 to source device.

[0294] For example, sink device 2 can send a UDP packet to source device 1, which may carry distance information between sink device 1 and sink device 2. The UDP packet includes the data portion of an IP datagram. The data portion of the IP datagram may include expandable bits. Sink device 2 and source device 2 can agree on the content of a certain expandable bit. For example, when a certain expandable bit is 000, the source device can know that the distance between sink device 1 and sink device 2 is 1 cm; when a certain expandable bit is 001, the source device can know that the distance between sink device 1 and sink device 2 is 2 cm; when a certain expandable bit is 011, the source device can know that the distance between sink device 1 and sink device 2 is 3 cm.

[0295] S1308, in response to receiving an instruction from sink device 1, source device enlarges the canvas on the current screen by two times.

[0296] For example, the original canvas size displayed by the source device was 1080x2340. When the source device receives the instruction information from the sink device 2, the source device can determine that the sink devices 1 and 2 want to form a three-screen splicing with the source device. Then, the source device expands the main device's display canvas size to (1080x3)x2340, that is, 3240x2340.

[0297] S1309, the source device will crop the canvas after it has been enlarged by two times. The first cropped part is displayed on the source device, the second part is placed in the virtual screen (display1) created by the source device, and the third part is placed in another virtual screen (display2) created by the source device.

[0298] For segmentation methods, such as Figure 17 As shown, when SurfaceFlinger composites display0, it clips the layer, where clipping region 1 is [0, 0, 1080, 2340]. The source device can put the canvas shown in clipping region 1 into display0, so that the source device can display the canvas in display0.

[0299] When SurfaceFlinger composites display1, it copies all layer information from display0 and then performs cropping, where cropping region 2 is [1080, 0, 2160, 2340]. The source device can shift cropping region 2 1080 degrees to the left and place it into display1. The source device can then project the canvas from display1 onto sink device 1.

[0300] When SurfaceFlinger composites display2, it copies all layer information from display0 and then performs cropping, where cropping region 3 is [2160, 0, 3240, 2340]. The source device can shift cropping region 3 2160 degrees to the left and place it into display2. The source device can then project the canvas from display2 onto the sink device 2.

[0301] For masking methods, such as Figure 6 As shown, the source device first determines the two areas to be clipped based on the distance between the source device and sink device 1, and the distance between sink device 1 and sink device 2 (e.g., Figure 17 (as shown in (d) in the diagram, regions 605 and 607). It should be understood that the process by which the source device determines the pixel values ​​of the region to be cropped can be referred to the description in the above embodiments, and will not be repeated here for the sake of brevity. Assume that the pixel values ​​to be cropped determined by the source are x and y.

[0302] When SurfaceFlinger composites display0, it clips the layer, where clipping region 4 is [0, 0, 1080, 2340]. The source device can put the canvas shown in clipping region 4 into display0, so that the source device can display the canvas in display0.

[0303] When SurfaceFlinger composites display1, it copies all layer information from display0 and then performs cropping, where cropping region 5 is [1080+x, 0, 2160+x, 2340]. The source device can shift cropping region 5 to the left by 1080+x and then place it into display1. The source device can then project the canvas from display1 onto sink device 1.

[0304] SurfaceFlinger composites display2 from display0, and crops the layer information, where the crop region 6 is [2160+x+y, 0, 3240, 2340]. The source device can put the crop region 6 into display2 after shifting it left by 2160+x+y. The source device can cast the canvas in display2 onto sink device 2.

[0305] It should be understood that, Figure 18 It should be understood that, the crop region 5 can also be [1080+x, 0, 2160, 2340]. The source device can put the crop region 5 into display1 after shifting it left by 1080+x. The source device can cast the canvas in display1 onto sink device 1.

[0306] The crop region 6 can also be [2160+y, 0, 3240, 2340]. The source device can put the crop region 6 into display2 after shifting it left by 2160+y. The source device can cast the canvas in display2 onto sink device 2.

[0307] S1310, the source device casts display1 onto sink device 1, and casts display2 onto sink device 2.

[0308] It should be understood that, the process of casting display1 onto sink device 1 and casting display2 onto sink device 2 by the source device can refer to the process of S1305, which will not be repeated here.

[0309] It should be understood that, the process of casting display1 onto sink device 1 and casting display2 onto sink device 2 by the source device can refer to the existing casting technology, which will not be repeated here for brevity.

[0310] Figure 9 A schematic flowchart of a method 1600 for displaying by the source device and the sink device in a paging mode is shown. The method 1800 includes:

[0311] S1801, the source device and the sink device establish a wireless connection.

[0312] It should be understood that, S1801 can refer to the process of S1301, which will not be repeated here for brevity.

[0313] S1802, when the sink end device detects the third operation of the user, the sink end device indicates to the source end device to enter the paging mode.

[0314] For example, as shown in (a) of FIG. 1 1, the icon of the paging mode displayed on the mobile phone B can be drawn by the mobile phone A. The mobile phone A can add the icon of the parallel mode, the icon of the dual application mode, the icon of the paging mode and the exit control on the cropped canvas after putting the cropped canvas into the display 1. Figure 19 In one embodiment, when the mobile phone B detects the operation of clicking the icon of the paging mode, the mobile phone B can obtain the touch event of the user and the corresponding coordinate point. The mobile phone B can send the touch event and the transformed coordinate point to the mobile phone A. The mobile phone A can switch from the full screen mode to the paging mode according to the touch event and the transformed coordinate point.

[0315] For example, the mobile phone B detects that the user clicks the screen at the position (100, 100), and then the mobile phone B determines that the event is the touch event and the coordinate point is transformed to (100+1080, 100), i.e. (1180, 100). Thus, the mobile phone B can send the touch event and the transformed coordinate point to the mobile phone A. The mobile phone A receives the touch event and the transformed coordinate point, and determines that the user clicks the icon of the paging mode on the mobile phone B, and then proceeds to S1803.

[0316] In one embodiment, the mobile phone B can also send the coordinate point (e.g. (100, 100)) information of the operation of clicking on the screen of the mobile phone B to the mobile phone A. The mobile phone A receives the coordinate information sent by the mobile phone B, and transforms the coordinate point to the coordinate point (e.g. (1180, 100)) on the canvas enlarged by 1 times by the mobile phone A. Thus, the mobile phone A can determine that the user clicks the icon of the paging mode on the mobile phone B.

[0317] It should be understood that the process of sending the touch event and the transformed coordinate point from the sink end device to the source end device can refer to the description in the above embodiments, which will not be repeated here for brevity.

[0318] In one embodiment, the icon of the paging mode displayed on the mobile phone B can be drawn by the mobile phone B. The mobile phone B receives the canvas of the display 1 sent by the mobile phone A, and adds the icon of the parallel mode, the icon of the dual application mode, the icon of the paging mode and the exit control on the canvas. When the mobile phone B detects the operation of clicking the icon of the paging mode, the mobile phone B sends the indication information to the mobile phone A, and the indication information is used to indicate that the mobile phone B wants to enter the paging mode.

[0319] In one embodiment, the icon of the paging mode displayed on the mobile phone B can be drawn by the mobile phone B. The mobile phone B receives the canvas of the display 1 sent by the mobile phone A, and adds the icon of the parallel mode, the icon of the dual application mode, the icon of the paging mode and the exit control on the canvas. When the mobile phone B detects the operation of clicking the icon of the paging mode, the mobile phone B sends the indication information to the mobile phone A, and the indication information is used to indicate that the mobile phone B wants to enter the paging mode.

[0320] For example, when the phone B detects the operation of the user clicking the icon of the page mode, the phone B can send a UDP packet to the phone A, and the UDP packet can carry the indication information indicating that the phone B wants to enter the page mode. The UDP packet includes the data part of the IP datagram. The data part of the IP datagram can include an extensible bit. The phone B and the phone A can agree on the content of the extensible bit. When the extensible bit is 1, the phone A can know that the phone B wants to enter the page mode.

[0321] For example, when the phone B detects the operation of the user clicking the icon of the page mode, the phone B can send a UDP packet to the phone A, and the UDP packet can carry the indication information indicating that the phone B wants to enter the page mode. The UDP packet includes the data part of the IP datagram. The data part of the IP datagram can include an extensible bit. The phone B and the phone A can agree on the content of the extensible bit. When the extensible bit is 1, the phone A can know that the phone B wants to enter the page mode.

[0322] S1803, in response to receiving the indication of the sink device, the source device and the sink device display by the page mode.

[0323] Figure 9 A schematic diagram of the display of the desktop of the source by the page mode is shown. When the source device receives the indication of the sink device, the source device expands the size of the display canvas by one time, and the source adjusts the desktop layout. For example, taking the system of the source device as an Android system, the first page of icons is displayed in the area 1901 and the second page of icons is displayed in the area 1902 by the App of the source device by overwriting the protected void onSizeChanged(int w, int h, int oldw, int oldh) method.

[0324] In the embodiment of the application, the page mode is different from mirroring one desktop and different from two independent desktops. The first page of the page mode displays the first desktop page, and the second page is the natural extension of the first desktop page, and the second page can not include the function bar at the bottom. Each page supports clicking, sliding and gesture operation under the page mode, for example, each page can be slid, and the sliding between the two pages is linked.

[0325] Taking the system of the source-end device as an example, the App of the source-end device listens to the change of the canvas size, and judges the current mode through calling the interface getSplicingModeType() shown in Table 1. For example, when the return value is 2, it can be determined that the current mode is the page mode, and then the page mode is switched to.

[0326] For example, Table 1 shows the correspondence of the package name, the interface prototype and the return value.

[0327] Table 1

[0328]

[0329]

[0330] When the App determines that the current mode is the page mode, the App displays the icons of the first page in the area 1901 and the icons of the second page in the area 1902 by overriding the method protected void onSizeChanged(int w, int h, int oldw, int oldh). The source-end device can put the canvas in the area 1902 after being cut into two halves and being shifted to the left by 1080 into the display 1, so as to project the display 1 on the sink-end device.

[0331] S1804, the source-end device displays one half of the canvas after being enlarged by one time and being cut into two halves, and creates a virtual screen (display 1) and puts the other half into the display 1.

[0332] S1805, the source-end device projects the display 1 on the sink-end device.

[0333] Referring to (b) shown in Figure 9 , the source-end device (mobile phone A) can display the icons of the first desktop page, and the sink-end device (mobile phone B) can display the icons of the second desktop page.

[0334] S1806, the source-end device detects the operation of starting the App by the user, and loads the content of the second page on the canvas after being enlarged by one time.

[0335] S1807, the source-end device displays one half of the canvas after being enlarged by one time and being cut into two halves, and displays the other half on the display 1.

[0336] For example, as shown in Figure 20As shown in (c) of FIG. 13, the mobile phone A can display the canvases of the first page and the second page (PDF1 / 8 and PDF2 / 8) of the App5 on the canvas which is enlarged by one time. The mobile phone A can crop the content of the first page (PDF1 / 8) and display it through the display screen, and put the cropped canvas of the second page (PDF2 / 8) into the display1 after shifting it to the left by 1080. The mobile phone A can project the display1 onto the mobile phone B.

[0337] It should be understood that the specific implementation process of S1806-S1807 can refer to the process of S1803-S1804 described above, and details are not described herein for brevity.

[0338] S1808, the source device projects the display1 onto the sink device.

[0339] For example, the sink device (mobile phone B) can display the content of the second page (PDF2 / 8).

[0340] The embodiments of the present application provide a way to enter the paging mode, and the application program can adjust the layout in this mode, which helps to improve the user experience when multiple devices are spliced.

[0341] Figure 11 A schematic flowchart of a method 2000 for displaying by the source device and the sink device in parallel mode is shown. The method 2000 includes:

[0342] S2001, the source device and the sink device establish a wireless connection.

[0343] It should be understood that S2001 can refer to the process of S1301 described above, and details are not described herein for brevity.

[0344] S2002, when the sink device detects the fourth operation of the user, the sink device indicates to the source device to enter the parallel mode.

[0345] For example, as shown in (a) of FIG. 14, the icon of the parallel mode displayed on the mobile phone B can be drawn by the mobile phone A. The mobile phone A can add the icon of the parallel mode, the icon of the dual application mode, the icon of the paging mode and the exit control on the cropped canvas after putting the cropped canvas into the display1. Figure 11

[0346] In one embodiment, when the mobile phone B detects the operation of clicking the paging mode, the mobile phone B can obtain the touch event of the user and the corresponding coordinate point information. The mobile phone B can send the touch event and the coordinate point information to the mobile phone A. The mobile phone A can switch from the full screen mode to the parallel mode according to the touch event and the coordinate point information.​

[0347] For example, the phone B detects that the user clicks the screen (100, 100), and then the phone B can determine that the event is a touch event, and the coordinate point is converted to (100+1080, 100), i.e., (1180, 100). Thus, the phone B can send the touch event and the converted coordinate point to the phone A. After receiving the touch event and the converted coordinate point, the phone A can determine that the user clicks the parallel mode on the phone B, and then S2003 is performed.

[0348] In one embodiment, the phone B can also send the coordinate point (e.g., (100, 100)) information of the user's click operation on the screen of the phone B to the phone A. After receiving the coordinate point information sent by the phone B, the phone A can convert the coordinate point to the coordinate point (e.g., (1180, 100)) on the canvas which is enlarged by 1 times. Thus, the phone A can determine that the user clicks the icon of the page mode on the phone B.

[0349] It should be understood that the process of sending the touch event and the converted coordinate point information from the phone B to the phone A can refer to the description in the above embodiments, which will not be repeated here for brevity.

[0350] In one embodiment, the icon of the page mode displayed on the phone B can be drawn by the phone B. After receiving the canvas of display1 sent by the phone A, the phone B can add the icon of the parallel mode, the icon of the dual application mode, the icon of the page mode, and the exit control on the canvas. When the phone B detects that the user clicks the icon of the parallel mode, the phone B sends the indication information to the phone A, which indicates that the phone B wants to enter the parallel mode.

[0351] For example, when the phone B detects that the user clicks the icon of the parallel mode, the phone B can send a UDP data packet to the phone A, which carries the indication information indicating that the phone B wants to enter the parallel mode. The UDP data packet includes the data part of the IP datagram. The data part of the IP datagram can include extensible bits. The phone B and the phone A can agree on the content of a certain extensible bit. When the certain extensible bit is 1, the phone A can know that the phone B wants to enter the parallel mode.

[0352] S2003, in response to receiving the indication of the sink device, the source device enlarges the size of the display canvas by 1 times.

[0353] S2004, detecting that the user starts the App, the source device displays the home page of the App on one half of the display canvas which is enlarged by 1 times.

[0354] For example, such as Figure 21 As shown in (c), phone A can display the homepage of App 6 on the left half of a canvas that is doubled in size. Phone A can also crop the left half and place it in display0, thus displaying the canvas shown in display0. At this point, since phone A has not yet detected any user interaction with an activity page, the content displayed on the right half is not limited. Phone A can also display its desktop on the right half of the doubled-sized canvas. Phone A can also crop the right half and place it in display1, thus projecting display1 onto phone B. Alternatively, phone A can choose not to project to phone B, and phone B can display its own desktop.

[0355] S2005, when it is detected that the user clicked on an activity page on the App's homepage, the source device displays the activity page on the other half of a canvas that is twice the size.

[0356] Figure 11 This demonstrates the process of opening an active page within an application hierarchy in parallel mode. Figure 11 Taking the GUI shown as an example, when the source device detects that the user clicked on a photo on the homepage of App6, it can display the content of the App's homepage in the doubled-sized area 2101 and the content of the photo in area 2102. The source device can crop the doubled-sized canvas, placing the canvas in area 2101 into display0, and displaying the canvas in display0 on the screen. The source device can also shift the canvas in area 2102 1080 degrees to the left and place it into display1, then project display1 onto the sink device, so that the sink device displays the active page.

[0357] In this embodiment, when the source device detects that a user has launched an app, it can by default display the app's homepage on the left half of a canvas that is twice the size of its original size. When the source device detects that a user has clicked on an activity page, it can call an API to display that activity page on the right half.

[0358] For example, Table 2 shows the correspondence between package name, interface prototype and return value.

[0359] Table 2

[0360]

[0361] The source end device judges what mode it is in by calling the interface getSplicingModeType() shown in Table 1. For example, when the return value is 3, it can be determined that the current mode is parallel mode. When the source end device detects that the user clicks a certain active page in the App, the App can call the startActivity() interface shown in Table 2, and set the active page to start at a specified orientation in the Intent extension field "position". For example, when the source end device detects that the user clicks the active page 1 in the App, and expects to start the active page 1 on the screen of another device (the other device is located on the right side of the current device), it writes intent.putExtra("position", RIGHT) in the Intent, and calls startActivity(Intent) to display the active page 1 on the other device.

[0362] For example, as shown in (b) of FIG. 10, when the phone A starts the App 6, the App 6 can call the getSplicingModeType() interface to determine that the current mode is parallel mode. When the phone A detects that the user clicks the photo 1101, the App 6 determines that the active page corresponding to the photo 100 needs to be started. The phone A determines that the phone B is located on the right side of the phone A, and then the phone A can write intent.putExtra("position", RIGHT) in the Intent, and call startActivity(Intent) to display the active page corresponding to the photo 100 on the device B. The phone A can crop the doubled canvas, display the canvas corresponding to the home page of the App 6 through the display screen, and put the active page corresponding to the photo 100 obtained by cropping into the display 1, and project the display 1 to the phone B. Thus, the phone B displays the active page. Figure 22

[0363] S2006, the source end device crops the doubled canvas, displays one half of the cropped canvas through the display screen, and displays the other half in the display 1.

[0364] S2007, the source end device projects the content of the display 1 to the sink end device.

[0365] The embodiments of the present application provide a way of displaying upper and lower active pages of an App in parallel mode, and display multiple active pages through multiple devices in parallel mode, thereby bringing better user experience when multiple devices are spliced.

[0366] Figure 10 ​A schematic flowchart of a method 2200 for displaying a dual-application mode by a source device and a sink device is shown. The method 2200 comprises:

[0367] S2201, the source device and the sink device establish a wireless connection.

[0368] It should be understood that S2201 can refer to the process of S1301 described above, and for brevity, will not be repeated here.

[0369] S2202, after the sink device detects the fifth operation of the user, the sink device indicates to the source device to enter the dual-application mode.

[0370] For example, as shown in (a) of FIG. 11, the icon of the dual-application mode displayed on the phone B can be drawn by the phone A. The phone A can add the icon of the parallel mode, the icon of the dual-application mode, the icon of the paging mode and the exit control on the cropped canvas after putting the cropped canvas into the display 1. Figure 10 In one embodiment, when the phone B detects the operation of clicking the dual-application mode, the phone B can obtain the touch event of the user and the corresponding coordinate point. The phone B can send the touch event and the converted coordinate point to the phone A. The phone A can switch from the full-screen mode to the dual-application mode according to the touch event and the coordinate point information.

[0371] For example, the phone B detects that the user clicks the screen at the position (100, 100), then the phone B can determine that the touch event is a click event and convert the coordinate point to (100+1080, 100), i.e. (1180, 100). Thus, the phone B can send the touch event and the converted coordinate point to the phone A. After receiving the touch event and the converted coordinate point, the phone A can determine that the user clicks the icon of the dual-application mode on the phone B, and then proceed to S2203.

[0372] In one embodiment, the phone B can also send the coordinate point (e.g. (100, 100)) information of the click operation detected on the screen of the phone B to the phone A. After receiving the coordinate information sent by the phone B, the phone A can convert the coordinate point to the coordinate point on the expanded canvas by 1 times (e.g. (1180, 100)) by the phone A. Thus, the phone A can determine that the user clicks the icon of the dual-application mode on the phone B.

[0373] It should be understood that the process of the phone B sending the touch event and the coordinate point information to the phone A can refer to the description in the above embodiments, and for brevity, will not be repeated here.

[0374] It should be understood that the process of the phone B sending the touch event and the coordinate point information to the phone A can refer to the description in the above embodiments, and for brevity, will not be repeated here.

[0375] In one embodiment, the icon of the dual-application mode displayed on the phone B can be drawn by the phone B. After receiving the canvas of displayl sent by the phone A, the phone B can add the icon of the parallel mode, the icon of the dual-application mode, the icon of the page mode and the exit control on the canvas. When the phone B detects the operation of the user clicking the icon of the dual-application mode, the phone B sends the indication information to the phone A, which indicates that the phone B wants to enter the dual-application mode.

[0376] For example, when the phone B detects the operation of the user clicking the icon of the dual-application mode, the phone B can send a UDP packet to the phone A, which carries the indication information indicating that the phone B wants to enter the dual-application mode. The UDP packet includes the data part of the IP datagram. The data part of the IP datagram can include extensible bits. The phone B and the phone A can agree on the content of a certain extensible bit. When the certain extensible bit is 1, the phone A can know that the phone B wants to enter the dual-application mode.

[0377] S2203, in response to receiving the indication of the sink device, the source device creates a virtual screen (display) and puts the canvas corresponding to the desktop of the source device into the display.

[0378] S2204, the source device screens the display to the sink device.

[0379] In one embodiment, taking the source device as an Android system for example, after receiving the indication of the sink device wanting to enter the dual-application mode, the source device can create a display. The source device can use the second desktop (second Launcher) mechanism of Android to start the second Launcher on the display, and screen the display to the sink device, so that the sink device can display the desktop of the source device.

[0380] For example, as shown in (b) of FIG. 20, Figure 10 After receiving the indication of the phone B wanting to enter the dual-application mode, the phone A can start the desktop of the phone A (including the network mode in the status bar, the Wi-Fi connection state, the battery capacity, the weather information, the date information and the icons of App1-App12) on the display, and screen the display to the phone B, so that the phone B can also display the desktop of the phone A.

[0381] S2205: When the sink device detects that the user has clicked the icon of the first application, it sends the touch event and coordinate point information to the source device.

[0382] It should be understood that the process of the sink device sending touch events and coordinate point information to the source device can be referred to the description in the above embodiments, and will not be repeated here for the sake of brevity.

[0383] S2206, in response to receiving the touch event and the coordinate point information, the source device can launch the first application and run the first application in the display.

[0384] For example, such as Figure 10 As shown in (c), when phone B detects that the user clicked the App4 icon, phone B can send the touch event and the coordinate information of the user's click point collected by phone B to phone A. After receiving the touch event and coordinate information, phone A can determine that phone B detected that the user clicked the screen and the corresponding coordinate information. Thus, phone A can determine that the user clicked the App4 icon on phone B. Phone A can then launch App4 and run it in the display, and then project the display onto phone B.

[0385] S2207, the source device projects the display onto the sink device.

[0386] like Figures 12 to 22 As described in (d), mobile phone B can display the interface of App4.

[0387] It should be understood that the display process of the source device when it detects the user's operation can be referred to the description in the existing technology, and will not be repeated here for the sake of brevity.

[0388] This application provides a method for displaying different applications of the source device on the source device and the sink device respectively through a dual application mode, avoiding the process of users switching back and forth between different applications on the source device and bringing a better user experience when splicing multiple devices.

[0389] The above combination Figures 23 to 24 This section introduces the process of achieving multi-device splicing display through full-screen mode, paginated mode, parallel mode, and dual-application mode. Based on this, the following section combines... Figure 23 This section explains how to enable content sharing between devices.

[0390] Figure 23A schematic flow chart of the method 2300 of content storage provided by the embodiments of the present application is shown. As shown in Figure 13 The method 2300 includes the following steps:

[0391] S2301, the source device and the sink device display by the first mode.

[0392] In one embodiment, the first mode can include a full screen mode, a page mode, a parallel mode and a dual application mode.

[0393] It should be understood that the process of the source device and the sink device displaying by the full screen mode can refer to the process shown in the above Figure 18 ; the process of the source device and the sink device displaying by the page mode can refer to the process shown in the above Figure 20 ; the process of the source device and the sink device displaying by the parallel mode can refer to the process shown in the above Figure 22 ; the process of the source device and the sink device displaying by the dual application mode can refer to the process shown in the above Figure 5 . Here, no further description is given.

[0394] S2302, when the source device detects the input of the user for the currently displayed content, prompting the user to save the currently displayed content on which device.

[0395] For example, as shown in (b) of Figure 5 , the mobile phone A is the source device, the mobile phone B is the sink device 1, and the mobile phone C is the sink device 2. When the mobile phone A detects the long press operation of the user on the screen of the mobile phone A, the mobile phone A can prompt the user to save the currently full screen displayed content on one or more of the mobile phone A, the mobile phone B or the mobile phone C.

[0396] In one embodiment, if the mobile phone A determines that the currently full screen displayed content is the content local to the mobile phone A, when the mobile phone A detects the long press operation of the user on the screen of the mobile phone A, the mobile phone A can prompt the user to save the currently full screen displayed content on one or more of the mobile phone B or the mobile phone C.

[0397] In one embodiment, when the source device detects the input of the user for the currently displayed content, the source device can determine whether the currently displayed content is content opened by the gallery or the file manager. If the currently displayed content is content opened by the gallery or the file manager, the source device can determine that the currently displayed content is content saved locally by the source device, and thus the source device can prompt the user to save the content to the sink device 1 and / or the sink device 2.

[0398] As shown in (b) of FIG. 1, when the phone A detects the voice instruction "share the video" input by the user, the phone A can first convert the voice instruction into text information through an automatic speech recognition (ASR) module, and then analyze the text information. The phone A can recognize the slot information and the user's intention in the text information through a natural language understanding (NLU) module. As an example, Table 3 shows the user's intention and the slot information determined by the phone A. Figure 3

[0399] Table 3

[0400]

[0401] When the phone A determines that the object information in the slot information is missing, the phone A can prompt the user to share the currently displayed content with which device. When the phone A detects another voice instruction "share with the phone B" input by the user, the phone A can determine that the user wants to share the currently displayed content with the phone B. Alternatively, when the phone A detects another voice instruction "share with the device located in the middle" input by the user, the phone A can determine that the user wants to share the currently displayed content with the phone B.

[0402] In one embodiment, if the source device, the sink device 1 and the sink device 2 currently display content saved locally by the source device, when the source device detects the input of the user for the currently displayed content, the source device can prompt the user to save the content to the sink device 1 and / or the sink device 2.

[0403] ​In one embodiment, if the content currently displayed by the source device, sink device 1, and sink device 2 is not content saved locally on the source device (for example, the currently displayed content is content played online by the source device), then when the source device detects user input on the currently displayed content, it can prompt the user to save the content to one or more of the source device, sink device 1, and sink device 2.

[0404] S2303, in response to the user's selection of sink device 1, the source device can send the currently displayed content to sink device 1.

[0405] For example, such as Figure 24 As shown in (c), mobile phones A and B are currently displaying a video. In response to the user clicking control 305, mobile phone A can send a UDP packet to mobile phone B. This UDP packet can carry the video content. The UDP packet includes the data portion of the IP datagram. The data portion of the IP datagram can include expandable bits. Mobile phone A can encode the video and place the encoded data in the expandable bits. After receiving the UDP packet, mobile phone B can decode the data in the expandable bits to obtain the video content, and mobile phone B can save the video content locally.

[0406] In one embodiment, when the source device sends the currently displayed content to the sink device 1, it can also send an instruction message to the sink device 1. This instruction message instructs the sink device 1 to save the content sent by the source device locally. For example, mobile phone A and mobile phone B can also agree on a certain expandable bit. When this expandable bit is 1, mobile phone B can know that mobile phone A wants it to save the content locally.

[0407] S2304, after sink device 1 finishes receiving the content, it sends an indication message to source device, which indicates that sink device 1 has successfully received the content.

[0408] For example, the sink device 1 can send a UDP packet to the source device, and the UDP packet can carry the indication information indicating that the sink device 1 has successfully received the content. The UDP packet includes a data part of an IP datagram. The data part of the IP datagram can include an extensible bit. The sink device 1 and the source device can agree on the content of the extensible bit. When the extensible bit is 1, the source device can know that the sink device 1 has successfully received the content.

[0409] In response to receiving the indication information, the source device can prompt the user that the sink device 1 has successfully received the content, in S2305.

[0410] In one embodiment, when the sink device 1 completes the reception of the content, the sink device 1 can not send the indication information to the source device, but can prompt the user that the sink device 1 has successfully received the content.

[0411] In the embodiments of the present application, the user can trigger the sharing of the currently displayed content on the source device, which saves the process of the user searching for the target device and sending the file to the target device through the close-range wireless communication, and helps to improve the user experience.

[0412] Figure 24 A schematic flowchart of a method 2400 for storing content is shown. As shown in the method 2400 includes: Figure 13

[0413] In S2401, the source device and the sink device display by the first mode.

[0414] In one embodiment, the first mode can include a full-screen mode, a paging mode, a parallel mode, and a dual-application mode.

[0415] It should be understood that the process of the source device and the sink device displaying by the full-screen mode can refer to the process shown in the above Figure 18 The process of the source device and the sink device displaying by the paging mode can refer to the process shown in the above Figure 20 The process of the source device and the sink device displaying by the parallel mode can refer to the process shown in the above Figure 22 The process of the source device and the sink device displaying by the dual-application mode can refer to the process shown in the above Figure 5 The process of the source device and the sink device displaying by the dual-application mode can refer to the process shown in the above The process of the source device and the sink device displaying by the dual-application mode can refer to the process shown in the above Figure 5 The process of the source device and the sink device displaying by the dual-application mode can refer to the process shown in the above

[0416] S2402, when the sink device 1 detects the input of the user for the current display content, the sink device 1 prompts the user to save the current display content on which device.

[0417] For example, as shown in (c) of FIG. 24, the mobile phone A is the source device, the mobile phone B is the sink device 1, and the mobile phone C is the sink device 2. When the mobile phone B detects the long press operation of the user on the screen of the mobile phone B, the mobile phone B can prompt the user to save the current full-screen display content on one or more of the mobile phone A, the mobile phone B, or the mobile phone C. Figure 4

[0418] It should be understood that the mobile phone B can also prompt the user to save the current display content on which device after detecting the voice instruction of the user. The specific process can refer to the description of S2302 above, and is not described herein again for brevity.

[0419] In one embodiment, if the current display content is a page of a file, the source device can also prompt the user to send the content of the page to the sink device or send the content of the entire file to the sink device.

[0420] S2403, in response to the operation of the user selecting the sink device 1, the sink device 1 can send first indication information to the source device, the first indication information being used to instruct the source device to send the content to the sink device 1.

[0421] For example, the sink device 1 can send a UDP packet to the source device, and the first indication information can be carried in the UDP packet. The first indication information is used to instruct the source device to send the current display content to the sink device 1. The UDP packet includes a data part of an IP datagram. The data part of the IP datagram can include an extensible bit. The sink device 1 and the source device can agree on the content of a certain extensible bit. When a certain extensible bit is 1, the source device can know that the sink device 1 wants it to send the current display content to the sink device 1.

[0422] S2404, in response to receiving the first indication information sent by the sink device 1, the source device can send the current display content to the sink device 1.

[0423] It should be understood that the specific implementation process of the source device sending the current display content to the sink device 1 can refer to the description of S2303 above, and is not described herein again for brevity. ​

[0424] S2405, when sink device 1 completes the reception of the content, it can prompt the user that the content has been successfully saved in sink device 1.

[0425] For example, as shown in (c) of FIG. 14, when mobile phone B successfully receives the video content sent by mobile phone A, mobile phone B can prompt the user that the video has been saved in mobile phone B. Figure 5

[0426] S2406, in response to the user selecting the operation of sink device 2, sink device 1 can send second indication information to source device, which is used to instruct source device to send the currently displayed content to sink device 2.

[0427] For example, sink device 1 can send a UDP packet to source device, which can carry the second indication information, which is used to instruct source device to send the currently displayed content to sink device 2. The UDP packet includes the data part of the IP datagram. The data part of the IP datagram can include extensible bits. Sink device 1 and source device can agree on the content of a certain extensible bit. When a certain extensible bit is 1, source device can know that sink device 1 wants it to send the currently displayed content to sink device 2.

[0428] ​For example, the second indication information can include a first field and a second field, the first field is used to request the source device to send the currently displayed content to the device indicated by the second field, and the second field carries address information of the sink device 2. The sink device 1 can send a UDP packet to the source device, and the data part of the IP datagram of the UDP packet can include the first field and the second field. For example, the sink device 1 and the source device can agree on the content of an extensible bit. When the content of the extensible bit is 1, the source device can know that the sink device 1 wants it to send the currently displayed content to the device indicated by the second field. For another example, the sink device 1 can know the address (for example, a wireless local area network address or a MAC address) of the sink device 2 when establishing a connection with the sink device 2. The sink device 1 can encode the address of the sink device 2 by using GBK, ISO8859-1 or Unicode (for example, UTF-8, UTF-16) and the like, and carry the encoded content on the second field. After receiving the UDP packet, the source device can decode it to obtain the address information of the device receiving the currently displayed content. Thus, the source device can send the currently displayed content to the device (sink device 2) indicated by the second field.

[0429] For example, the second indication information can include a first field and a third field. The first field is used to request the source device to send the currently displayed content to the device indicated by the third field. The third field is used to indicate the position of the device receiving the currently displayed content. The sink device 1 can send a UDP packet to the source device. The data part of the IP datagram of the UDP packet can include the first field and the third field. For example, the sink device 1 and the source device can agree on the content of an extensible bit. When the content of the extensible bit is 1, the source device can know that the sink device 1 wants it to send the currently displayed content to the device indicated by the third field. For another example, the sink device 1 can know the position information of the source device and the sink device 2 when establishing a connection with the source device and the sink device 2 (for example, the source device is located at the leftmost side, the sink device 1 is located in the middle, and the sink device 2 is located at the rightmost side). The sink device 1 can agree with the source device on the content of the third field. When the content carried by the third field is "001", the source device can know to send the displayed content to the device located at the rightmost side. When the content carried by the third field is "010", the source device can know to send the displayed content to the device located in the middle. When the content carried by the third field is "011", the source device can know to send the displayed content to the device located in the middle and the device located at the rightmost side. After receiving the UDP packet, the source device can decode it to obtain the position of the device receiving the currently displayed content. Since the source device can know the position information of the sink device 1 and the sink device 2 when establishing a connection with the sink device 1 and the sink device 2 (the sink device 1 is located in the middle and the sink device 2 is located at the rightmost side), the source device can send the currently displayed content according to the content in the third field.

[0430] S2407, in response to receiving the second indication information sent by the sink device 1, the source device can send the currently displayed content to the sink device 2.

[0431] It should be understood that the specific implementation process of the source device sending the currently displayed content to the sink device 2 can refer to the description of S2303 above. For brevity, it will not be repeated here.

[0432] S2408, when the source device completes the sending of the content, the source device can send a third indication information to the sink device 1, the third indication information is used to indicate that the source device has successfully sent the content to the sink device 2.

[0433] For example, the source device can send a UDP packet to the sink device 1, the UDP packet can carry the third indication information, the third indication information is used to indicate that the source device has successfully sent the content to the sink device 2. The UDP packet includes a data part of an IP datagram. The data part of the IP datagram can include an extensible bit. The sink device 1 and the source device can agree on the content of the extensible bit. When the extensible bit is 1, the sink device 1 can know that the source device has successfully sent the currently displayed content to the sink device 2.

[0434] In one embodiment, the third indication information includes response information and address information, the response information is used to indicate that the source device has successfully sent the content to the device corresponding to the address information, and the address information is used to indicate the address of the sink device 2. For example, the source device can agree with the sink device 1 on an extensible bit, when the extensible bit is 1, the sink device 1 can know that the source device has successfully sent the content to the device corresponding to the address information. The process that the source device carries the address information of the sink device 2 in the extensible bit can refer to the description of the process that the sink device 1 sends the address information of the sink device 2 to the source device in S2406, which will not be described here. After receiving the third indication information, the sink device 1 can determine that the source device has successfully sent the content through the response information and has successfully sent the content to the sink device 2 through the address information. Thus, the sink device 1 can prompt the user that the content has been successfully saved in the sink device 2.

[0435] In one embodiment, the third indication information includes response information and position information, the response information is used to indicate that the source device has successfully sent the content to the device corresponding to the position, and the position information is used to indicate the position (e.g., the rightmost position) of the sink device 2. For example, the source device and the sink device 1 can agree on an extensible bit, and when the extensible bit is 1, the sink device 1 can know that the source device has successfully sent the content to the device corresponding to the address information. The process of the source device carrying the position information of the sink device 2 in the extensible bit can refer to the description of the sink device 1 sending the position information of the sink device 2 to the source device in S2406, which will not be described here. After receiving the third indication information, the sink device 1 can determine that the source device has successfully sent the content through the response information and that the source device has successfully sent the content to the device at the rightmost position through the position information. Therefore, the sink device 1 can prompt the user that the content has been successfully saved in the device at the rightmost position.

[0436] In S2409, in response to receiving the third indication information, the sink device 1 can prompt the user that the content has been successfully saved in the sink device 2.

[0437] For example, as shown in (e) of FIG. 5B, when the mobile phone B knows that the mobile phone A has successfully sent the content of the video to the mobile phone B, the mobile phone B can display a prompt box 506. Figure 25

[0438] In one embodiment, when the sink device 2 successfully receives the content sent by the source device, the source device can be instructed that the content has been successfully received. In response to the instruction of the sink device 2, the source device can indicate to the sink device 1 that the sink device 2 has successfully received the content. In response to receiving the indication of the source device, the sink device 1 can prompt the user that the video has been successfully saved in the sink device 2.

[0439] In one embodiment, when the sink device 2 successfully receives the content sent by the source device, the sink device 2 can also prompt the user that the content has been successfully saved in the sink device 2.

[0440] It should be understood that S2403-S2405 and S2406-S2409 are in a parallel relationship.

[0441] Figure 25 ​A schematic flowchart of a method 2500 of content storage is shown, which is provided by an embodiment of the present application and is performed by a first electronic device and a second electronic device. The first electronic device communicates with the second electronic device through a close-range wireless connection. The first electronic device can be the source device, and the second electronic device can be the sink device. As shown in Figure 15 The method 2500 includes the following steps.

[0442] S2501 The first electronic device displays a first interface.

[0443] In one embodiment, the first interface can be a desktop of the first electronic device, or a display interface of an application in the first electronic device, or a lock screen interface of the first electronic device. The type of the first interface is not limited in the embodiments of the present application.

[0444] S2502 In response to detecting a first input of a user, the second electronic device sends first indication information to the first electronic device, where the first indication information is used to instruct the first electronic device and the second electronic device to perform joint display.

[0445] In one embodiment, the joint display includes the joint display through the full-screen mode, the joint display through the page mode, the joint display through the parallel mode, or the joint display through the dual-application mode.

[0446] It should be understood that the implementation process of the second electronic device sending the first indication information to the first electronic device can refer to the description in the above embodiments, which will not be repeated here.

[0447] S2503 In response to receiving the first indication information, the first electronic device displays first part image information and sends second part image information to the second electronic device according to the orientation information of the first electronic device and the second electronic device, where the first part image information and the second part image information are associated with the first interface.

[0448] In one embodiment, if the first electronic device determines to perform joint display with the second electronic device through the full-screen mode, in response to receiving the first indication information, the first electronic device can enlarge the image information corresponding to the first interface. The first electronic device can split the enlarged image information to obtain the first part image information and the second part image information. In other words, the first part image information and the second part image information are obtained by splitting the first interface after the first interface is enlarged by the first electronic device, so the first part image information and the second part image information are associated with the first interface.

[0449] In one embodiment, the first electronic device receives first information sent by the second electronic device before zooming the image information corresponding to the first interface, the first information being used to indicate the size of the display screen of the second electronic device; and the first electronic device zooms the image information corresponding to the first interface according to the number of electronic devices for display in mosaic, the size of the display screen of the first electronic device, and the size of the display screen of the second electronic device.

[0450] For example, if only the first electronic device and the second electronic device are used for display in mosaic, the first electronic device can determine to zoom the image information corresponding to the first interface by 1 times. If the size of the first electronic device in the first direction is A, the size of the first electronic device in the second direction is B, and the size of the second electronic device in the first direction is A, the size of the second electronic device in the second direction is B. When the first electronic device and the second electronic device are arranged along the first direction, the first electronic device can zoom the image information corresponding to the first interface in the first direction by 2A, and keep the size of the image information corresponding to the first interface in the second direction unchanged.

[0451] It should be understood that the size of the first electronic device in the first direction can be the size of the display screen of the first electronic device in the first direction, or the size of the first interface in the first direction; and the size of the first electronic device in the second direction can be the size of the display screen of the first electronic device in the second direction, or the size of the first interface in the second direction.

[0452] It should also be understood that the first direction and the second direction can be perpendicular to each other. If the first direction is a horizontal direction, the second direction can be a vertical direction; if the first direction is a vertical direction, the second direction can be a horizontal direction.

[0453] In one embodiment, if the first electronic device has a size of A in a first direction and a size of B in a second direction, and the second electronic device has a size of C in the first direction and a size of D in the second direction, where A is greater than C and B is greater than D, then the first electronic device can expand the image information corresponding to the first interface in the first direction to a size of 2A, and keep the size of the image information corresponding to the first interface in the second direction unchanged. The first electronic device can split the expanded canvas (e.g., into two regions of equal size), and the first electronic device can reduce the region to be sent to the second electronic device by a uniform ratio. For example, if A / B is less than C / D, then the first electronic device can reduce the region to be sent to the second electronic device to a size of A*D / B in the first direction and a size of D in the second direction. Thus, the first electronic device can send the reduced region to the second electronic device, so that the second electronic device displays the canvas in the reduced region. For another example, if A / B is greater than C / D, then the first electronic device can reduce the region to be sent to the second electronic device to a size of C in the first direction and a size of B*C / A in the second direction. Thus, the first electronic device can send the reduced region to the second electronic device, so that the second electronic device displays the canvas in the reduced region.

[0454] In one embodiment, the display screen of the first electronic device has a size of a first size in a first direction and a size of a second size in a second direction, the display screen of the second electronic device has a size of a third size in the first direction, the first direction and the second direction are perpendicular, and when the first electronic device and the second electronic device are displayed in a spliced manner along the first direction, the first electronic device expands the image information corresponding to the first interface in the first direction to a fourth size and keeps the size of the image information corresponding to the first interface in the second direction unchanged, the fourth size being the sum of the first size and the third size.

[0455] In one embodiment, the expanded image information is further split into third image information, the third image information being located between the first image information and the second image information, and the third image information being determined by the first electronic device according to the distance between the first electronic device and the second electronic device.

[0456] For example, the third image information can be a region that needs to be cropped. Figure 9 For example, the third image information can be a region that needs to be cropped.

[0457] In one embodiment, the first interface displays the first page of the first content. When the first electronic device determines that the first content includes multiple pages, it can display the first page and send the second page of the first content to the second electronic device. The second electronic device displays the second page in response to receiving the second page.

[0458] In this embodiment, if the first electronic device determines that the second electronic device is to be displayed in a paginated mode, the first electronic device can send the second page of the first content to the second electronic device while displaying the first page of the first content, thereby causing the second electronic device to display the second page of the first content. At this time, the first part of the image information can be the first page of the first content, and the second part of the image information can be the second page of the second content; both the first part of the image information and the second part of the image information are associated with the first content displayed on the first interface.

[0459] For example, if a first electronic device is displaying the first page of a document, and the document comprises multiple pages, a second electronic device displays its desktop. When the second electronic device detects a first input from the user, it can send a first instruction to the first electronic device. This first instruction can instruct the first and second electronic devices to display the document in a paginated manner. If the first electronic device determines that the document and the second electronic device are to be displayed in a paginated manner, then the first electronic device can continue displaying the first page of the document and can send the second page of the document to the second electronic device, thereby causing the second electronic device to display the second page.

[0460] In one embodiment, the first document further includes a third page and a fourth page. In response to detecting user input, the first electronic device displays the third page and sends the fourth page to the second electronic device; the second electronic device displays the fourth page in response to receiving the fourth page.

[0461] For example, such as Figure 3 As shown in (c), the PDF comprises 8 pages. Currently, the first electronic device and the second electronic device display the first page and the second page respectively in pagination mode. When mobile phone A detects a user's page-turning operation (e.g., mobile phone A detects the user swiping up from the bottom of the screen, or detecting the user swiping from the right side of the screen to the left side), mobile phone A can display the third page of the PDF and can send the fourth page of the PDF to mobile phone B, thereby causing mobile phone B to display the fourth page.

[0462] In one embodiment, the first file further includes third page content and fourth page content, the second electronic device, in response to detecting the input of the user, sends indication information to the first electronic device, the indication information being used to indicate that the second electronic device detects the input, the first electronic device, in response to receiving the indication information, displays the third page content and sends the fourth page content to the second electronic device, and the second electronic device, in response to receiving the fourth page content, displays the fourth page content.

[0463] For example, the PDF includes 8 pages of content, and the first electronic device and the second electronic device display the first page of content and the second page of content respectively in the page-by-page mode. When the mobile phone B detects the page-turning operation of the user (e.g., the mobile phone B detects the user’s swiping from the bottom of the screen upwards or detects the user’s swiping from the right side of the screen to the left side), the mobile phone B can send a corresponding touch event (e.g., a swiping event) to the mobile phone A. The mobile phone A can determine, according to the touch event sent by the mobile phone B, that the mobile phone B detects the page-turning operation of the user, at which time the mobile phone A can display the third page of content of the PDF and the mobile phone A can send the fourth page of content of the PDF to the mobile phone B, so that the mobile phone B displays the fourth page of content.

[0464] In one embodiment, the first interface is a desktop of the first electronic device, the first electronic device, in response to receiving the first indication information, displays the desktop and sends image information corresponding to the desktop to the second electronic device, and the second electronic device, in response to receiving the image information corresponding to the desktop, displays the desktop.

[0465] For example, the first electronic device can display a desktop of the first electronic device. When the second electronic device detects the first input of the user, the second electronic device can send first indication information to the first electronic device, the first indication information being used to indicate that the first electronic device and the second electronic device display in the split mode. If the first electronic device determines that the first electronic device and the second electronic device display in the split mode, the first electronic device can continue to display the desktop of the first electronic device and the first electronic device can send image information corresponding to the desktop to the second electronic device, so that the second electronic device displays the desktop of the first electronic device.

[0466] In one embodiment, the desktop includes an icon of a first application program, the second electronic device, in response to the input of the user, sends indication information to the first electronic device, the indication information being used to indicate that the second electronic device detects the input, the input being an input to the icon of the first application program, the first electronic device, in response to receiving the indication information, sends image information corresponding to a display interface of the first application program to the second electronic device, and the second electronic device, in response to receiving the image information corresponding to the display interface of the first application program, displays the display interface of the first application program.

[0467] In one embodiment, the desktop further includes an icon of a second application, and the first electronic device displays a display interface of the second application in response to detecting an input of the user on the icon of the second application.

[0468] In one embodiment, the first interface is a display interface of a third application, and the display interface includes a first interface element associated with a second interface of the third application, wherein the first part of the image information is image information corresponding to the first interface, and the second part of the image information is image information corresponding to the first interface; or the first part of the image information is image information corresponding to the first interface, and the second part of the image information is image information corresponding to the second interface.

[0469] In the embodiments of the present application, if the first electronic device determines that the second electronic device is to be displayed in parallel, the first electronic device can send image information corresponding to the current display interface of the first electronic device to the second electronic device, or the first electronic device can select an interface element on the current display interface, the interface element corresponding to another display interface, and the first electronic device can send image information corresponding to the other display interface to the second electronic device. The current display interface of the first electronic device can be a first-level page, and the other display interface can be a second-level page, and the first-level page and the second-level page are associated.

[0470] For example, the first electronic device can display a display interface 1 of an application, and the display interface 1 includes an interface element 1 associated with a display interface 2 of the application. When the second electronic device detects a first input of the user, the second electronic device can send first indication information to the first electronic device, the first indication information indicating that the first electronic device and the second electronic device are to be displayed in parallel. If the first electronic device determines that the second electronic device is to be displayed in parallel, the first electronic device can continue to display the display interface 1 and send image information of the display interface 1 to the second electronic device, so that the second electronic device displays the display interface 1. Alternatively, the first electronic device can continue to display the display interface 1 and send image information of the display interface 2 to the second electronic device, so that the second electronic device displays the display interface 2.

[0471] In one embodiment, the interface element 1 can be any interface element on the display interface 1 associated with another display interface; or the interface element 1 can be an interface element in a preset direction (for example, the upper left corner).

[0472] For example, the first electronic device can display a desktop of the first electronic device. When the second electronic device detects the input of the user, the second electronic device can send first indication information to the first electronic device, the first indication information being used to instruct the first electronic device and the second electronic device to perform splicing display. If the first electronic device determines that the first electronic device and the second electronic device perform splicing display in parallel mode, the first electronic device can continue to display the desktop of the first electronic device, and the first electronic device can send image information of the desktop of the first electronic device to the second electronic device, so that the second electronic device displays the desktop of the first electronic device. Alternatively, the first electronic device can continue to display the desktop of the first electronic device, and the first electronic device does not send any image information to the second electronic device, and the second electronic device can continue to display the current interface of the second electronic device.

[0473] In one embodiment, the first interface further includes a second interface element, the second interface element being associated with a third interface of the third application, and the first electronic device is further configured to, in response to detecting an input of the user on the second interface element, display image information corresponding to the first interface and send image information corresponding to the third interface to the second electronic device, and the second electronic device is further configured to, in response to receiving the image information corresponding to the third interface, display the third interface.

[0474] In one embodiment, the third interface includes a third interface element, the third interface element being associated with a fourth interface of the third application, and the second electronic device is configured to, in response to detecting an input of the user, send indication information to the first electronic device, the indication information being used to indicate that the second electronic device detects the input, the input being an input on the third interface element, and the first electronic device is configured to, in response to receiving the indication information, display the fourth interface and send image information corresponding to the third interface to the second electronic device, and the second electronic device is configured to, in response to receiving the image information corresponding to the third interface, display the third interface.

[0475] S2504, in response to receiving the second part of the image information, the second electronic device displays the second part of the image information.

[0476] In one embodiment, the second electronic device displays a first control while displaying the second part of the image information, and in response to detecting an input of the user on the first control, displays a display interface before the second electronic device detects the first input and sends fifth indication information to the first electronic device, the fifth indication information being used to instruct the first electronic device and the second electronic device to exit splicing display.

[0477] S2505, in response to detecting a second input of the user on the first part of the image information, the first electronic device sends first content associated with the first interface to the second electronic device.

[0478] It should be understood that S2505 and S2506-S2507 are in parallel relationship.

[0479] For example, as shown in (d) of FIG. 3B, when the mobile phone A detects the operation of the user clicking the control 305, the mobile phone A can send the first content to the mobile phone B. Figure 4

[0480] In one embodiment, the mobile phone A can display the prompt box 304 when detecting the first operation of the user on the screen, and the mobile phone A can send the first content to the mobile phone B when detecting the operation of the user clicking the control 305. Alternatively, the mobile phone A can also detect the second operation (for example, a gesture in the air) of the user on the screen, and then send the first content to the mobile phone B.

[0481] In one embodiment, in response to detecting the second input, the first electronic device prompts the user to save the first content in the second electronic device; and in response to an operation of the user determining to save the first content in the second electronic device, the first electronic device sends the first content to the second electronic device.

[0482] S2506, in response to detecting the third input of the user, the second electronic device sends second indication information to the first electronic device, the second indication information being used to indicate that the second electronic device detects the third input, the third input being an input for the second part of the image information.

[0483] For example, as shown in (b) of FIG. 4B, when the mobile phone B detects the operation of the user clicking the control 402, the mobile phone B can send the second indication information to the mobile phone A. Figure 4

[0484] It should be understood that the implementation process of the mobile phone B sending the second indication information to the mobile phone A can refer to the description of the above embodiments, which will not be described here.

[0485] S2507, in response to receiving the second indication information, the first electronic device sends the first content to the second electronic device.

[0486] In one embodiment, in response to detecting the third input, the second electronic device prompts the user to save the first content in the second electronic device; and in response to an operation of the user determining to save the first content in the second electronic device, the second electronic device sends the second indication information to the first electronic device.

[0487] For example, as shown in (b) of FIG. 4B, when the mobile phone B detects the operation of the user clicking the control 402, the mobile phone B can send the second indication information to the mobile phone A. Figure 4 ​​As shown in (b) of FIG. 4, in response to a long press operation of the user on the screen, the mobile phone B can prompt the user to save the video in the mobile phone B. In response to an operation of the user clicking the control 402 (which is an operation of the user confirming to save the video content in the mobile phone B), the mobile phone B can send the second indication information to the mobile phone A.

[0488] In an embodiment, the second electronic device is further configured to, in response to successfully receiving the first content, prompt the user that the first content has been successfully saved in the second electronic device.

[0489] For example, as shown in (c) of FIG. 4, when the mobile phone B successfully receives the video content, the mobile phone B can prompt the user that "the video has been saved in the mobile phone B!". Figure 3

[0490] In an embodiment, the first electronic device is further configured to, in response to completing sending the first content, prompt the user that the first content has been successfully saved in the second electronic device.

[0491] For example, as shown in (e) of FIG. 4, when the mobile phone A completes sending the video content, the mobile phone B can prompt the user that "the video has been saved in the mobile phone B!". Figure 26

[0492] In the embodiments of the present application, the mobile phone A and the mobile phone B can trigger content storage when displaying in the full-screen mode or the split-page mode, or can trigger content storage when displaying in the parallel mode or the dual-application mode.

[0493] For example, the mobile phone A and the mobile phone B display the home page of a social application and the chat interface of the user A and the user B in the social application respectively in the parallel mode, and the chat interface displays that the user B sends a certain document to the user A. When the mobile phone B detects the input of the user, the mobile phone B can send indication information to the mobile phone A, the indication information being used to indicate that the mobile phone detects the input of the user, the input being an input for the document. In response to receiving the indication information, the mobile phone A can send image information corresponding to the chat interface displaying the function window to the mobile phone B. The function window can include the controls of forwarding, collecting, quoting, deleting, sending to the mobile phone B, etc. In response to receiving the image information, the mobile phone B can display the chat interface including the function window. When the mobile phone B detects another input of the user, the mobile phone B can send another indication information to the mobile phone A, the other indication being used to indicate that the mobile phone B detects the other input, the other input being an operation for the control corresponding to the sending to the mobile phone B. In response to receiving the other indication information, the mobile phone A can send the content of the document to the mobile phone B.

[0494] ​​In an embodiment of the present application, after the first electronic device and the second electronic device trigger splicing display, the user can trigger saving the first content in the second electronic device on the first electronic device, or the user can also trigger saving the first content in the second electronic device on the second electronic device. In this way, the operation of searching for the electronic device and confirming before content transmission is saved, which helps to improve the efficiency of content transmission between electronic devices, thereby helping to improve the user experience.

[0495] Figure 25 A schematic block diagram of the apparatus 2600 provided by an embodiment of the present application is shown. The apparatus 2600 can be arranged in the first electronic device in the above Figure 27 The apparatus 2600 includes: a display unit 2610, configured to display a first interface; a receiving unit 2620, configured to receive first indication information sent by the second electronic device, the first indication information being used to indicate that the first electronic device and the second electronic device perform splicing display; the display unit 2610 is further configured to, in response to the receiving unit receiving the first indication information, display first partial image information according to the orientation information of the first electronic device and the second electronic device; a sending unit 2630, configured to, in response to the receiving unit receiving the first indication information, send second partial image information to the second electronic device according to the orientation information of the first electronic device and the second electronic device, the first partial image information and the second partial image information being associated with the first interface; a detection unit 2640, configured to detect a first input of the user for the first partial image information; the sending unit 2630 is further configured to, in response to the detection unit detecting the first input, send first content associated with the first interface to the second electronic device.

[0496] Figure 25 A schematic block diagram of the apparatus 2700 provided by an embodiment of the present application is shown. The apparatus 2700 can be arranged in the first electronic device in the above Figure 28In the second electronic device in the first electronic device, the apparatus 2700 comprises: a detection unit 2710 configured to detect a first input of a user; a sending unit 2720 configured to, in response to the detection unit detecting the first input, send first indication information to the first electronic device, the first indication information being used to instruct the first electronic device and the apparatus to perform splicing display; a receiving unit 2730 configured to receive second partial image information sent by the first electronic device, the second partial image information being associated with a first interface, the first interface being a display interface of the first electronic device when the first indication information is received; and a display unit 2740 configured to, in response to the receiving unit receiving the second partial image information, display the second partial image information; the detection unit 2710 is further configured to detect a second input of a user; the sending unit 2720 is further configured to send second indication information to the first electronic device, the second indication information being used to instruct the second electronic device to detect the second input, the second input being an input to the second partial image information; and the receiving unit 2730 is further configured to receive first content associated with the first interface sent by the first electronic device.

[0497] Figure 28 A schematic structural diagram of an electronic device 2800 provided by an embodiment of the present application is shown. As shown in the figure, the electronic device comprises: one or more processors 2810, one or more memories 2820, and the one or more memories 2820 store one or more computer programs, the one or more computer programs comprising instructions. When the instructions are run by the one or more processors 2810, the first electronic device or the second electronic device performs the technical solutions in the above embodiments. ​

[0498] An embodiment of the present application provides a system comprising a first electronic device and a second electronic device, and the system is used to perform the technical solutions in the above embodiments. The implementation principles and technical effects are similar to those of the above method-related embodiments, and will not be described here.

[0499] An embodiment of the present application provides a computer program product, when the computer program product is run on a first electronic device (or, a source device), the first electronic device performs the technical solutions in the above embodiments. The implementation principles and technical effects are similar to those of the above method-related embodiments, and will not be described here.

[0500] An embodiment of the present application provides a computer program product, when the computer program product is run on a second electronic device (or, a sink device), the second electronic device performs the technical solutions in the above embodiments. The implementation principles and technical effects are similar to those of the above method-related embodiments, and will not be described here.

[0501] ​The embodiment of the present application provides a readable storage medium, the readable storage medium contains instructions, when the instructions run in the first electronic device (or, source end device), causes the first electronic device to execute the technical scheme of the above embodiment. Its implementation principle and technical effect are similar, and will not be repeated here.

[0502] The embodiment of the present application provides a readable storage medium, the readable storage medium contains instructions, when the instructions run in the second electronic device (or, sink end device), causes the second electronic device to execute the technical scheme of the above embodiment. Its implementation principle and technical effect are similar, and will not be repeated here.

[0503] The embodiment of the present application provides a chip, the chip is used to execute instructions, when the chip runs, executes the technical scheme in the above embodiment. Its implementation principle and technical effect are similar, and will not be repeated here.

[0504] Those skilled in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software mode depends on the specific application and design constraints of the technical scheme. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0505] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

[0506] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be realized by other ways. For example, the above-described device embodiments are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the shown or discussed units can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0507] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. According to actual needs, part or all of the units can be selected to realize the purpose of the embodiment scheme.

[0508] In addition, each function unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0509] If the functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the parts of the technical solutions that essentially contribute to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0510] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A system, characterized by The system comprises a first electronic device and a second electronic device, the first electronic device communicates with the second electronic device through a short-range wireless connection, The first electronic device is configured to display a first interface; The second electronic device is configured to, in response to detecting a first input of a user, send first indication information to the first electronic device, the first indication information being used to instruct the first electronic device and the second electronic device to perform splicing display; The first electronic device is further configured to, in response to receiving the first indication information, display first partial image information and send second partial image information to the second electronic device according to position information of the first electronic device and the second electronic device, the first partial image information and the second partial image information being associated with the first interface; The second electronic device is further configured to, in response to receiving the second partial image information, display the second partial image information; The first electronic device is further configured to, in response to detecting a second input of a user for the first partial image information, send first content associated with the first interface to the second electronic device; or the second electronic device is further configured to, in response to detecting a third input of a user, send second indication information to the first electronic device, the second indication information being used to instruct the second electronic device to detect the third input, the third input being an input for the second partial image information; and the first electronic device is further configured to, in response to receiving the second indication information, send the first content to the second electronic device. The first electronic device is specifically configured to: in response to detecting the second input, prompt the user to save the first content in the second electronic device; in response to an operation of the user determining to save the first content in the second electronic device, send the first content to the second electronic device.

2. The system of claim 1, wherein, The second electronic device is specifically configured to: in response to detecting the third input, prompt the user to save the first content in the second electronic device; in response to an operation of the user determining to save the first content in the second electronic device, send the second indication information to the first electronic device.

3. The system of claim 1 or 2, wherein, The second electronic device is further configured to, in response to successfully receiving the first content, prompt the user that the first content has been successfully saved in the second electronic device.

4. The system of any one of claims 1 to 3, wherein, The first electronic device is further configured to, in response to completing the sending of the first content, prompt the user that the first content has been successfully saved in the second electronic device.

5. The system of any one of claims 1 to 4, wherein, The first electronic device is further configured to receive first information sent by the second electronic device, the first information being used to indicate a size of a display screen of the second electronic device; The first electronic device is further configured to, according to a number of electronic devices performing splicing display, a size of a display screen of the first electronic device, and a size of a display screen of the second electronic device, enlarge and split image information corresponding to the first interface to obtain the first partial image information and the second partial image information.

6. The system of claim 5, wherein, The display screen of the first electronic device has a first size in a first direction and a second size in a second direction, the display screen of the second electronic device has a third size in the first direction, and the first direction and the second direction are perpendicular, and the first electronic device is specifically used for: When the first electronic device and the second electronic device are displayed in the first direction, the first electronic device expands the image information corresponding to the first interface in the first direction to a fourth size and keeps the size of the image information corresponding to the first interface in the second direction unchanged, and the fourth size is the sum of the first size and the third size.

7. The system of claim 5 or 6, wherein, The expanded image information is further divided to obtain third part image information, the third part image information is located between the first part image information and the second part image information, and the third part image information is determined by the first electronic device according to the distance between the first electronic device and the second electronic device.

8. The system of any one of claims 1 to 4, wherein, The first interface displays first page content of the first content, and the first content further includes second page content, the first part image information is the first page content, and the second part image information is the second page content.

9. A method of content storage, characterized by, The method is applied to a first electronic device, the first electronic device communicates with a second electronic device through a short-distance wireless connection, and the method comprises: The first electronic device displays a first interface; The first electronic device receives first indication information sent by the second electronic device, and the first indication information is used to indicate that the first electronic device and the second electronic device are displayed in a splicing manner; In response to receiving the first indication information, the first electronic device displays first part image information according to the position information of the first electronic device and the second electronic device, and sends second part image information to the second electronic device, the first part image information and the second part image information are associated with the first interface; In response to detecting a first input of a user for the first part image information, the first electronic device sends first content associated with the first interface to the second electronic device; The first electronic device sends the first content associated with the first interface to the second electronic device in response to detecting the first input of the user for the first part image information, comprising: in response to detecting the first input, the first electronic device prompts the user to save the first content in the second electronic device; In response to the operation of the user determining to save the first content in the second electronic device, the first electronic device sends the first content to the second electronic device.

10. The method of claim 9, wherein, The method further comprises: In response to completing the sending of the first content, the first electronic device prompts the user that the first content has been successfully saved in the second electronic device.

11. The method according to claim 9 or 10, characterized in that, The method further comprises: The first electronic device receives first information sent by the second electronic device, and the first information is used to indicate the size of the display screen of the second electronic device; The method comprises the following steps before the first part of image information is displayed and the second part of image information is sent to the second electronic device: The first electronic device expands and divides the image information corresponding to the first interface according to the number of electronic devices for splicing display, the size of the display screen of the first electronic device, and the size of the display screen of the second electronic device, to obtain the first part of image information and the second part of image information.

12. The method of claim 11, wherein, The size of the display screen of the first electronic device in the first direction is the first size, the size of the first electronic device in the second direction is the second size, the size of the display screen of the second electronic device in the first direction is the third size, the first direction and the second direction are perpendicular, and the first electronic device expands the image information corresponding to the first interface according to the number of electronic devices for splicing display, the size of the display screen of the first electronic device, and the size of the display screen of the second electronic device, which comprises the following steps: When the first electronic device and the second electronic device are displayed in splicing along the first direction, the first electronic device expands the size of the image information corresponding to the first interface in the first direction to the fourth size and keeps the size of the image information corresponding to the first interface in the second direction unchanged, and the fourth size is the sum of the first size and the third size.

13. The method according to claim 11 or 12, characterized in that, The expanded image information is further divided to obtain the third part of image information, the third part of image information is located between the first part of image information and the second part of image information, and the third part of image information is determined by the first electronic device according to the distance between the first electronic device and the second electronic device.

14. The method of claim 9 or 10, wherein, The first interface displays the first page content of the first content, and the first content further comprises the second page content, the first part of image information is the first page content, and the second part of image information is the second page content.

15. A method of content storage, characterized by, The method is applied to the second electronic device, the second electronic device communicates with the first electronic device through close-range wireless connection, and the method comprises the following steps: In response to detecting the first input of the user, the second electronic device sends first indication information to the first electronic device, the first indication information is used to instruct the first electronic device and the second electronic device to display in splicing; The second electronic device receives the second part of image information sent by the first electronic device, the second part of image information is associated with the first interface, and the first interface is the display interface of the first electronic device when the first indication information is received; In response to receiving the second part of image information, the second electronic device displays the second part of image information; In response to detecting the second input of the user, the second electronic device sends second indication information to the first electronic device, the second indication information is used to instruct the second electronic device to detect the second input, and the second input is an input to the second part of image information. The second electronic device receives the first content associated with the first interface sent by the first electronic device; The second electronic device sends second indication information to the first electronic device in response to detecting the second input of the user, including: In response to detecting the second input, the second electronic device prompts the user to save the first content in the second electronic device; In response to the user determining to save the first content in the second electronic device, the second electronic device sends the second indication information to the first electronic device.

16. The method of claim 15, wherein, The method further includes: In response to successfully receiving the first content, the second electronic device prompts the user that the first content has been successfully saved in the second electronic device.

17. The method according to claim 15 or 16, characterized in that, The second part of image information is image information obtained by the first electronic device after expanding and dividing the image information corresponding to the first interface.

18. The method of claim 15 or 16, wherein, The first interface displays the first page content of the first content, and the first content further includes second page content, the first part of image information is the first page content, and the second part of image information is the second page content.

19. An electronic device, comprising: Comprise: One or more processors; One or more memories; The one or more memories store one or more computer programs, the one or more computer programs include instructions, when the instructions are executed by the one or more processors, make the electronic device execute the method as claimed in any one of claims 9 to 14; or, when the instructions are executed by the one or more processors, make the electronic device execute the method as claimed in any one of claims 15 to 18.

20. A computer-readable storage medium, characterized in that, Comprise computer instructions, when the computer instructions run on an electronic device, make the electronic device execute the method as claimed in any one of claims 9 to 14; or, When the computer instructions run on an electronic device, make the electronic device execute the method as claimed in any one of claims 15 to 18.

Images