A message processing method, related device and system

Abstract

A method for message processing is provided, comprising: first, after a terminal establishes a connection with an external display device, the terminal sends first data to the external display device, instructing the external device to display a first interface in full screen. After the terminal receives a new message from the first application, the terminal sends a first instruction to the external display device, instructing the external display device to display a first notification message. When the terminal receives a first input operation from the user for the first notification message, the terminal displays a third interface, sends second data to the external display device, instructing the external display device to divide the display area of ​​the external display device into a first display area and a second display area, and displays a fourth interface in the first display area after scaling down the first interface, and displays a fifth interface with the same interface elements as the third interface in the second display area. In this way, multiple independent display interfaces can be displayed simultaneously in split-screen through the external display device, making it convenient for users to operate multiple display interfaces at the same time.

Description

[0001] This application is a divisional application. The application number of the original application is 201811640377.8, and the original application date is December 29, 2018. The entire content of the original application is incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of mobile communication technology, and in particular to a message processing method, related device and system. Background Art

[0003] The transformation of terminals into personal computers (PCs) is a key means of achieving mobile office productivity. Specifically, mobile phones and other terminals can project their screen content onto large-screen displays such as PCs through Wi-Fi Display or Microsoft's continuum feature, allowing them to function like PCs even when connected to external display devices.

[0004] When a phone is connected to a large-screen monitor, it effectively has two displays: the phone's touchscreen and the connected external display device. The phone can control both displays to display the same interface simultaneously, or it can control each to run two independent interfaces.

[0005] When a mobile phone controls two displays to run two independent display interfaces respectively, for example, when a video or a slideshow is played in full screen on the external display device, if the mobile phone receives a new message such as a text message, and the user needs to view it on the external display device, it is necessary to exit the full-screen playback of the video or the full-screen presentation of the slideshow before being able to view the text message or WeChat message and perform further operations on the message, which will interrupt the full-screen playback of the video or the playback of the slideshow. Summary of the Invention

[0006] The present application provides a message processing method, related devices and systems. When a terminal displays on multiple screens, it can simultaneously display multiple independent display interfaces through an external display device, making it convenient for users to operate multiple display interfaces at the same time.

[0007] In a first aspect, the present application provides a message processing method, comprising: first, after establishing a connection with an external display device, the terminal sends first data to the external display device. Then, based on the received first data, the external display device displays a first interface in full screen. A second interface is displayed on the touch screen of the terminal, and the first interface is different from the second interface. Next, when the terminal receives a new message from a first application, the terminal sends a first command to the external display device. Then, after receiving the first command, the external display device displays a first notification message. Next, when the terminal receives a first user input operation in response to the first notification message, the terminal displays a third interface via the touch screen and sends second data to the external display device. The third interface is an interface within the first application. Then, after receiving the second data, the external display device divides its display area into a first display area and a second display area, and displays a fourth interface in the first display area and a fifth interface in the second display area. The fourth interface is a scaled-down version of the first interface, and has the same interface elements; the interface elements of the fifth interface are the same as those of the third interface.

[0008] In this way, when the terminal uses an external display device to display the first interface in full screen, if the terminal receives a new message from the first application, it can display the reduced interface of the first interface and the interface in the first application in split screen on the external display device according to user needs. This can facilitate users to operate multiple display interfaces at the same time on the external display device, and facilitate users to view new messages of the first application.

[0009] In one implementation, after the external display device displays the fourth interface in the first display area and the fifth interface in the second display area, the method further includes: first, when the terminal receives a new message from the second application, the terminal sends a second instruction to the external display device. Then, after receiving the second instruction, the external display device displays the second notification information. Then, the terminal receives the user's second input operation for the second notification information. In response to the second input operation, the terminal sends third data to the external display device. Then, after receiving the third data, the external display device displays the fourth interface in the first display area and the sixth interface in the second display area, wherein the sixth interface is the interface in the second application. In this way, after the external display device displays the two interfaces in a split screen, when a new message from the second application arrives, the terminal can, according to the user's needs, display the interface of the second application in the display area that originally displayed the interface of the first application on the external display device, so that the user can reply to new messages from multiple applications in a timely manner.

[0010] In one implementation, after the external display device displays the fourth interface in the first display area and the fifth interface in the second display area, the method further includes: first, when the terminal receives a new message from the second application, the terminal sends a second instruction to the external display device. Then, after receiving the second instruction, the external display device displays the second notification information. Then, the terminal receives the user's second input operation for the second notification information. In response to the second input operation, the terminal sends fourth data to the external display device. Then, after receiving the fourth data, the external display device divides the display area of ​​the external display device into a third display area, a fourth display area, and a fifth display area, and displays the seventh interface in the third display area, the eighth interface in the fourth display area, and the ninth interface in the fifth display area. Among them, the seventh interface has the same interface elements as the fourth interface, the eighth interface is the interface in the first application, and the ninth interface is the interface in the second application. In this way, after the external display device displays the two interfaces in split screen, when a new message from the second application arrives, the terminal can, according to the user's needs, display the reduced interface of the first interface, the interface of the first application, and the interface of the second application in split screen on the external display device, which can facilitate users to reply to new messages from multiple applications in a timely manner.

[0011] In one implementation, after the external display device displays the first notification message, the method further includes: when the terminal does not receive the first input operation for the first notification message within a first time threshold, the terminal sends a third instruction to the external display device. After receiving the third instruction, the external display device hides the first notification message and displays a first prompt prompting the user to view new messages of the first application on the terminal. In this way, when the user does not want to view the first notification message, the terminal hides the first notification message, thereby reducing obstruction of the first interface displayed on the external display device and improving the user experience.

[0012] In one implementation, the external display device is configured with a touch sensor; and the terminal receives a first user input operation in response to the notification message, specifically including: the terminal receives the first user touch operation in response to the notification message via the touch sensor of the external display device. Thus, when the external display device is a screen with a touch sensor, the terminal can receive the user's touch operation on the external display device to enable a split-screen display on the external display device, allowing the user to quickly view new messages from the first application.

[0013] In one implementation, the terminal is connected to a mouse; the terminal receiving a first user input operation in response to the notification message specifically includes: the terminal receiving, via the mouse, a first click operation in response to the first notification message. Thus, the terminal can receive the user's click operation in response to the first notification message via the mouse to enable a split-screen display on the external display device, facilitating the user to quickly view new messages from the first application.

[0014] In one implementation, the terminal is connected to a mouse; the terminal receives a first input operation from the user for the notification message, specifically including: the terminal receives, via the mouse, a first sliding operation in which the user operates a mouse pointer displayed on the external display device to slide across a first designated area on the external display device; wherein the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold. In this way, the terminal can receive, via the mouse, a sliding operation in which the user controls the mouse pointer to slide across the external display device, thereby enabling a split-screen display on the external display device, thereby facilitating the user to quickly view new messages from the first application.

[0015] In one implementation, the terminal is connected to a keyboard; the terminal receives a first user input operation in response to the notification message, specifically including: the terminal receives, via the keyboard, a first press operation of one or more designated keys on the keyboard by the user. In this way, the terminal can receive the user's press operation of the designated keys via the keyboard to enable a split-screen display on the external display device, facilitating the user to quickly view new messages from the first application.

[0016] In one implementation, the method further includes: the terminal receiving a third input operation from the user. In response to the third input operation, the terminal sending fifth data to the external display device. After receiving the fifth data, the external display device displays the first interface in full screen. In this way, after the user views the new message of the first application, the terminal can restore the full-screen display of the first interface on the external display device according to the user's needs, thereby improving the user experience.

[0017] In one implementation, the external display device is configured with the touch sensor; the terminal receiving the third input operation of the user specifically includes: the terminal receiving the second touch operation of the user through the touch sensor of the external display device. Or,

[0018] The terminal is connected to a mouse, and the terminal receives a third input operation from the user, specifically including: the terminal receives, through the mouse, a second sliding operation in which the user operates the mouse pointer displayed on the external display device to slide on a second designated area on the external display device. The sliding distance of the second sliding operation on the second designated area is greater than a second distance threshold, or the sliding time of the second sliding operation on the second designated area is greater than a second time threshold. Or,

[0019] The terminal is connected to a keyboard, and the terminal receives a third input operation from the user, specifically including: the terminal receives, through the keyboard, a second pressing operation of the user on one or more designated keys on the keyboard.

[0020] In this way, when the external display device is a screen with a touch sensor, the terminal can receive a user's touch operation on the external display device to activate split-screen display on the external display device; or receive a user's sliding operation of controlling a mouse pointer on the external display device to activate split-screen display on the external display device; or receive a user's pressing operation of a designated key on the keyboard to activate split-screen display on the external display device. This facilitates the user to quickly view new messages of the first application.

[0021] In one implementation, the first interface includes a video playback interface, a slide presentation interface, or a picture browsing interface; or the second interface includes a main interface, wherein the main interface includes an icon of the first application.

[0022] In a second aspect, the present application provides a system comprising: a terminal and an external display device. The terminal is connected to the external display device. The terminal is configured to send first data to the external display device. The external display device is configured to display a first interface in full screen based on the received first data; wherein a second interface is displayed on the touch screen of the terminal, and the first interface is different from the second interface. The terminal is further configured to send a first instruction to the external display device upon receiving a new message from a first application. The external display device is further configured to display a first notification message after receiving the first instruction. The terminal is further configured to display a third interface via the touch screen upon receiving a first input operation from a user in response to the first notification message, and to send second data to the external display device. The third interface is an interface within the first application. The external display device is further configured to divide the display area of ​​the external display device into a first display area and a second display area upon receiving the second data, and to display a fourth interface in the first display area and a fifth interface in the second display area. Among them, the fourth interface is the interface after the first interface is scaled down, and the interface elements are the same, and the interface elements in the fifth interface are the same as the interface elements in the third interface.

[0023] In this way, when the terminal uses an external display device to display the first interface in full screen, if the terminal receives a new message from the first application, it can display the reduced interface of the first interface and the interface in the first application in split screen on the external display device according to user needs. This can facilitate users to operate multiple display interfaces at the same time on the external display device, and facilitate users to view new messages of the first application.

[0024] In one implementation, the terminal is further used to send a second instruction to the external display device when a new message from the second application is received. The external display device is further used to display a second notification message after receiving the second instruction. The terminal is also used to receive a second input operation from the user for the second notification message. The terminal is also used to send third data to the external display device in response to the second input operation. The external display device is also used to display the fourth interface in the first display area and the sixth interface in the second display area after receiving the third data, wherein the sixth interface is the interface in the second application. In this way, after the external display device displays the two interfaces in a split screen, when a new message from the second application arrives, the terminal can, according to the user's needs, display the interface of the second application in the display area on the external display device that originally displayed the interface of the first application, so that the user can reply to new messages from multiple applications in a timely manner.

[0025] In one implementation, the terminal is further configured to, upon receiving a new message associated with a second application, send a second instruction to the external display device. The external display device is further configured to display a second notification message upon receiving the second instruction. The terminal is further configured to receive a second user input operation in response to the second notification message. The terminal is further configured to, in response to the second input operation, send fourth data to the external display device. The external display device is further configured to, upon receiving the fourth data, divide the display area of ​​the external display device into a third display area, a fourth display area, and a fifth display area, and display a seventh interface in the third display area, an eighth interface in the fourth display area, and a ninth interface in the fifth display area. The seventh interface has the same interface elements as the fourth interface, the eighth interface is an interface within the first application, and the ninth interface is an interface within the second application. In this way, after the external display device displays two interfaces in a split-screen display, if a new message from the second application arrives, the terminal can, based on the user's needs, split the screen on the external display device to display a reduced version of the first interface, the interface of the first application, and the interface of the second application, thereby facilitating timely responses to new messages from multiple applications.

[0026] In one implementation, the terminal is further configured to, when the first input operation for the first notification message is not received within a first time threshold, send a third instruction to the external display device. Upon receiving the third instruction, the external display device is further configured to hide the first notification message and display a first prompt prompting the user to view new messages from the first application on the terminal. In this way, when the user does not want to view the first notification message, the terminal hides the first notification message, thereby reducing obstruction of the first interface displayed on the external display device and improving the user experience.

[0027] In one implementation, the external display device is configured with a touch sensor. The terminal is further configured to receive a first user input operation in response to the notification message, specifically including: the terminal is further configured to receive the user's first touch operation in response to the notification message via the touch sensor of the external display device. In this way, when the external display device is a screen with a touch sensor, the terminal can receive the user's touch operation on the external display device to enable a split-screen display on the external display device, allowing the user to quickly view new messages from the first application.

[0028] In one implementation, the system further includes a keyboard connected to the terminal; the terminal is further configured to receive a first user input operation in response to the notification message, specifically including: the terminal is further configured to receive a first click operation in response to the first notification message via the mouse. In this way, the terminal can receive the user's click operation in response to the first notification message via the mouse to enable a split-screen display on the external display device, allowing the user to quickly view new messages from the first application.

[0029] In one implementation, the system also includes a mouse, which is connected to the terminal; the terminal is also used to receive a first input operation of the user for the notification message, specifically including: the terminal is also used to receive, through the mouse, a first sliding operation of the user operating the mouse pointer displayed on the external display device to slide in a first designated area on the external display device. The sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold. In this way, the terminal can receive a sliding operation of the user controlling the mouse pointer on the external display device through the mouse to turn on a split-screen display on the external display device, so that the user can quickly view new messages of the first application.

[0030] In one implementation, the system further includes a keyboard connected to the terminal; the terminal is further configured to receive a first user input operation in response to the notification message, specifically comprising: the terminal is further configured to receive, via the keyboard, a first press operation of one or more designated keys on the keyboard by the user. In this way, the terminal can receive the user's press operation of the designated keys via the keyboard to enable a split-screen display on the external display device, facilitating the user to quickly view new messages from the first application.

[0031] In one implementation, the terminal is further configured to receive a third input operation from the user. The terminal is further configured to send fifth data to the external display device in response to the third input operation. The external display device is further configured to display the first interface in full screen after receiving the fifth data. In this way, after the user has viewed the new message of the first application, the terminal can restore the full-screen display of the first interface on the external display device based on the user's needs, thereby improving the user experience.

[0032] In one implementation, the external display device is configured with the touch sensor; the terminal is further configured to receive a third input operation from the user, specifically comprising: the terminal receiving a second touch operation from the user through the touch sensor of the external display device.

[0033] or,

[0034] The system includes a mouse connected to the terminal; the terminal is further configured to receive a third input operation from the user, specifically comprising: receiving, by the terminal through the mouse, a second sliding operation in which the user operates a mouse pointer displayed on the external display device to slide over a second designated area on the external display device, wherein the sliding distance of the second sliding operation in the second designated area is greater than a second distance threshold, or the sliding time of the second sliding operation in the second designated area is greater than a second time threshold.

[0035] or,

[0036] The system includes the keyboard connected to the terminal; the terminal is further used to receive the user's third input operation, specifically including: the terminal receives the user's second pressing operation on one or more designated keys on the keyboard through the keyboard.

[0037] In this way, when the external display device is a screen with a touch sensor, the terminal can receive a user's touch operation on the external display device to activate split-screen display on the external display device; or receive a user's sliding operation of controlling a mouse pointer on the external display device to activate split-screen display on the external display device; or receive a user's pressing operation of a designated key on the keyboard to activate split-screen display on the external display device. This facilitates the user to quickly view new messages of the first application.

[0038] In one implementation, the first interface includes a video playback interface, a slide presentation interface, or a picture browsing interface. Alternatively, the second interface includes a main interface, wherein the main interface includes an icon of the first application.

[0039] In a third aspect, the present application provides a terminal comprising: a memory, a touch screen, a communication interface, one or more processors, and one or more programs; wherein the one or more programs are stored in the memory; the communication interface is used to communicate with an external display device and an external input device; when the processor runs the one or more programs, the terminal implements the message processing method in any possible implementation of the first aspect above.

[0040] In a fourth aspect, the present application provides a computer storage medium, comprising: computer instructions, which, when executed on a terminal, enable the terminal to implement the message processing method in any possible implementation of the first aspect.

[0041] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when running on a computer, enables the computer to execute the message processing method in any possible implementation of the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic diagram of an application scenario of a message processing method provided in an embodiment of the present application;

[0043] Figure 2A-2B A set of interface schematic diagrams provided for embodiments of the present application;

[0044] Figure 3 A schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0045] Figure 4 A schematic diagram of a software architecture provided in an embodiment of the present application;

[0046] Figure 5 A schematic diagram of an interface provided in an embodiment of the present application;

[0047] Figure 6 Another interface diagram provided in an embodiment of the present application;

[0048] Figure 7 Another interface diagram provided in an embodiment of the present application;

[0049] Figures 8A-8C A set of interface schematic diagrams provided for embodiments of the present application;

[0050] Figures 9A-9C A set of interface schematic diagrams provided for embodiments of the present application;

[0051] Figures 10A-10B A set of interface schematic diagrams provided for embodiments of the present application;

[0052] Figures 11A-11B A set of interface schematic diagrams provided for embodiments of the present application;

[0053] Figure 12 A flowchart of a message processing method provided in an embodiment of the present application;

[0054] Figure 13 A schematic diagram of a system architecture provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0056] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0057] The embodiment of the present application provides a message processing method, which can be applied to application scenarios such as mobile office where the display data in the terminal needs to be displayed on multiple display screens. For example, Figure 1 As shown, the terminal 100 can be a mobile phone, a tablet computer, a wearable device, an augmented reality (AR) or virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc., and the present embodiment of the application does not impose any restrictions on this. The external display device 200 in the embodiment of the present application can be any display device such as a PC monitor, a TV, a tablet computer, or a projector.

[0058] like Figure 1As shown, the terminal 100 can establish a wireless connection with the external display device 200 through wireless communication methods (for example, Wi-Fi, Bluetooth, etc.), and the terminal 100 can also establish a wireless connection with external devices (for example, a mouse, keyboard, etc.) through wireless communication methods (for example, Wi-Fi, Bluetooth, etc.).

[0059] Alternatively, the terminal 100 may establish a connection with the external display device 200 via a wired communication method (e.g., a data line), and the terminal 100 may also establish a connection with an external device (e.g., a mouse, a keyboard, etc.) via a wired communication method (e.g., a data line). The present application does not impose any restrictions on this.

[0060] In the embodiment of the present application, the terminal 100 can also use the switching device ( Figure 1 The external display device 200 is connected to the adapter device 200 (not shown). The adapter device can be plugged into the universal serial bus (USB) interface of the terminal 100 data cable, and the Type-C interface of the terminal data cable is plugged into the terminal 100. The adapter device can also be connected to the external display device 200 through an adapter cable, which can include any one of a high-definition multimedia interface (HDMI) cable, a video graphics array (AGI) cable, and a digital visual interface (DVI) cable.

[0061] Among them, the switching device in the embodiment of the present application can be a mobile high-definition link (MHL) device, which can simultaneously transmit the audio or video signal in the terminal 100 (such as a mobile phone) to the external display device 200 for display.

[0062] Among them, the terminal 100 can be used as a master device, and the external display device 200 can be used as a slave device of the terminal 100. After the terminal 100 and the external display device 200 are connected, the terminal 100 is equivalent to having two displays, one is the touch screen 300 of the terminal 100 itself, and the other is the display of the external display device 200 connected thereto.

[0063] After the terminal 100 establishes a connection with the external display device 200 , the terminal 100 may project the display content into the screen container of the external display device 200 through a same-source display or a different-source display, and display the content on the external display device 200 .

[0064] Among them, homologous display refers to different displays, for example, the signal source of the touch screen of the above-mentioned terminal 100 and the display interface in the external display device 200 are the same; while heterologous display refers to the signal source of the display interface in the touch screen of the above-mentioned terminal 100, which is independent of the signal source of the display interface in the external display device 200.

[0065] (1) Homologous display

[0066] When the terminal 100 projects the display content onto the display of the external display device, such as Figure 2A As shown, before the terminal 100 establishes a connection with the external display device 200, the terminal 100 stores the generated display content to be displayed in a specified location in the memory (the area storing the display content to be displayed on the screen is called a screen container in this application). In this way, the touch screen 300 of the terminal 100 can display the relevant screen by reading the display content in the screen container. After the terminal 100 establishes a connection with the external display device 200, Figure 2A As shown, the terminal 100 can send the display content in the screen container to the external display device 200, so that the external display device 200 displays the same display content as the terminal 100, thereby achieving synchronous display of the terminal 100 and the external display device 200.

[0067] (2) Heterogeneous display

[0068] When the terminal 100 projects its installed applications onto the display of the external display device 200 from a different source, such as Figure 2B As shown, before the terminal 100 establishes a connection with the external display device 200, the terminal 100 stores the generated display content 0 to be displayed in the screen container 0 in the memory. In this way, when the touch screen 300 of the terminal 100 reads the display content 0 in the screen container 0, the relevant display interface can be displayed on the touch screen 300 of the terminal 100. The terminal 100 stores the generated display content 1 to be displayed in the screen container 1 in the memory. In this way, when the external display device 200 reads the display content 1 in the screen container 1, the relevant display interface can be displayed on the external display device 200.

[0069] After the terminal 100 establishes a connection with the external display device 200, the terminal 100 can identify the relevant specification information of the display of the external display device 200 connected thereto, such as the resolution and dots per inch (DPI) of the display of the external display device 200. Figure 2B As shown, the terminal 100 can create an independent screen container for the external display device 200 in the memory according to the specification information of the display of the external display device 200, that is, Figure 2BScreen container 1 in the display, wherein screen container 1 and screen container 0 can be distinguished by different display identifiers (DisplayID) (for example, DisplayID: 0 can refer to the screen container of the touch screen 300 of the terminal 100, and DisplayID: 1 can refer to the screen container of the external display device 200).

[0070] Generally, for applications that support display on both the terminal 100 and the external display device 200, such applications generally store two display resources in the terminal 100, one display resource corresponding to the terminal 100, and the other display resource corresponding to the external display device 200. The same display content (such as the application icon) may have different layouts and display effects in different display resources.

[0071] Then, after the terminal 100 is connected to the external display device 200, Figure 2B As shown, the terminal 100 can read the display resources stored in the external display device 200 and store the application icons, icon layout, status bar and other desktop display content in the display resources in the screen container 1. In this way, after the terminal 100 sends the display content in the screen container 1 to the external display device 200, the icons and / or interfaces of each application installed on the terminal 100 can be independently projected onto the external display device 200. Subsequently, the terminal 100 and the external display device 200 can independently run two display interfaces under the same operating system based on the display content in their respective screen containers.

[0072] It should be noted that the above-mentioned screen container can specifically be a cache queue used to store the display content generated by each task in the task queue when the terminal 100 runs each task in the task queue. Generally, the task at the head of the task queue is the task currently being run by the terminal. The display content generated by the terminal when running this task can be stored at the head of the cache queue. The touch screen 300 of the terminal 100 or the external display device 200 always reads the display content at the head of the cache queue for display.

[0073] When the terminal 100 projects the display content onto the display of the external display device 200 from a different source, the terminal 100 can receive user input on the operation interface displayed on the external display device 200 through the connected external device (e.g., a mouse, keyboard, etc.). The terminal 100 can receive user touch input on the operation interface displayed on the terminal 100's own touch screen 300 through the terminal 100's own touch screen 300. Optionally, if the external display device 200 is also a touch screen 300, the terminal 100 can also receive user touch input on the operation interface displayed on the external display device 200 through the external display device 200.

[0074] Figure 3 A schematic structural diagram of the terminal 100 is shown.

[0075] The embodiment will be described in detail below using terminal 100 as an example. It should be understood that Figure 3 The terminal 100 shown is only an example, and the terminal 100 may have more Figure 3 More or fewer components may be shown, two or more components may be combined, or the components may be arranged differently. Figure 3 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0076] The terminal 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0077] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on terminal 100. In other embodiments of the present application, terminal 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0078] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0079] The controller may be the nerve center and command center of the terminal 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0080] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0081] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0082] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby implementing the touch function of the terminal 100.

[0083] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0084] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0085] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0086] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the terminal 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the terminal 100.

[0087] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0088] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the terminal 100, or to transfer data between the terminal 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect to other terminals, such as AR devices.

[0089] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative description and does not constitute a structural limitation on the terminal 100. In other embodiments of the present application, the terminal 100 may also adopt a different interface connection method from the above embodiment, or a combination of multiple interface connection methods.

[0090] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the terminal 100. While charging the battery 142, the charging management module 140 can also provide power to the terminal via the power management module 141.

[0091] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0092] The wireless communication function of the terminal 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0093] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0094] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on the terminal 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0095] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0096] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. applied on the terminal 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0097] In some embodiments, the antenna 1 of the terminal 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal 100 can communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0098] Terminal 100 implements display functions through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0099] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, terminal 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0100] The terminal 100 can realize the shooting function through the ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0101] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0102] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the terminal 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0103] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0104] Video codecs are used to compress or decompress digital video. Terminal 100 may support one or more video codecs. This allows terminal 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0105] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU enables intelligent cognitive applications in the terminal 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0106] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0107] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the terminal 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the terminal 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0108] The terminal 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0109] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0110] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The terminal 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0111] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the terminal 100 receives a call or voice message, the voice can be heard by placing the receiver 170B close to the ear.

[0112] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The terminal 100 can be provided with at least one microphone 170C. In other embodiments, the terminal 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the terminal 100 can also be provided with three, four or more microphones 170C to realize sound signal collection, noise reduction, and identification of sound sources, and realize directional recording function, etc.

[0113] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0114] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Terminal 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, terminal 100 detects the touch intensity based on pressure sensor 180A. Terminal 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.

[0115] The gyroscope sensor 180B can be used to determine the motion posture of the terminal 100. In some embodiments, the angular velocity of the terminal 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the terminal 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0116] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0117] The magnetic sensor 180D includes a Hall sensor. The terminal 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the terminal 100 is a flip phone, the terminal 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Furthermore, based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.

[0118] Accelerometer 180E can detect the magnitude of acceleration of terminal 100 in all directions (generally three axes). When terminal 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify terminal posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0119] The distance sensor 180F is used to measure distance. The terminal 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the terminal 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0120] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal 100 emits infrared light outward through the light emitting diode. The terminal 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal 100. When insufficient reflected light is detected, the terminal 100 can determine that there is no object near the terminal 100. The terminal 100 can use the proximity light sensor 180G to detect when the user holds the terminal 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0121] Ambient light sensor 180L is used to sense ambient light brightness. Terminal 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light brightness. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether terminal 100 is in a pocket to prevent accidental touches.

[0122] The fingerprint sensor 180H is used to collect fingerprints. The terminal 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0123] Temperature sensor 180J is used to detect temperature. In some embodiments, terminal 100 uses the temperature detected by temperature sensor 180J to implement a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, terminal 100 reduces the performance of a processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature falls below another threshold, terminal 100 heats battery 142 to prevent abnormal shutdown of terminal 100 due to low temperature. In other embodiments, when the temperature falls below yet another threshold, terminal 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0124] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the terminal 100, in a location different from that of the display screen 194.

[0125] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals from the vibrating bones of the human body. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulse signals. In some embodiments, the bone conduction sensor 180M can also be set in headphones to form bone conduction headphones. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bones of the human body obtained by the bone conduction sensor 180M to implement voice functions. The application processor can parse heart rate information based on the blood pressure pulse signals obtained by the bone conduction sensor 180M to implement heart rate detection functions.

[0126] Keys 190 include a power button, a volume button, etc. Keys 190 may be mechanical keys or touch keys. Terminal 100 may receive key inputs and generate key signal inputs related to user settings and function control of terminal 100.

[0127] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0128] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0129] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or removed from the terminal 100 by inserting it into or removing it from the SIM card interface 195. The terminal 100 can support one or N SIM card interfaces, where N is a positive integer greater than one. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The terminal 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the terminal 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal 100 and cannot be separated from the terminal 100.

[0130] Currently, when the terminal 100 turns on the PC mode and establishes a connection with the external display device 200, the terminal 100 can display two different interfaces on the touch screen of the terminal 100 and the external display device 200. For example, the terminal 100 can display a video playback interface (e.g., Figure 5 The terminal 100 may display a main interface (eg, Figure 5 Main interface 510 in).

[0131] When the terminal 100 displays two independent interfaces through the touch screen 300 of the terminal 100 and the external display device 200, the terminal 100 can play a video, present a slide show in full screen, or display a picture in full screen through the external display device 200. If there is a notification message pushed by the notification center on the terminal 100 (such as a notification of a new text message), the terminal 100 can display the notification message through the touch screen 300 of the terminal 100. When the user is watching the slide show in full screen on the external display device 200, if the user wants to view the notification message through the external display device 200, the user needs to exit the slide show that is currently being presented in full screen, and then open the notification center application displayed on the external display device 200 to see the complete notification message. After the user finishes viewing the notification message, the user needs to operate again to make the slide show play in full screen again. Such an operation process affects the user's experience of watching slides, videos, or pictures in full screen, especially when the terminal 100 has continuous message notifications (for example, the terminal 100 keeps receiving new text messages). If the user needs to view these messages on the external display device 200, it is necessary to constantly open or close the full-screen playback of the video, full-screen presentation of the slides, or full-screen display of the pictures on the external display device 200, which brings a bad experience to the user.

[0132] In order to solve the above problems, an embodiment of the present application provides a message processing method. If the external display device 200 presents a slide show in full screen or plays a video in full screen or displays a picture in full screen, when a message notification arrives on the terminal 100, the terminal 100 can display the message notification on the touch screen of the terminal 100 and display the prompt information of the external display device 200 on the external display device 200. When the terminal 100 receives the user's input operation on the interface displayed by the external display device 200 through an external device (for example, a mouse, keyboard, etc.), the external display device 200 can simultaneously display the interface displayed on the touch screen of the terminal 100 and the interface of the external display device 200 presenting a slide show or playing a video or displaying a picture in a split screen. The user can process the notification message (e.g., reply to a text message) on the external display device 200. After the user has processed the notification message, the terminal 100 can also receive another input operation from the user on the display interface of the external display device 200 through an external device (e.g., a mouse, keyboard). In response to the other input operation, the external display device 200 can display a full-screen interface of a presentation slide, a video playback interface, or a picture display interface. In this way, the user can simultaneously view the presentation slide, video playback interface, or picture display interface and the interface displayed on the touch screen of the terminal 100, making it convenient for the user to process the notification message directly on the external display device 200.

[0133] The following is an introduction to the software architecture diagram of the terminal 100 in the embodiment of the present application.

[0134] Figure 4 This is a software architecture block diagram of an embodiment of the present application. In some embodiments, the software architecture for display output under the Android system may include applications, a window management system, a display system, and a display output device.

[0135] like Figure 4 As shown, applications may include video, gallery, SMS and other applications. These applications may be displayed on the screen of terminal 100, or may be displayed on an external display device. For example, the interface of the SMS application may be displayed on the screen of terminal 100, and the interface of the gallery application or the display interface of the video application may be displayed on an external display device. Terminal 100 may output application task 0 (i.e., displaying the interface of the SMS application) to display device 0 (i.e., the screen of terminal 100), and terminal 100 may output application task 1 (i.e., displaying the interface of the gallery application) and application task 2 (i.e., displaying the interface of the video application) to display device 1 (i.e., the external display device).

[0136] Window management system: The interfaces of various applications are views or windows. Since there are multiple views superimposed, a window management system is needed to manage the addition, deletion, hierarchy, and animation of each window.

[0137] The display system renders the windows managed by the window management system in a hierarchical manner. Windows at the top have a higher display priority, and windows at the bottom may be covered. The rendered output destination is the terminal screen or the screen of the SMS application.

[0138] The display output device includes the screen of the terminal 100 and an external display device.

[0139] Generally, windows on different screens do not affect each other. For example, the display system can synthesize the display layer 0 of application task 0 into a frame buffer (FB) area 0, and output the display data (e.g., YUV data) of frame buffer 0 (which can refer to the above-mentioned screen container 0) to the terminal screen for display. The display system can synthesize the display layer 1 of application task 1 and the display layer 2 of application task 2 into a frame buffer 1 (which can refer to the above-mentioned screen container 1), and output the display data (e.g., YUV data) of frame buffer 1 to an external display device for display.

[0140] In the embodiment of the present application, in order to realize that the interface originally displayed on the external display device (such as the interface of application task 1 or the interface of application task 2) and the interface displayed on the screen of the terminal 100 (such as the interface of application task 0) can be displayed on the external display device at the same time, the display system has the following structure: Figure 4 As shown in the improvement Figure 4 As shown, the display system can perform necessary processing on the display data of display device 0 and the display data of display device 1. The display system can synthesize the display data of display device 0 and the display data of display device 1 after necessary processing into a layer to the frame buffer 1', and then synthesize the display data in the frame buffer 1' into a layer to the frame buffer 1. Then, the display system outputs the display data (such as YUV data) in the frame buffer 0 to the screen of the terminal 100 for display, that is, the interface of the SMS application is displayed on the screen of the terminal 100. The display system outputs the display data (such as YUV data) in the frame buffer 1 to the external display device for display, that is, the screen of the terminal 100 is split-screen to display the SMS application interface displayed on the screen of the terminal 100 and the interface of the gallery application (or the interface of the video application) originally displayed on the external display.

[0141] A split-screen display method provided by an embodiment of the present application will be described in detail below in conjunction with specific embodiments.

[0142] The terminal 100 is connected to the external display device 200. The terminal 100 can establish a communication connection with the external display 200 through a wireless communication method such as Bluetooth, WiFi, or ZigBee. The terminal 100 can also establish a communication connection with the external display 200 through a wired method (such as an HDMI cable), which is not limited in this embodiment of the present application.

[0143] The terminal 100 may be connected to an external input device (e.g., a mouse, keyboard). The terminal 100 may establish a communication connection with the external input device via wireless communication such as Bluetooth, WiFi, or ZigBee. The terminal 100 may also establish a communication connection with the external input device via wired communication, which is not limited in this embodiment of the present application.

[0144] After the terminal 100 establishes a connection with the external display 200, the terminal 100 can display the first main interface on the touch screen 300 and the second main interface on the external display device 200. The first main interface and the second main interface are different. The terminal 100 can receive user input operations on the first main interface through the touch screen, and the terminal 100 can receive input operations on the second main interface through an external input device (such as a mouse, keyboard, etc.).

[0145] For example, Figure 5 As shown, after the terminal 100 establishes a connection with the external display device 200, the terminal 100 can display the main interface 510 through the touch screen 300. Among them, the main interface 510 displays a page with application icons, which may include one or more application icons (such as weather application icon, stock application icon, calculator application icon, settings application icon, email application icon, browser application icon, gallery application icon, music application icon, video application icon, application store icon, etc.), and a page indicator is also included below the multiple application icons to indicate the position relationship between the currently displayed page and other pages. There are multiple tray icons (such as dial application icon, SMS application icon, contact application icon, camera application icon) below the page indicator. The tray application icon remains displayed when the page is switched. A page may include multiple application icons and page indicators. The page indicator may not be part of the page and exist separately.

[0146] like Figure 5As shown, after the terminal 100 establishes a connection with the external display device 200, the terminal 100 can display a main interface 520 through the external display device 200. The main interface 520 displays multiple application icons (such as a video application icon 521, a music application icon, a gallery application icon, an email application icon, an application store icon, a slide application icon, etc.). The main interface 520 also includes a taskbar 522, which can include shortcuts to one or more applications (such as a shortcut to a WeChat application, a shortcut to a voice assistant application, a shortcut to a word application, a shortcut to an excel application, etc.), a status bar (including a volume adjustment icon, a Wi-Fi signal icon, and time), etc.

[0147] The main interface 520 displayed on the external display device 200 is similar to an operating interface of the Windows system. A mouse pointer 523 may be displayed on the external display device 200, and the mouse pointer 523 may be displayed above all interfaces displayed on the external display device 200. The terminal 100 can receive user input operations through the external mouse, such as left-clicking, left-double-clicking, right-clicking, right-double-clicking, sliding, and dragging operations of the mouse pointer 523 on the external display device 200.

[0148] The terminal 100 can receive user input through an external input device (such as a mouse, a keyboard) to play a video or a full-screen presentation slide or a full-screen display image on the external display device 200 .

[0149] For example, Figure 6 As shown, the terminal 100 can receive the user's input operation 611 on the video application icon 521 on the external display device 200 through the mouse, wherein the input operation 611 can be the user operating the mouse, controlling the mouse pointer 523 to move to the video application icon 521, and double-clicking the video application icon 521 with the left key. In response to the input operation 611, the terminal 100 can display the video application icon 521 on the external display device 200 as shown in FIG. Figure 7 The video playback interface 530 shown. In one implementation, in response to the input operation 611, the terminal 100 may first display an interface of a video application, which may include one or more full-screen play buttons for videos. Then, the terminal 100 may receive the user's input operation for the full-screen play button through an external input device (such as a mouse). For example, the input operation for the full-screen play button may be that the user operates the mouse to move the mouse pointer to the full-screen play button and left-clicks the full-screen play button. In response to the input operation for the full-screen play button, the terminal 100 may display the following through the external display device 200: Figure 7 The video playback interface 530 is shown.

[0150] like Figure 7 As shown, the terminal 100 displays a video playback interface 530 in full screen through the external display device 200. Among them, the video playback interface 530 may include a play / pause button 531, a playback progress bar 532, a playback progress time 533, a total video time 534 and a playback screen 539. Among them, the play / pause button 531 can be used to receive user input to control the playback and pause of the video. The terminal 100 can also display a mouse pointer 523 through the external display device 200. Among them, if the terminal 100 does not receive the user's input operation for the mouse within a period of time (for example, 10 seconds), the mouse pointer 523 can disappear. In this way, the mouse pointer 523 can be avoided from blocking the video playback interface 530 for a long time, thereby improving the user experience.

[0151] After the mouse pointer 523 disappears, if the terminal 100 receives a user input operation (e.g., sliding the mouse) via the mouse, the mouse pointer 523 may be displayed again on the video playback interface 530. The main interface 510 may still be displayed on the touch screen 300 of the terminal 100. In one implementation, the touch screen 300 of the terminal 100 may also turn off after receiving no user input operation for a period of time (e.g., 30 seconds) to save power.

[0152] When the terminal 100 receives a new message (such as a text message or a WeChat message), the terminal 100 may display a first notification (such as a text message or a WeChat message) on the touch screen 300. Figure 8A The first notification is used to prompt the user on the touch screen 300 that the application has a push message to be viewed. The terminal 100 can display the second notification (e.g. Figure 8A Aggregated notification message 535), the second notification is used to prompt the user on the external display device 200 that there is an application push message to be viewed.

[0153] Specifically, after receiving the new message, terminal 100 may store the display content related to the first notification in screen container 0 corresponding to touch screen 300. After reading the display content related to the first notification in screen container 0, touch screen 300 may display the first notification. After receiving the new message, terminal 100 may also store the display content related to the second notification in screen container 1 corresponding to external display device 200. After reading the display content related to the second notification in screen container 1, external display device 200 may display the second notification.

[0154] The terminal 100 may receive the user's input operation for the second notification through the mouse, and in response to the input operation, the terminal 100 may display the detailed interface of the application push message on the touch screen 300 (for example, Figure 8B In addition, the terminal 100 can divide the display area of ​​the external display device 200 into two parts (including a first display area and a second display area). The terminal 100 can also display the details interface of the application push message in the first display area (for example, Figure 8B The second display area may be used to display the full-screen interface (e.g., the SMS chat interface 820 in the external display device 200) and the interface originally displayed full-screen on the external display device 200 (e.g., the full-screen video playback interface, the full-screen slide presentation interface, or the full-screen image display interface) in a reduced scale. This allows the user to view the contents displayed on two screens simultaneously on the external display device 200, facilitating user operation.

[0155] For example, Figure 8A As shown, the terminal 100 receives a text message sent by a contact (e.g., "Uncle"), and the terminal 100 can display a notification message 518 of the text message on the touch screen 300. The notification message 518 can be displayed at the top of the touch screen 300. The notification message 518 can be all or part of the content of the new text message, and can include the sender of the text message (e.g., "Uncle"), the content of the text message (e.g., "Xiao Ming, come to my house for dinner at 18:00 tonight. Your aunt has made a lot of delicious food!") and the application that pushed the notification message 518 (i.e., the text message application). In some embodiments, the notification message 518 can disappear after a period of time (e.g., after 5 seconds). After the terminal 100 receives the text message sent by the contact, if the user does not open the text message application to view the text message, the terminal 100 can display a mark 511 on the icon of the text message application to remind the user that there is an unread text message.

[0156] like Figure 8A As shown, when the notification message 518 of the short message is displayed on the touch screen 300 of the terminal 100, the terminal 100 can also display the following information through the external display device 200: Figure 8A The terminal 100 can receive the user's input operation 841 through the mouse, wherein the input operation 841 can be the mouse pointer 523 left-clicking the notification message 535. In response to the input operation 841, the terminal 100 can open the SMS application and display the following information through its own touch screen 300: Figure 8B The SMS chat interface 810 is shown, and the external display device 200 is split-screen displayed as shown. Figure 8B The text message chat interface 820 and the video playback interface 830 are shown.

[0157] In some embodiments, if the terminal 100 does not receive any user input operation on the notification message 535 within a period of time (e.g., within 30 seconds), the notification message 535 may disappear from the external display device 200. In some embodiments, a notification close control 536 may be displayed on the notification message 535, and the notification close control 536 may receive a user input operation (e.g., left-clicking the notification close control 536 with a mouse). In response to the input operation, the terminal 100 may not display the notification message 535 on the external display device 200. In this way, the notification message 535 is prevented from blocking the full-screen interface on the external display device 200 for a long time, thereby improving the user's viewing experience.

[0158] like Figure 8B As shown, the SMS chat interface 810 may include an add control 811, a text input box 812, an emoticon control 813, a send control 814, an SMS chat box 815, a return control 816, contact information 817, a dial control 818, and a more control 819. The add control 811 may be used to receive user input and add pictures, voice, videos, etc. to the SMS to be sent. The text input box 812 may be used to display the text information entered by the user. The send control 814 may be used to receive user input to send the SMS. The SMS chat box 815 may be used to display the content of the received or sent SMS. The return control 816 may be used to receive user input to return to the previous interface. The contact information 817 may include the contact's nickname and mobile phone number. The dial control 818 may be used to receive user input to call a contact (e.g., "Uncle"). The more control 819 may be used to receive user input to display more functions (e.g., deleting the SMS, creating a new contact, saving to an existing contact, editing before calling, saving to a blacklist, etc.).

[0159] like Figure 8B As shown, the terminal 100 can display the above Figure 8A The video playback interface 530 in the video playback interface 830 is reduced to be displayed in the right part of the display area of ​​the external display device 200, and the SMS chat interface 810 displayed on the touch screen 300 is adjusted in proportion and displayed in the left part of the display area of ​​the external display device 200. Among them, the SMS chat interface 810 has the same interface elements as the SMS chat interface 820, except that the proportions are changed. The SMS chat interface 820 may include an add control 821, a text input box 822, an emoticon control 823, a send control 824, an SMS chat box 825, a return control 826, contact information 827, a dialing control 828, and more controls 829. Therefore, the above-mentioned text description of the SMS chat interface 810 is also applicable to the SMS chat interface 820 and will not be repeated here. The video playback interface 830 is the above-mentioned Figure 8A The video playback interface 830 is a scaled-down interface of the video playback interface 530 in FIG. The video playback interface 830 includes the same interface elements as the video playback interface 530. Therefore, for the text description of the video playback interface 830, reference can be made to the text description of the video playback interface 530 in the above embodiment, which will not be repeated here.

[0160] The terminal 100 can receive the user's input operation through an external input device (such as a mouse or keyboard) and reply to the message in the SMS chat interface 820 displayed on the external display device 200. For example, Figure 8B As shown, the terminal 100 can receive the user's input operation 843 through the keyboard. The input operation 843 can be the user entering text information in the text input box 822 (for example, "Okay! I will definitely come on time!"). The terminal 100 can display the text information in the text input box 822 through the external display device 200, and also display the text information in the text input box 812 through the touch screen 300. The terminal 100 can also receive the user's input operation 842 through the mouse. The input operation 842 can be the user operating the mouse to control the mouse pointer 523 to left-click the send control 824. In response to the input operation 842, the terminal 100 can send the text information in the text input box 822 (that is, the text information in the text input box 812) to the contact (for example, "Uncle").

[0161] In some embodiments, if the terminal does not receive the user's response within a period of time (e.g., 3 seconds, 10 seconds, etc.), Figure 8A If the input operation of the notification message 535 displayed on the external display device 200 is performed, the terminal can hide the notification message 535 and display the notification message 535 on the external display device 200 as shown in FIG. Figure 8C The prompt information 851 shown (for example, a text prompt “You have a new text message, please check it on your mobile phone”) is used to prompt the user to check the new text message on the terminal 100 (mobile phone).

[0162] In some embodiments, not limited to the above Figure 8A In the input operation 841 for the notification message 535, the terminal 100 may also receive other input operations of the user to display the split screen on the external display device 200 as follows: Figure 8B For example, the terminal 100 can receive a user input operation through the keyboard (for example, pressing the key "F12" or pressing the combination key "Ctrl" + "Alt" + "P", etc.), and in response to the input operation, the terminal 100 can display the video in a split screen through the external display device 200. Figure 8B The text message chat interface 820 and the video playback interface 830 are shown.

[0163] In some embodiments, after the terminal 100 displays the video playback interface 530 in full screen through the external display device 200, the terminal 100 can receive a user's sliding operation through the mouse (for example, the mouse pointer 523 slides at the left edge of the external display device 200 for a time greater than the first time threshold T1). In response to the sliding operation, the terminal 100 can display the display content on the touch screen 300 through the first display area of ​​the external display device 200, and display the video playback interface 530 originally displayed in full screen on the external display device 200 in a reduced scale in the second display area of ​​the external display device 200. In this way, the user can use an external input device (such as a mouse, keyboard, etc.) to simultaneously operate the display content on the touch screen 300 and the display content displayed on the external display device 200 before the split screen, thereby simplifying the user's operation.

[0164] For example, Figure 9A As shown, the terminal 100 displays the video playback interface 530 in full screen through the external display device 200. The terminal 100 displays the main interface 510 through the touch screen 300. When the terminal 100 receives a text message sent by a contact (such as "uncle"), the terminal 100 can display a notification message 518 of the text message on the touch screen 300, and the terminal 100 can also display a notification message 535 of the text message on the external display device 200. Among them, the text description of the video playback interface 530 can refer to the above Figure 7 In the embodiment shown, the text description of the main interface 510, notification message 518 and notification message 535 can refer to the above Figure 8A The illustrated embodiment will not be described in detail here.

[0165] The terminal 100 may receive a user input operation 941 via a mouse, wherein the input operation 941 may be a user operating a mouse pointer 523 to stay at a designated area 537 of the external display device 200 for a time period greater than a first time threshold T1 (e.g., 1.5 seconds). In response to the input operation 941, the terminal 100 may display the external display device 200 in a split-screen manner. Figure 9B The main interface 920 and the video playback interface 930 are shown. Figure 9A As shown, the designated area 537 may be the display area at the left edge of the external display device 200, or the display area at the top edge of the external display device 200, which is not limited here. In some embodiments, the input operation 941 may also be the user operating the mouse pointer 523 to slide within the designated area 537 of the external display device 200, with the displacement being greater than the first distance threshold L1 (e.g., 10 cm), wherein the starting position of the sliding of the mouse pointer 523 may be as follows: Figure 9A Position 538 shown.

[0166] like Figure 9B As shown, the terminal 100 can display the main interface 920 in the left display area of ​​the external display device 200 and the main interface 930 in the right display area. The external display device 200 also displays a notification message 928 on the main interface 920. Among them, the notification message 928 is different from the notification message 518 only in terms of scale. Among them, the interface elements of the main interface 920 displayed on the external display device 200 are the same as the interface elements of the main interface 510 displayed on the touch screen 300 of the terminal 100, except that the display scale is different. Since the interface elements are the same, that is, the text description for the main interface 510 is also applicable to the main interface 920. For the text description of the main interface 920, reference can be made to the main interface 510, and no further details will be given here.

[0167] like Figure 9B As shown, the terminal 100 can receive the user's input operation 942 for the SMS application icon 511 through the mouse (for example, the left button of the mouse clicks the SMS application icon 511), and in response to the input operation 942, the terminal 100 can display the SMS application icon 511 through the external display device 200 in a split screen manner. Figure 9C The interface 960 of the SMS application and the video playback interface 930 are shown. The SMS application interface 960 may include a search box 961, one or more information entries (including an information entry 962 for the contact "Uncle"), a shortcut menu 963, and the like. The search box 961 may be used to receive user input to search for information entries. The shortcut menu 963 includes a new message control and more controls. The new message control is used to receive user input to create a new SMS chat window, and the more control is used to receive user input to display more functional controls (such as a delete message control, a favorites control, a harassment blocking control, a read all control, a settings control, etc.). Optionally, in response to the input operation 942, the terminal 100 may also display the SMS application interface 950 through the touch screen 300. The SMS application interface 950 includes a search box 951, one or more information entries, a shortcut menu 963, and the like. The SMS application interface 950 has the same interface elements as the SMS application interface 960 displayed on the external display device 200, but the display scale is different. Therefore, the text description of the SMS application interface 950 can refer to the text description of the SMS application interface 960, which will not be repeated here.

[0168] The terminal 100 may receive an input operation 943 of the user for the information item 962 of the contact "uncle" through the mouse (for example, left-clicking the information item 962). In response to the input operation 962, the terminal 100 may display the information item 962 of the contact "uncle" through the external display device 200 in a split-screen manner. Figure 8BThe text chat interface 820 and the video playback interface 830 are shown. The video playback interface 830 is the same as the video playback interface 930, and the text description of the video playback interface 830 is also applicable to the video playback interface 930. Optionally, in response to the input operation 943, the terminal 100 can also display the following information through the touch screen 300: Figure 8B The text message chat interface 810 is shown.

[0169] In some embodiments, the terminal 100 can receive the user's response to the following Figure 9B In response to the input operation for the notification message 928, the terminal 100 can display the notification message 928 in a split screen manner through the external display device 200. Figure 8B The text chat interface 820 and the video playback interface 830 shown in FIG. The video playback interface 830 has the same interface elements as the video playback interface 930. In some embodiments, in response to the input operation 942, the terminal 100 can also display the following information through the touch screen 300: Figure 8A The text message chat interface 816 is shown. In this way, the user can directly control the mouse to click the notification message 928 to enter the text message chat interface 820 and reply to the contact's text message, which simplifies the user's message reply operation steps.

[0170] After the external display device 200 displays the SMS chat interface 820 and the video playback interface 830 in split screen, the terminal 100 can also receive the user's input operation through an external input device (such as a mouse, keyboard, etc.) (for example, the time when the mouse pointer 523 slides at the left edge of the external display device 200 is greater than the second time threshold T2, for example, the user presses the key "F12" on the keyboard, or for example, the user presses the combination key "Ctrl" + "Alt" + "P" on the keyboard, etc.), and in response to the input operation, the terminal 100 can turn off the split screen display function. That is, the terminal 100 displays the video playback interface (such as Ctrl + Alt + P) in full screen through the external display device 200. Figure 10B The video playback interface 1030 is shown).

[0171] For example, Figure 10A As shown, the terminal 100 can display the SMS chat interface 820 and the video playback interface 830 in split screen through the external display device 200. The text description of the SMS chat interface 820 and the video playback interface 830 can refer to the above Figure 8A Optionally, the terminal 100 may further display a text chat interface 810 via the touch screen 300 , wherein the text chat interface 810 has the same interface elements as the text chat interface 820 .

[0172] The terminal 100 may receive a user input operation 1041 via a mouse, wherein the input operation 1041 may be a user operating a mouse pointer 523 to stay in a designated area 1027 of the external display device 200 for a time period greater than a first time threshold T1 (e.g., 1.5 seconds). In response to the input operation 1041, the terminal 100 closes the split-screen display via the external display device 200 and displays the full-screen display as shown below. Figure 10B The video playback interface 1030 is shown.

[0173] The designated area 1027 may be the display area at the left edge of the external display device 200, and the designated area 1037 may also be the display area at the top edge of the external display device 200, which is not limited here. In some embodiments, the input operation 1041 may also be the user operating the mouse pointer 523 to slide within the designated area 1037 of the external display device 200, with the displacement being greater than the first distance threshold L1 (e.g., 10 cm), wherein the starting position of the sliding of the mouse pointer 523 may be as follows: Figure 10A Position 1028 shown.

[0174] like Figure 10B As shown, the terminal 100 can display the video playback interface 1030 in full screen through the external display device 200, wherein the video playback interface 1030 includes a play / pause button 1031, a playback progress bar 1032, a playback progress time 1033, a total video time 1034 and a playback screen 1035. Optionally, the terminal 100 can display the SMS chat interface 810 through the touch screen 300, wherein the text description of the SMS chat interface 810 can refer to the above Figure 8A The embodiments shown will not be described in detail here.

[0175] In some embodiments, the triggering operation of the terminal 100 to close the split-screen display function on the external display device 200 is not limited to the above Figure 10A The input operation 1041 shown can also be that the user drags the dividing line of the two interfaces of the split screen display by sliding the mouse. When the sliding distance of the dragging dividing line is greater than the second distance threshold L2, the terminal 100 can turn off the function of split screen display on the external display device 200, that is, the terminal 100 displays the video playback interface (for example, the video playback interface) in full screen on the external display device 200. Figure 10B ). The video playback interface 1030 shown in FIG.

[0176] For example, Figure 11A As shown, the terminal 100 can display the SMS chat interface 820 and the video playback interface 830 in split screen through the external display device 200. The text description of the SMS chat interface 820 and the video playback interface 830 can refer to the above Figure 8AOptionally, the terminal 100 may further display a text chat interface 810 via the touch screen 300 , wherein the text chat interface 810 has the same interface elements as the text chat interface 820 .

[0177] The terminal 100 can receive the user's input operation 1141 by using a mouse, wherein the input operation 1141 can be that the user operates the mouse pointer 1123 of the mouse to move to the position of the dividing line 1124, and long-presses the left button of the mouse to drag the dividing line 1124 to the left, so that the displacement of the dividing line 1124 is greater than the second distance threshold L2 (for example, 20 cm). The direction of dragging the dividing line 1124 may not be a strict left direction, for example, it may be to the upper left or to the lower left, which is not limited here. The dividing line 1124 is at the junction of the SMS chat interface 820 and the video playback interface 830. The mouse pointer 1123 is the same mouse pointer as the mouse pointer 523 in the aforementioned embodiment, except that when the mouse pointer 523 moves to the dividing line 1124, the mouse pointer 523 can change shape, and the mouse pointer after changing shape can be as shown in the figure. Figure 11A The mouse pointer in 1123.

[0178] In some embodiments, the input operation 1141 may also be the user operating a mouse pointer 1123 to move to the position of the dividing line 1124, and then pressing and holding the left button of the mouse to drag the dividing line 1124 to the left, so that the distance between the dividing line 1124 and the left edge of the screen is less than a third distance threshold L3 (e.g., 3 cm). During the process of dragging the dividing line 1124, the size of the display area occupied by the SMS chat interface 820 on the external display device 200 and the size of the display area occupied by the video playback interface 830 on the external display device 200 will change.

[0179] For example, Figure 11B As shown, when the dividing line 1124 is dragged to the left, the display area occupied by the SMS chat interface 820 on the external display device 200 will decrease, and the display area occupied by the video playback interface 830 on the external display device 200 will increase. When the displacement of the dividing line 1124 from the starting position 1125 is greater than the second distance threshold L2 (for example, 20 cm), the terminal 100 displays the full screen as shown in FIG. Figure 10B The video playback interface 1030 is shown.

[0180] See Figure 12 , Figure 12 A flow chart of a message processing method provided by an embodiment of the present application is shown. Figure 12 As shown, the method includes:

[0181] After the terminal establishes a connection with the external display device:

[0182] The terminal displays the second interface.

[0183] For example, the second interface may be as follows: Figure 5 or Figure 6 The main interface 510 shown in FIG. Figure 5 、 Figure 6 The embodiments shown will not be described in detail here.

[0184] S1201: The terminal sends first data to an external display device. S1202: The external display device displays a first interface in full screen based on the received first data, wherein the first interface is different from the second interface.

[0185] The first data includes display data of the first interface and instruction data for full-screen display. For example, the first interface can be as follows: Figure 7 The video playback interface 530 is shown.

[0186] S1203: The terminal receives a new message from the first application.

[0187] For example, the new message of the first application may be a new message of the SMS application. Figure 8A As shown, the new message of the SMS application can be a notification message 518. Not limited to this, the new message of the first application can also be a new message of the WeChat application, a new message of the QQ application, etc.

[0188] S1204: The terminal sends a first instruction to the external display device. S1205: The external display device receives the first instruction and displays the first notification message.

[0189] The first instruction is used to instruct the external display device to display the first notification message. The first notification message can be as follows: Figure 8A The notification message 535 shown is not limited thereto, and the first notification message may also be a voice notification or a mechanical vibration notification.

[0190] S1206. The terminal receives a first input operation from the user in response to the first notification message.

[0191] Exemplarily, the first input operation may be as follows: Figure 8A The input operation 841 shown can also be as follows Figure 9A Operation 941 etc. shown in FIG. Figure 8A and Figure 9A The embodiments shown will not be described in detail here.

[0192] S1207 : The terminal displays the third interface through the touch screen, and S1208 : The terminal sends the second data to the external display device.

[0193] The second data may include display data of the fourth interface, display data of the fifth interface, and split screen instruction data. For example, the third interface may be as follows: Figure 8B The SMS chat interface 810 shown is specifically referred to the aforementioned Figure 8B The embodiments shown will not be described in detail here.

[0194] S1209. After receiving the second data, the external display device divides the display area of ​​the external display device into a first display area and a second display area, and displays a fourth interface in the first display area and a fifth interface in the second display area. The fourth interface is a scaled-down version of the first interface, and has the same interface elements; the interface elements in the fifth interface are the same as those in the third interface.

[0195] For example, the fourth interface displayed on the first display area may be as follows: Figure 8B The video playback interface 830 shown. The fifth interface displayed on the second display area can be as follows Figure 8B The text message chat interface 820 is shown.

[0196] In this way, when the terminal uses an external display device to display the first interface in full screen, if the terminal receives a new message from the first application, it can display the reduced interface of the first interface and the interface in the first application in split screen on the external display device according to user needs. This can facilitate users to operate multiple display interfaces at the same time on the external display device, and facilitate users to view new messages of the first application.

[0197] In one implementation, after the external display device displays the fourth interface in the first display area and the fifth interface in the second display area, the method further includes: first, when the terminal receives a new message from the second application, the terminal sends a second instruction to the external display device. Then, after receiving the second instruction, the external display device displays the second notification information. Then, the terminal receives the user's second input operation for the second notification information. In response to the second input operation, the terminal sends third data to the external display device. Then, after receiving the third data, the external display device displays the fourth interface in the first display area and the sixth interface in the second display area, wherein the sixth interface is the interface in the second application. In this way, after the external display device displays the two interfaces in a split screen, when a new message from the second application arrives, the terminal can, according to the user's needs, display the interface of the second application in the display area that originally displayed the interface of the first application on the external display device, so that the user can reply to new messages from multiple applications in a timely manner.

[0198] In one implementation, after the external display device displays the fourth interface in the first display area and the fifth interface in the second display area, the method further includes: first, when the terminal receives a new message from the second application, the terminal sends a second instruction to the external display device. Then, after receiving the second instruction, the external display device displays the second notification information. Then, the terminal receives the user's second input operation for the second notification information. In response to the second input operation, the terminal sends fourth data to the external display device. Then, after receiving the fourth data, the external display device divides the display area of ​​the external display device into a third display area, a fourth display area, and a fifth display area, and displays the seventh interface in the third display area, the eighth interface in the fourth display area, and the ninth interface in the fifth display area. Among them, the seventh interface has the same interface elements as the fourth interface, the eighth interface is the interface in the first application, and the ninth interface is the interface in the second application. In this way, after the external display device displays two interfaces in split screen, when a new message from the second application arrives, the terminal can, according to the user's needs, display the reduced interface of the first interface, the interface of the first application, and the interface of the second application in split screen on the external display device, which can facilitate users to reply to new messages from multiple applications in a timely manner.

[0199] In one implementation, after the external display device displays the first notification message, the method further includes: when the terminal does not receive the first input operation for the first notification message within a first time threshold, the terminal sends a third instruction to the external display device. After receiving the third instruction, the external display device hides the first notification message and displays a first prompt prompting the user to view new messages of the first application on the terminal. In this way, when the user does not want to view the first notification message, the terminal hides the first notification message, thereby reducing obstruction of the first interface displayed on the external display device and improving the user experience.

[0200] For example, the first time threshold may be 3 seconds, 5 seconds, 10 seconds, etc., which are not limited here. The first prompt may be as follows: Figure 8C The prompt information 851 shown can be referred to the above Figure 8C The embodiments shown are not described in detail here.

[0201] In one implementation, the external display device is configured with a touch sensor; and the terminal receives a first user input operation in response to the notification message, specifically including: the terminal receives the first user touch operation in response to the notification message via the touch sensor of the external display device. Thus, when the external display device is a screen with a touch sensor, the terminal can receive the user's touch operation on the external display device to enable a split-screen display on the external display device, allowing the user to quickly view new messages from the first application.

[0202] In one implementation, the terminal is connected to a mouse; the terminal receives a first input operation of the user for the notification message, specifically including: the terminal receives a first click operation of the user for the first notification message via the mouse. In this way, the terminal can receive a click operation of the user for the first notification message via the mouse to open a split-screen display on an external display device, so that the user can quickly view the new message of the first application. For example, the first click operation can be the above Figure 8A The input operation 841 in the embodiment may be referred to in detail and will not be described in detail here.

[0203] In one implementation, the terminal is connected to a mouse; the terminal receives a first input operation of the user for the notification message, specifically including: the terminal receives, through the mouse, a first sliding operation of the user operating the mouse pointer displayed on the external display device to slide on a first designated area on the external display device; wherein the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold. In this way, the terminal can receive, through the mouse, a sliding operation of the user controlling the mouse pointer on the external display device to turn on a split-screen display on the external display device, so that the user can quickly view new messages of the first application. Exemplarily, the first sliding operation can be the above-mentioned Figure 9A The input operation 941 in the above can be referred to for details. Figure 9A The embodiments shown will not be described in detail here.

[0204] In one implementation, the terminal is connected to a keyboard; the terminal receives a first user input operation in response to the notification message, specifically including: the terminal receives, via the keyboard, a first press operation of one or more designated keys on the keyboard by the user. In this way, the terminal can receive the user's press operation of the designated keys via the keyboard to enable a split-screen display on the external display device, facilitating the user to quickly view new messages from the first application.

[0205] In one implementation, the method further includes: the terminal receiving a third input operation from the user. In response to the third input operation, the terminal sending fifth data to the external display device. After receiving the fifth data, the external display device displays the first interface in full screen. In this way, after the user views the new message of the first application, the terminal can restore the full-screen display of the first interface on the external display device according to the user's needs, thereby improving the user experience.

[0206] In one implementation, the external display device is configured with the touch sensor; the terminal receiving the third input operation of the user specifically includes: the terminal receiving the second touch operation of the user through the touch sensor of the external display device. Or,

[0207] The terminal is connected to a mouse, and the terminal receives a third input operation from the user, specifically including: the terminal receives, through the mouse, a second sliding operation in which the user operates the mouse pointer displayed on the external display device to slide on a second designated area on the external display device. The sliding distance of the second sliding operation on the second designated area is greater than a second distance threshold, or the sliding time of the second sliding operation on the second designated area is greater than a second time threshold. Or,

[0208] The terminal is connected to a keyboard, and the terminal receives a third input operation from the user, specifically including: the terminal receives, through the keyboard, a second pressing operation of the user on one or more designated keys on the keyboard.

[0209] In this way, when the external display device is a screen with a touch sensor, the terminal can receive a user's touch operation on the external display device to activate split-screen display on the external display device; or receive a user's sliding operation of controlling a mouse pointer on the external display device to activate split-screen display on the external display device; or receive a user's pressing operation of a designated key on the keyboard to activate split-screen display on the external display device. This facilitates the user to quickly view new messages of the first application.

[0210] For example, the second sliding operation can refer to the aforementioned Figure 10A The input operation 1041 shown in FIG. Figure 10A The embodiments shown will not be described in detail here.

[0211] In one implementation, the first interface includes a video playback interface, a slide presentation interface, or a picture browsing interface; or the second interface includes a main interface (eg Figure 5 The main interface 510 shown in FIG, wherein the main interface includes an icon of the first application (eg, an icon of a text message application).

[0212] See Figure 13 , Figure 13 FIG3 shows a schematic diagram of the architecture of a system provided by an embodiment of the present application, wherein the system 1300 includes a terminal 100 and an external display device 200. The terminal 100 and the external display device 200 are connected wirelessly or by wire.

[0213] The terminal is configured to send first data to the external display device. The external display device is configured to display a first interface in full screen based on the received first data; wherein a second interface is displayed on the touch screen of the terminal, and the first interface is different from the second interface. The terminal is further configured to send a first instruction to the external display device upon receiving a new message from the first application. The external display device is further configured to display a first notification message after receiving the first instruction. The terminal is further configured to display a third interface via the touch screen upon receiving a first user input operation in response to the first notification message, and to send second data to the external display device. The third interface is an interface within the first application. The external display device is further configured to divide a display area of ​​the external display device into a first display area and a second display area upon receiving the second data, and to display a fourth interface in the first display area and a fifth interface in the second display area. The fourth interface is a scaled-down version of the first interface, and has the same interface elements. The interface elements in the fifth interface are the same as those in the third interface.

[0214] In this way, when the terminal uses an external display device to display the first interface in full screen, if the terminal receives a new message from the first application, it can display the reduced interface of the first interface and the interface in the first application in split screen on the external display device according to user needs. This can facilitate users to operate multiple display interfaces at the same time on the external display device, and facilitate users to view new messages of the first application.

[0215] In one implementation, the terminal is further used to send a second instruction to the external display device when a new message from the second application is received. The external display device is further used to display a second notification message after receiving the second instruction. The terminal is also used to receive a second input operation from the user for the second notification message. The terminal is also used to send third data to the external display device in response to the second input operation. The external display device is also used to display the fourth interface in the first display area and the sixth interface in the second display area after receiving the third data, wherein the sixth interface is the interface in the second application. In this way, after the external display device displays the two interfaces in a split screen, when a new message from the second application arrives, the terminal can, according to the user's needs, display the interface of the second application in the display area on the external display device that originally displayed the interface of the first application, so that the user can reply to new messages from multiple applications in a timely manner.

[0216] In one implementation, the terminal is further configured to, upon receiving a new message associated with a second application, send a second instruction to the external display device. The external display device is further configured to display a second notification message upon receiving the second instruction. The terminal is further configured to receive a second user input operation in response to the second notification message. The terminal is further configured to, in response to the second input operation, send fourth data to the external display device. The external display device is further configured to, upon receiving the fourth data, divide the display area of ​​the external display device into a third display area, a fourth display area, and a fifth display area, and display a seventh interface in the third display area, an eighth interface in the fourth display area, and a ninth interface in the fifth display area. The seventh interface has the same interface elements as the fourth interface, the eighth interface is an interface within the first application, and the ninth interface is an interface within the second application. In this way, after the external display device displays two interfaces in a split-screen display, if a new message from the second application arrives, the terminal can, based on the user's needs, split the screen on the external display device to display a reduced version of the first interface, the interface of the first application, and the interface of the second application, thereby facilitating timely responses to new messages from multiple applications.

[0217] In one implementation, the terminal is further configured to, when the first input operation for the first notification message is not received within a first time threshold, send a third instruction to the external display device. Upon receiving the third instruction, the external display device is further configured to hide the first notification message and display a first prompt prompting the user to view new messages from the first application on the terminal. In this way, when the user does not want to view the first notification message, the terminal hides the first notification message, thereby reducing obstruction of the first interface displayed on the external display device and improving the user experience.

[0218] In one implementation, the external display device is configured with a touch sensor. The terminal is further configured to receive a first user input operation in response to the notification message, specifically including: the terminal is further configured to receive the user's first touch operation in response to the notification message via the touch sensor of the external display device. In this way, when the external display device is a screen with a touch sensor, the terminal can receive the user's touch operation on the external display device to enable a split-screen display on the external display device, allowing the user to quickly view new messages from the first application.

[0219] In one implementation, the system further includes a keyboard connected to the terminal; the terminal is further configured to receive a first user input operation in response to the notification message, specifically including: the terminal is further configured to receive a first click operation in response to the first notification message via the mouse. In this way, the terminal can receive the user's click operation in response to the first notification message via the mouse to enable a split-screen display on the external display device, allowing the user to quickly view new messages from the first application.

[0220] In one implementation, the system also includes a mouse, which is connected to the terminal; the terminal is also used to receive a first input operation of the user for the notification message, specifically including: the terminal is also used to receive, through the mouse, a first sliding operation of the user operating the mouse pointer displayed on the external display device to slide in a first designated area on the external display device. The sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold. In this way, the terminal can receive a sliding operation of the user controlling the mouse pointer on the external display device through the mouse to turn on a split-screen display on the external display device, so that the user can quickly view new messages of the first application.

[0221] In one implementation, the system further includes a keyboard connected to the terminal; the terminal is further configured to receive a first user input operation in response to the notification message, specifically comprising: the terminal is further configured to receive, via the keyboard, a first press operation of one or more designated keys on the keyboard by the user. In this way, the terminal can receive the user's press operation of the designated keys via the keyboard to enable a split-screen display on the external display device, facilitating the user to quickly view new messages from the first application.

[0222] In one implementation, the terminal is further configured to receive a third input operation from the user. The terminal is further configured to send fifth data to the external display device in response to the third input operation. The external display device is further configured to display the first interface in full screen after receiving the fifth data. In this way, after the user has viewed the new message of the first application, the terminal can restore the full-screen display of the first interface on the external display device based on the user's needs, thereby improving the user experience.

[0223] In one implementation, the external display device is configured with the touch sensor; the terminal is further configured to receive a third input operation from the user, specifically comprising: the terminal receiving a second touch operation from the user through the touch sensor of the external display device.

[0224] or,

[0225] The system includes a mouse connected to the terminal; the terminal is further configured to receive a third input operation from the user, specifically comprising: receiving, by the terminal through the mouse, a second sliding operation in which the user operates a mouse pointer displayed on the external display device to slide over a second designated area on the external display device, wherein the sliding distance of the second sliding operation in the second designated area is greater than a second distance threshold, or the sliding time of the second sliding operation in the second designated area is greater than a second time threshold.

[0226] or,

[0227] The system includes the keyboard connected to the terminal; the terminal is further used to receive the user's third input operation, specifically including: the terminal receives the user's second pressing operation on one or more designated keys on the keyboard through the keyboard.

[0228] In this way, when the external display device is a screen with a touch sensor, the terminal can receive a user's touch operation on the external display device to activate split-screen display on the external display device; or receive a user's sliding operation of controlling a mouse pointer on the external display device to activate split-screen display on the external display device; or receive a user's pressing operation of a designated key on the keyboard to activate split-screen display on the external display device. This facilitates the user to quickly view new messages of the first application.

[0229] In one implementation, the first interface includes a video playback interface, a slide presentation interface, or a picture browsing interface. Alternatively, the second interface includes a main interface, wherein the main interface includes an icon of the first application.

[0230] exist Figure 13 For parts not described in detail in the illustrated embodiment, reference may be made to the aforementioned embodiments and will not be repeated here.

[0231] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A message processing method, characterized in that: include: After the terminal establishes a connection with the external display device, the terminal sends first data to the external display device; The external display device displays a first interface in full screen according to the received first data; wherein a second interface is displayed on the touch screen of the terminal, and the first interface is different from the second interface; When the terminal receives a new message from the first application, the terminal displays a first notification message and sends a first instruction to the external display device; After receiving the first instruction, the external display device displays a third notification message; When the terminal receives a first input operation of the user in response to the first notification message, sending second data to the external display device; After receiving the second data, the external display device displays a fifth interface and the first interface in split screen; the fifth interface includes the content of the second data, a text input box, a send control, a dialing control and contact information.

2. The method according to claim 1, characterized in that After the external display device displays the fifth interface and the first interface in split screen, the method further includes: When the terminal receives a new message from the second application, the terminal displays a second notification message and sends a second instruction to the external display device; After receiving the second instruction, the external display device displays a fourth notification message; The terminal receives a second input operation of the user in response to the second notification message; In response to the second input operation, the terminal sends third data to the external display device; After receiving the third data, the external display device displays a sixth interface and the first interface in a split screen; wherein the sixth interface is an interface in the second application.

3. The method according to claim 1, characterized in that After the external display device displays the fifth interface and the first interface in split screen, the method further includes: When the terminal receives a new message from the second application, the terminal displays a second notification message and sends a second instruction to the external display device; After receiving the second instruction, the external display device displays a fourth notification message; The terminal receives a second input operation of the user in response to the second notification message; In response to the second input operation, the terminal sends fourth data to the external display device; After receiving the fourth data, the external display device displays the eighth interface, the ninth interface and the first interface in split screen; wherein, the eighth interface is the interface in the first application, and the ninth interface is the interface in the second application.

4. The method according to claim 1, wherein After the external display device displays the third notification message, the method further includes: When the terminal does not receive the first input operation for the first notification message within a first time threshold, the terminal sends a third instruction to the external display device; After receiving the third instruction, the external display device hides the third notification message.

5. The method according to claim 4, characterized in that After the external display device hides the third notification message, the method further includes: The external display device displays a first prompt, where the first prompt is used to prompt a user to check new messages of the first application on the terminal.

6. The method according to claim 1, characterized in that The terminal receiving a first input operation of a user in response to the first notification message specifically includes: The terminal receives, through the touch screen, a first touch operation of the user on the first notification message.

7. The method according to claim 1, characterized in that The terminal is connected to a mouse; The terminal receiving a first input operation of a user in response to the first notification message specifically includes: The terminal receives, through the mouse, a first click operation of the user on the first notification message.

8. The method according to claim 1, characterized in that The terminal is connected to a mouse; The terminal receiving a first input operation of a user in response to the first notification message specifically includes: The terminal receives, through the mouse, a first sliding operation in which the user operates the mouse pointer displayed on the external display device to slide in a first designated area on the external display device; wherein the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold.

9. The method according to claim 1, characterized in that The terminal is connected to a keyboard; and the terminal receives a first input operation of a user in response to the first notification message, specifically including: The terminal receives, through the keyboard, a first pressing operation of the user on one or more designated keys on the keyboard.

10. The method according to any one of claims 1 to 9, characterized in that The first interface includes a video playback interface, a slide presentation interface, or a picture browsing interface; or, The second interface includes a main interface, wherein the main interface includes an icon of the first application.

11. The method according to claim 1, wherein The third notification message includes SMS content, a sending control, an SMS input box, and contact information.

12. The method according to claim 1, characterized in that The method further comprises: The external display device receives a fourth input operation of the user on the fifth interface; In response to the fourth input operation, the external display device adjusts a display position of the fifth interface on the external display device.

13. A message processing system, characterized in that: include: A terminal and an external display device; wherein the terminal is connected to the external display device; The terminal is configured to send first data to the external display device; The external display device is configured to display a first interface in full screen according to the received first data; wherein a second interface is displayed on the touch screen of the terminal, and the first interface is different from the second interface; The terminal is further configured to, upon receiving a new message from the first application, display a first notification message and send a first instruction to the external display device; The external display device is further configured to display a third notification message after receiving the first instruction; The terminal is further configured to send second data to the external display device upon receiving a first input operation of the user in response to the first notification message; The external display device is further used to display a fifth interface and the first interface in split screen after receiving the second data; the fifth interface includes the content of the second data, a text input box, a send control, a dialing control and contact information.

14. The system according to claim 13, wherein: The terminal is further configured to, upon receiving a new message from the second application, display a second notification message and send a second instruction to the external display device; The external display device is further configured to display a fourth notification message after receiving the second instruction; The terminal is further configured to receive a second input operation from a user in response to the second notification message; The terminal is further configured to send third data to the external display device in response to the second input operation; After receiving the third data, the external display device displays a sixth interface and the first interface in a split screen; wherein the sixth interface is an interface in the second application.

15. The system according to claim 13, characterized in that The terminal is further configured to, upon receiving a new message from the second application, display a second notification message and send a second instruction to the external display device; The external display device is further configured to display a fourth notification message after receiving the second instruction; The terminal is further configured to receive a second input operation from a user in response to the second notification message; The terminal is further configured to send fourth data to the external display device in response to the second input operation; The external display device is also used to display the eighth interface, the ninth interface and the first interface in split screen after receiving the fourth data; wherein the eighth interface is the interface in the first application, and the ninth interface is the interface in the second application.

16. The system according to claim 13, wherein: The terminal is further configured to send a third instruction to the external display device when the first input operation for the first notification message is not received within a first time threshold; The external display device is further configured to hide the third notification message after receiving the third instruction.

17. The system according to claim 16, wherein: The external display device is further configured to display a first prompt after hiding the third notification message, where the first prompt is configured to prompt the user to view new messages of the first application on the terminal.

18. The system according to claim 13, wherein: The receiving a first input operation of the user in response to the first notification message specifically includes: A first touch operation of the user on the first notification message is received through the touch screen.

19. The system according to claim 13, wherein: The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first click operation of the user on the first notification message is received through the mouse.

20. The system according to claim 13, wherein: The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first sliding operation is received by the mouse, in which the user operates the mouse pointer displayed on the external display device to slide in a first designated area on the external display device; wherein the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold.

21. The system according to claim 13, wherein: The terminal is connected to a keyboard; and the receiving a first input operation of the user in response to the first notification message specifically includes: A first pressing operation of the user on one or more designated keys on the keyboard is received through the keyboard.

22. The system according to any one of claims 13 to 21, characterized in that The first interface includes a video playback interface, a slide presentation interface, or a picture browsing interface; or, The second interface includes a main interface, wherein the main interface includes an icon of the first application.

23. The system according to claim 13, wherein: The third notification message includes SMS content, a sending control, an SMS input box, and contact information.

24. The system according to claim 13, wherein: The external display device is further configured to receive a fourth input operation from the user with respect to the fifth interface; The external display device is further configured to adjust a display position of the fifth interface on the external display device in response to the fourth input operation.

25. A message processing method, characterized in that: include: When the terminal establishes a connection with the external display device, the terminal displays the main interface through the external display device; In response to a user input operation, a video playback interface is displayed in full screen on the external display device; wherein a second interface is displayed on the touch screen of the terminal, and the video playback interface is different from the second interface; When the terminal receives a first notification message from a text message application, the terminal sends a first instruction to the external display device; After receiving the first instruction, the external display device displays a third notification message; When the terminal receives a first input operation of the user in response to the first notification message, sending second data to the external display device; After receiving the second data, the external display device displays the video playback interface and the SMS chat interface in split screen; the SMS chat interface includes SMS content, a text input box, a send control, a dialing control and contact information.

26. The method according to claim 25, characterized in that After the external display device displays the video playback interface and the SMS chat interface in split screen, the method further includes: When the terminal receives a second notification message from the second application, sending a second instruction to the external display device; After receiving the second instruction, the external display device displays a fourth notification message; The terminal receives a second input operation of the user in response to the second notification message; In response to the second input operation, the terminal sends third data to the external display device; After receiving the third data, the external display device displays the interface of the second application and the video playback interface in split screen.

27. The method according to claim 25, characterized in that After the external display device displays the video playback interface and the SMS chat interface in split screen, the method further includes: When the terminal receives a second notification message from the second application, the terminal sends a second instruction to the external display device; After receiving the second instruction, the external display device displays a fourth notification message; The terminal receives a second input operation of the user in response to the second notification message; In response to the second input operation, the terminal sends fourth data to the external display device; After receiving the fourth data, the external display device displays the SMS chat interface, the interface of the second application, and the video playback interface in split screens.

28. The method according to claim 25, characterized in that After the external display device displays the third notification message, the method further includes: When the terminal does not receive the first input operation for the first notification message within a first time threshold, the terminal sends a third instruction to the external display device; After receiving the third instruction, the external display device hides the third notification message.

29. The method according to claim 28, characterized in that After the external display device hides the first notification message, the method further includes: A first prompt is displayed, where the first prompt is used to prompt the user to view a first notification message of the SMS application on the terminal.

30. The method according to claim 25, wherein The terminal receiving a first input operation of a user in response to the first notification message specifically includes: The terminal receives, through the touch screen, a first touch operation of the user on the first notification message.

31. The method according to claim 25, wherein The terminal is connected to a mouse; and the terminal receives a first input operation of a user in response to the first notification message, specifically including: The terminal receives, through the mouse, a first click operation of the user on the first notification message.

32. The method according to claim 25, wherein The terminal is connected to a mouse; and the terminal receives a first input operation of a user in response to the first notification message, specifically including: The terminal receives, through a mouse, a first sliding operation in which the user operates the mouse pointer displayed on the external display device to slide in a first designated area on the external display device; wherein, the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold.

33. The method according to claim 25, wherein The terminal is connected to a keyboard; and the terminal receives a first input operation of a user in response to the first notification message, specifically including: The terminal receives, through the keyboard, a first pressing operation of the user on one or more designated keys on the keyboard.

34. The method according to claim 25, wherein The third notification message includes SMS content, a sending control, an SMS input box, and contact information.

35. The method according to claim 25, wherein The method further comprises: The external display device receives a fourth input operation of the user on the SMS chat interface; In response to the fourth input operation, the external display device adjusts the display position of the SMS chat interface on the external display device.

36. A message processing system, characterized in that: include: A terminal and an external display device; wherein the terminal is connected to the external display device; The terminal is configured to display the main interface via the external display device; The terminal is further configured to display a video playback interface in full screen on the external display device in response to a user input operation; wherein a second interface is displayed on the touch screen of the terminal, and the video playback interface is different from the second interface; The terminal is further configured to send a first instruction to the external display device upon receiving a first notification message from a text message application; The external display device is configured to display a third notification message after receiving the first instruction; The terminal is further configured to send second data to the external display device upon receiving a first input operation of the user in response to the first notification message; The external display device is further used to display the video playback interface and the SMS chat interface in split screen after receiving the second data. The SMS chat interface includes SMS content, a text input box, a send control, a dialing control and contact information.

37. The system according to claim 36, wherein: The terminal is further configured to receive a second notification message from a second application and send a second instruction to the external display device; The external display device is further configured to display a fourth notification message after receiving the second instruction; The terminal is further configured to receive a second input operation from a user in response to the second notification message; The terminal is further configured to send third data to the external display device in response to the second input operation; The external display device is further configured to display the interface of the second application and the video playback interface in split screen after receiving the third data.

38. The system according to claim 36, wherein: The terminal is further configured to send a second instruction to the external display device upon receiving a second notification message from the second application; The external display device is further configured to display a fourth notification message after receiving the second instruction; The terminal is further configured to receive a second input operation from a user in response to a second notification message; The terminal is further configured to send fourth data to the external display device in response to the second input operation; The external display device is further used to display the SMS chat interface, the interface of the second application and the video playback interface in split screen after receiving the fourth data.

39. The system according to claim 36, wherein: The terminal is further configured to send a third instruction to the external display device when the first input operation of receiving the first notification message is within a first time threshold; After receiving the third instruction, the external display device hides the third notification message.

40. The system according to claim 39, wherein: The external display device is further configured to display a first prompt after hiding the first notification message, where the first prompt is configured to prompt the user to view new messages of the first application on the terminal.

41. The system according to claim 36, wherein: The receiving a first input operation of the user in response to the first notification message specifically includes: A first touch operation of the user on the first notification message is received through the touch screen.

42. The system according to claim 36, wherein: The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first click operation of the user on the first notification message is received through the mouse.

43. The system according to claim 36, wherein: The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first sliding operation is received through a mouse, in which the user operates a mouse pointer displayed on the external display device to slide in a first designated area on the external display device; wherein the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold.

44. The system according to claim 36, wherein: The terminal is connected to a keyboard; and the receiving a first input operation of the user in response to the first notification message specifically includes: A first pressing operation of the user on one or more designated keys on the keyboard is received through the keyboard.

45. The system according to claim 36, wherein: The third notification message includes SMS content, a sending control, an SMS input box, and contact information.

46. ​​The system according to claim 36, wherein: The external display device is further configured to receive a fourth input operation from the user on the SMS chat interface; In response to the fourth input operation, the external display device adjusts the display position of the SMS chat interface on the external display device.

47. A terminal, characterized in that: include: A memory, a touch screen, a communication interface, one or more processors, and one or more programs; wherein the one or more programs are stored in the memory; the communication interface is used to communicate with an external display device and an external input device; when the processor runs the one or more programs, the terminal performs the following steps: After establishing a connection with the external display device, first data is sent to the external display device, where the first data is used for the external display device to display a first interface in full screen; wherein a second interface is displayed on the touch screen of the terminal, and the first interface is different from the second interface; When a new message of the first application is received, a first notification message is displayed, and a first instruction is sent to the external display device, where the first instruction is used to instruct the external display device to display a third notification message; When receiving the user's first input operation for the first notification message, second data is sent to the external display device, and the second data is used for the external display device to display the fifth interface and the first interface in split screen; the fifth interface includes the content of the second data, a text input box, a send control, a dialing control and contact information.

48. The terminal according to claim 47, characterized in that When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the second data to the external display device, when a new message of the second application is received, a second notification message is displayed, and a second instruction is sent to the external display device, where the second instruction is used to instruct the external display device to display a fourth notification message; receiving a second input operation from the user in response to the second notification message; In response to the second input operation, third data is sent to the external display device, and the third data is used for the external display device to display a sixth interface and the first interface in a split screen; wherein the sixth interface is an interface in the second application.

49. The terminal according to claim 47, characterized in that When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the second data to the external display device, when a new message of the second application is received, a second notification message is displayed, and a second instruction is sent to the external display device, where the second instruction is used to instruct the external display device to display a fourth notification message; receiving a second input operation from the user in response to the second notification message; In response to the second input operation, fourth data is sent to the external display device, and the fourth data is used for the external display device to display the eighth interface, the ninth interface and the first interface in split screen; wherein, the eighth interface is the interface in the first application, and the ninth interface is the interface in the second application.

50. The terminal according to claim 47, wherein When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the first instruction to the external display device, when the first input operation for the first notification message is not received within a first time threshold, sending a third instruction to the external display device, wherein the third instruction is used to instruct the external display device to hide the third notification message. The terminal according to claim 50 , wherein: When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the third instruction to the external display device, the external display device is controlled to display a first prompt, where the first prompt is used to prompt the user to view new messages of the first application on the terminal.

52. The terminal according to claim 47, characterized in that The receiving a first input operation of the user in response to the first notification message specifically includes: A first touch operation of the user on the first notification message is received through the touch screen.

53. The terminal according to claim 47, characterized in that The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first click operation of the user on the first notification message is received through the mouse.

54. The terminal according to claim 47, characterized in that The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first sliding operation is received by the mouse, in which the user operates the mouse pointer displayed on the external display device to slide in a first designated area on the external display device; wherein the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold.

55. The terminal according to claim 47, characterized in that The terminal is connected to a keyboard; and the receiving a first input operation of the user in response to the first notification message specifically includes: A first pressing operation of the user on one or more designated keys on the keyboard is received through the keyboard.

56. The terminal according to any one of claims 47 to 55, characterized in that: The first interface includes a video playback interface, a slide presentation interface, or a picture browsing interface; or, The second interface includes a main interface, wherein the main interface includes an icon of the first application.

57. The terminal according to claim 47, characterized in that The third notification message includes SMS content, a sending control, an SMS input box, and contact information.

58. A terminal, characterized in that: include: A memory, a touch screen, a communication interface, one or more processors, and one or more programs; wherein the one or more programs are stored in the memory; the communication interface is used to communicate with an external display device and an external input device; when the processor runs the one or more programs, the terminal performs the following steps: When a connection is established with an external display device, the main interface is displayed through the external display device; In response to a user input operation, a video playback interface is displayed in full screen on the external display device; wherein a second interface is displayed on the touch screen of the terminal, and the video playback interface is different from the second interface; When receiving a first notification message from a text message application, sending a first instruction to the external display device, wherein the first instruction is used to instruct the external display device to display a third notification message; When receiving the user's first input operation for the first notification message, second data is sent to the external display device, and the second data is used for the external display device to display the video playback interface and the SMS chat interface in split screen; the SMS chat interface includes SMS content, text input box, send control, dialing control and contact information.

59. The terminal according to claim 58, characterized in that When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the second data to the external display device, when receiving a second notification message from the second application, sending a second instruction to the external display device, wherein the second instruction is used to instruct the external display device to display a fourth notification message; receiving a second input operation from the user in response to the second notification message; In response to the second input operation, third data is sent to the external display device, and the third data is used for the external display device to display the interface of the second application and the video playback interface in a split-screen manner.

60. The terminal according to claim 58, wherein When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the second data to the external display device, when receiving a second notification message from the second application, sending a second instruction to the external display device, wherein the second instruction is used to instruct the external display device to display a fourth notification message; receiving a second input operation from the user in response to the second notification message; In response to the second input operation, fourth data is sent to the external display device, and the fourth data is used for the external display device to display the SMS chat interface, the interface of the second application and the video playback interface in split screen.

61. The terminal according to claim 58, wherein When the processor runs the one or more programs, the terminal is caused to further perform the following steps: When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the first instruction to the external display device, when the first input operation for the first notification message is not received within a first time threshold, sending a third instruction to the external display device, wherein the third instruction is used to instruct the external display device to hide the third notification message.

62. The terminal according to claim 61, characterized in that When the processor runs the one or more programs, the terminal is caused to further perform the following steps: After sending the third instruction to the external display device, the external display device is controlled to display a first prompt, where the first prompt is used to prompt the user to view the first notification message of the SMS application on the terminal.

63. The terminal according to claim 58, characterized in that The receiving a first input operation of the user in response to the first notification message specifically includes: A first touch operation of the user on the first notification message is received through the touch screen.

64. The terminal according to claim 58, characterized in that The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first click operation of the user on the first notification message is received through the mouse.

65. The terminal according to claim 58, characterized in that The terminal is connected to a mouse; and the receiving of a first input operation of the user in response to the first notification message specifically includes: A first sliding operation is received by the mouse, in which the user operates the mouse pointer displayed on the external display device to slide in a first designated area on the external display device; wherein the sliding distance of the first sliding operation in the first designated area is greater than a first distance threshold, or the sliding time of the first sliding operation in the first designated area is greater than a second time threshold.

66. The terminal according to claim 58, characterized in that The terminal is connected to a keyboard; and the receiving a first input operation of the user in response to the first notification message specifically includes: A first pressing operation of the user on one or more designated keys on the keyboard is received through the keyboard.

67. The terminal according to claim 58, characterized in that The third notification message includes SMS content, a sending control, an SMS input box, and contact information.

Images