Application display methods and apparatuses, and electronic device, medium and program product

Abstract

The present application relates to the technical field of device interconnection. Disclosed are application display methods and apparatuses, and an electronic device, a medium and a program product. An application display method comprises: when a communication connection has been established with an interconnected device, sending screen data to the interconnected device, wherein the interconnected device is used for displaying, in a floating window in an application launch interface and on the basis of the screen data, a screen provided by a mobile terminal (1601); launching a target application program, wherein the target application program is an application program indicated by a first application icon in the application launch interface, or by a second application icon in the screen displayed in the floating window, and the first application icon and the second application icon are icons of application programs in the mobile terminal (1602); and sending screen data of the target application program to the interconnected device, wherein the interconnected device is used for displaying a running screen of the target application program in the floating window on the basis of the screen data of the target application program (1603).

Description

Application display method and device, electronic device, medium and program product

[0001] The present application claims priority to the Chinese Patent Application No. 202411126339.6, filed on August 15, 2024, and entitled "Application display method and device, electronic device, medium and program product", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Embodiments of the present application relate to the field of device interconnection technology, and in particular to an application display method and device, electronic device, medium and program product. BACKGROUND

[0003] With the continuous development of device interconnection technology, more and more car machines support interconnection with mobile phones.

[0004] In related technologies, when a car machine is interconnected with a mobile phone, a user first needs to select the content (such as an application) to be projected on the mobile phone, and then the mobile phone transmits the picture of the projected content to the car machine, which displays the picture on the car machine screen in full screen. SUMMARY

[0005] Embodiments of the present application provide an application display method and device, electronic device, medium and program product. The technical solution is as follows:

[0006] In one aspect, the present application provides an application display method, which is used in a mobile terminal, and the method comprises:

[0007] In the case of establishing a communication connection with an interconnected device, picture data is sent to the interconnected device, and the interconnected device is used to display the picture provided by the mobile terminal in a floating window in an application start interface based on the picture data;

[0008] A target application program is started, which is a first application icon in the application start interface, or an application program indicated by a second application icon in the picture displayed by the floating window, and the first and second application icons are icons of application programs in the mobile terminal;

[0009] The picture data of the target application program is sent to the interconnected device, and the interconnected device is used to display the running picture of the target application program in the floating window based on the picture data of the target application program.

[0010] In another aspect, the present application provides an application display method, which is used in an interconnected device, and the method comprises:

[0011] In a case that a communication connection is established with the mobile terminal, display a first application icon and a floating window in an application start interface, the floating window is used to display a screen provided by the mobile terminal;

[0012] In response to a trigger operation on the first application icon in the application start interface or a second application icon in the screen displayed by the floating window, display an application screen in the floating window, the application screen is a running screen of a target application program indicated by the trigger operation;

[0013] The first application icon and the second application icon are icons of application programs in the mobile terminal.

[0014] In another aspect, an embodiment of the present application provides an application display device, the device comprises:

[0015] A sending module is configured to send screen data to an interconnection device in a case that a communication connection is established with the interconnection device, the interconnection device is configured to display a screen provided by a mobile terminal in a floating window in an application start interface based on the screen data;

[0016] A starting module is configured to start a target application program, the target application program is an application program indicated by a first application icon in the application start interface or a second application icon in a screen displayed by the floating window, the first application icon and the second application icon are icons of application programs in the mobile terminal.

[0017] The sending module is further configured to send the screen data of the target application program to the interconnection device, the interconnection device is configured to display a running screen of the target application program in the floating window based on the screen data of the target application program.

[0018] In another aspect, an embodiment of the present application provides an application display device, the device comprises:

[0019] A display module is configured to display a first application icon and a floating window in an application start interface in a case that a communication connection is established with a mobile terminal, the floating window is used to display a screen provided by the mobile terminal;

[0020] The display module is further configured to display an application screen in the floating window in response to a trigger operation on the first application icon in the application start interface or a second application icon in the screen displayed by the floating window, the application screen is a running screen of a target application program indicated by the trigger operation.

[0021] The first application icon and the second application icon are icons of application programs in the mobile terminal.

[0022] In another aspect, an electronic device is provided, which includes a processor and a memory. The memory stores at least one computer instruction for being executed by the processor to implement the application display method on the side of the mobile terminal or the interconnection device as described in the above aspect.

[0023] In another aspect, a computer readable storage medium is provided, which stores at least one computer instruction. The computer instruction is loaded and executed by a processor to implement the application display method on the side of the mobile terminal or the interconnection device as described in the above aspect.

[0024] In another aspect, a computer program product is provided, which includes computer instructions stored in a computer readable storage medium. A processor of an electronic device reads the computer instructions from the computer readable storage medium, and executes the computer instructions to cause the electronic device to perform the application display method on the side of the mobile terminal or the interconnection device as described in the above aspect. BRIEF DESCRIPTION OF DRAWINGS

[0025] FIG. 1 is a schematic diagram of an implementation environment of an application display method according to an example embodiment of the present application;

[0026] FIG. 2 is a flowchart of an application display method on the side of an interconnection device according to an example embodiment of the present application;

[0027] FIG. 3 is a schematic diagram of a display screen of an interconnection device according to an example embodiment of the present application;

[0028] FIG. 4 is a schematic diagram of a state of an interconnection device and a mobile terminal before connection according to an example embodiment of the present application;

[0029] FIG. 5 is a schematic diagram of a screen of an interconnection device and a mobile terminal in a mirror mode according to an example embodiment of the present application;

[0030] FIG. 6 is a schematic diagram of a screen of an interconnection device and a mobile terminal in an interconnection mode according to an example embodiment of the present application;

[0031] FIG. 7 is a schematic diagram of a screen comparison in the mirror mode and the interconnection mode according to an example embodiment of the present application;

[0032] FIG. 8 is a schematic diagram of mode switching according to an example embodiment of the present application;

[0033] FIG. 9 shows an implementation schematic diagram of a floating window closing and display process according to an example embodiment of the present application;

[0034] FIG. 10 illustrates an implementation example of a screen direction switching process in a mirror mode according to an exemplary embodiment of the present application;

[0035] FIG. 11 illustrates an implementation example of a screen direction switching process in a connection mode according to an exemplary embodiment of the present application;

[0036] FIG. 12 illustrates an implementation example of a screen direction switching process according to another exemplary embodiment of the present application;

[0037] FIG. 13 illustrates a floating window in different full screen states according to an exemplary embodiment of the present application;

[0038] FIG. 14 illustrates a connection device screen in which a floating window is displayed in a parallel window mode according to an exemplary embodiment of the present application;

[0039] FIG. 15 is a flowchart illustrating a display process of a first application icon according to an exemplary embodiment of the present application;

[0040] FIG. 16 is a flowchart illustrating a mobile terminal-side application display method according to an exemplary embodiment of the present application;

[0041] FIG. 17 is a timing diagram illustrating a floating window activation process in a mirror mode according to an exemplary embodiment of the present application;

[0042] FIG. 18 is a timing diagram illustrating a floating window activation process in a connection mode according to an exemplary embodiment of the present application;

[0043] FIG. 19 is a timing diagram illustrating a mode switching process according to an exemplary embodiment of the present application;

[0044] FIG. 20 is a timing diagram illustrating a floating window deactivation process according to an exemplary embodiment of the present application;

[0045] FIG. 21 is a flowchart illustrating a process in which a mobile terminal provides application information according to an exemplary embodiment of the present application;

[0046] FIG. 22 is a timing diagram illustrating a first application list acquisition process according to an exemplary embodiment of the present application;

[0047] FIG. 23 is a timing diagram illustrating an application information acquisition process according to an exemplary embodiment of the present application;

[0048] FIG. 24 is a timing diagram illustrating an application activation process according to an exemplary embodiment of the present application;

[0049] FIG. 25 is a timing diagram illustrating a connection device reverse control process according to an exemplary embodiment of the present application;

[0050] FIG. 26 is a structural diagram of an application display device according to an example embodiment of the present application;

[0051] FIG. 27 is a structural diagram of an application display device according to an example embodiment of the present application;

[0052] FIG. 28 is a structural diagram of an electronic device according to an example embodiment of the present application. DETAILED DESCRIPTION

[0053] For the purpose, technical solutions and advantages of the present application to be clearer, the embodiments of the present application will be further described in detail below with reference to the drawings.

[0054] Referring to FIG. 1, FIG. 1 is a schematic diagram of an implementation environment of an application display method according to an example embodiment of the present application, including an interconnected device 101 and a mobile terminal 102. The interconnected device 101 is provided with an interconnected device HMI (Human Machine Interaction) 103 and an interconnected device SDK (Software Development Kit) 104, and the mobile terminal 102 is provided with a mobile terminal SDK 105, an interconnected management program 106 and a terminal system 107.

[0055] The mobile terminal 102 can be provided with a large number of application programs, and application services can be provided by starting the application programs. For example, the mobile terminal 102 can start a video application to play a video. Optionally, the mobile terminal 102 can include a smart phone, a smart watch and other portable mobile devices.

[0056] The interconnected device 101 is an external device independent of the mobile terminal, and can display the screen projection content of the mobile terminal 102. Optionally, the interconnected device 101 and the mobile terminal 102 can be personal devices under the same user account. Optionally, the interconnected device 101 can include a personal computer, a tablet computer, a television, a car machine and other electronic devices that can project a screen. Optionally, the interconnected device 101 can be provided with application programs, which can be the same as or different from the application programs in the mobile terminal 102. The interconnected device 101 can control the application programs on the mobile terminal 102 through the interconnected device HMI 103 and the interconnected device SDK 104. The interconnected device 101 can receive the starting operation of the application programs on the mobile terminal 102 by displaying a floating window, or can receive the starting operation of the application programs on the mobile terminal 102 by displaying the application program icons on the application starting interface.

[0057] The interconnection device HMI 103 is configured to display a picture on the interconnection device 101 according to picture data transmitted by the mobile terminal 102, including a running picture of an application on the mobile terminal 102, a running picture of an application on the interconnection device 101, and an interactive picture of the interconnection device 101. Optionally, in the case that the interconnection device HMI 103 needs to display a running picture of an application on the mobile terminal 102, the interconnection device HMI 103 can receive a user operation and pass an operation instruction to the interconnection device SDK 104.

[0058] The interconnection device SDK 104 is configured to interact with the mobile terminal SDK 105 on the mobile terminal 102, including passing an instruction to the mobile terminal SDK 105 and receiving picture data coded by the interconnection management program 106. The interconnection device SDK 104 is also configured to decode picture data coded by the interconnection management program 106, so that the interconnection device HMI 103 displays a picture.

[0059] The mobile terminal SDK 105 is configured to interact with the interconnection device SDK 104, send a request from the interconnection device SDK 104 to the interconnection management program 106, and send a response content of the interconnection management program 106 to the interconnection device SDK 104.

[0060] The interconnection management program 106 is configured to manage information interaction between the interconnection device 101 and the mobile terminal 102. The interconnection device 101 cannot access the terminal system 107 on the mobile terminal 102, and needs to send a request to the interconnection management program 106 to start and reverse control an application on the mobile terminal 102 through the interconnection management program 106. The interconnection management program 106 is also configured to send coded picture data to the interconnection device SDK 104.

[0061] The terminal system 107 is configured to manage running of an application in the background. The terminal system 107 determines picture data of an application by creating a virtual screen, so that the interconnection management program 106 codes and sends the picture data to the interconnection device 101.

[0062] Optionally, the interconnection device 101 and the mobile terminal 102 can be connected through a wireless connection mode such as WIFI (Wireless Fidelity), Bluetooth, or a wired connection mode.

[0063] In the embodiment, the interconnection device 101 can display a picture provided by the mobile terminal 102, receive a control operation on an application on the mobile terminal 102, pass an instruction to the mobile terminal 102, and then update a display picture according to picture data transmitted by the mobile terminal 102. The mobile terminal 102 can run an application according to a request of the interconnection device 101, determine picture data, and provide the picture data for the interconnection device 101 to display.

[0064] The application provides an application display method. The method can start an application program on a mobile terminal in two ways of a floating window or an application icon on an application starting interface of an interconnected device, and then display a running screen of the application program in the floating window. The application program still runs on the mobile terminal, which can effectively avoid the application program on the mobile terminal from occupying display space and causing interference to picture display of the interconnected device.

[0065] The method can be applied to interconnection between a mobile phone and a car machine, interconnection between a PC (Personal Computer) and a mobile phone, interconnection between a PAD (Portable Android Device) and a mobile phone, and the like. The Carlink interconnection protocol mentioned in the application is only a specific protocol standard for realizing the car machine screen projection function, and the application does not limit the protocol used when the devices are interconnected.

[0066] The following embodiments are first described in detail with the method applied to interconnected devices as an example.

[0067] Referring to FIG. 2, FIG. 2 is a flowchart of an application display method on the side of an interconnected device according to an example embodiment of the application. The method includes the following steps.

[0068] In step 201, a first application icon and a floating window are displayed in an application starting interface in a case where a communication connection is established with a mobile terminal. The floating window is used to display a picture provided by the mobile terminal.

[0069] Optionally, the communication connection established between the interconnected device and the mobile terminal can be a WIFI connection, a Bluetooth connection, a wired connection, and the like. The embodiments of the application do not limit the communication connection mode between the interconnected device and the mobile terminal.

[0070] In some embodiments, the application starting interface is used to display application icons, so that the interconnected device starts an application program in a case where a triggering operation on the application icon is received. The application starting interface of the interconnected device displays application icons of local application programs of the interconnected device and the first application icon.

[0071] In some embodiments, the first application icon is an application icon of an application program in the mobile terminal, and the first application icon is used to realize quick start of the application program on the mobile terminal. In order to distinguish the first application icon from an application icon of an application program on the interconnection device, optionally, the interconnection device can display an application mark on the first application icon when displaying the first application icon, indicating that the application program is from the mobile terminal. The application mark can be a specific pattern, such as a mobile terminal pattern. Optionally, the interconnection device can also change the display color of the application name of the application program on the mobile terminal on the interconnection device, and the application icon represented by the first application icon is not limited to distinguish the local application of the interconnection device.

[0072] In some embodiments, the floating window displays a picture provided by the mobile terminal, that is, the display content of the picture displayed by the floating window is determined by the mobile terminal, and the application program on the mobile terminal runs on the mobile terminal and is displayed on the interconnection device.

[0073] Optionally, the picture displayed by the floating window can include a home page and an application page. The home page displayed by the floating window is used to display the application icon of the application program in the mobile terminal, so as to trigger the display of the application page.

[0074] In step 202, in response to the triggering operation on the first application icon in the application start interface or the second application icon in the picture displayed by the floating window, the application page is displayed in the floating window, and the application page is the running page of the target application program indicated by the triggering operation.

[0075] In some embodiments, the second application icon is an icon of an application program in the mobile terminal. Optionally, the second application icon in the floating window and the first application icon in the application start interface can represent the same application program, or can represent different application programs.

[0076] In one possible implementation, the interconnection device selects an application program from the mobile terminal, and displays the first application icon corresponding to the application program in the application start interface. The interconnection device displays the second application icon corresponding to all application programs in the mobile terminal in the floating window.

[0077] In another possible implementation, the interconnection device selects an application program from the mobile terminal, displays the first application icon corresponding to the application program in the application start interface, and displays the second application icon corresponding to the application program in the floating window, so that the first application icon and the second application icon can represent the same application program.

[0078] It should be noted that, in response to the triggering operation on the first application icon in the application interface, the interconnection device does not maintain the floating window display screen and additionally create a display window to display the application screen, but stops displaying the second application icon in the floating window and starts displaying the application screen, which can avoid occupying the display space of the interconnection device by newly creating a window and reduce the interference caused to the interconnection device.

[0079] For example, FIG. 3 is a schematic diagram of a display screen of an interconnection device according to an example embodiment of the present application. The application startup interface 301 shows applications 1 to 12 in the interconnection device. In the case where the mobile terminal establishes a communication connection with the interconnection device, the interconnection device displays the first application icons corresponding to applications A to E and the floating window 302. The first application icons are displayed with application identifiers representing the application programs of the mobile terminal. The second application icons corresponding to applications A to K in the mobile terminal are shown in the floating window 302. The first application icons corresponding to applications F to K are not present in the application startup interface 301. In the case where the interconnection device receives a triggering operation on the first application icon 303 corresponding to application C, or receives a triggering operation on the second application icon 304 corresponding to application C, the interconnection device displays the application C screen in the floating window 302.

[0080] Optionally, in the case where the floating window displays the application screens of other applications, the interconnection device can display the application screen of the application represented by the first application icon in the floating window in response to the triggering operation on the first application icon.

[0081] In the embodiments of the present application, the interconnection device can provide the first application icons for starting the application programs of the mobile terminal in the application startup interface, and can also provide the second application icons for starting the application programs of the mobile terminal in the floating window, so that the application programs of the mobile terminal can be started in multiple ways on the interconnection device, and the application screens are displayed in the floating window rather than in a newly created window, which is beneficial to reduce the interference of the application screens of the mobile terminal on the interconnection device.

[0082] In some embodiments, the floating window displayed by the interconnection device has different floating window modes, and the screens provided by the mobile terminal are different in different floating window modes. The floating window modes include a mirror mode and an interconnection mode.

[0083] Optionally, the interconnection device can display the floating window in the mirror mode in the application startup interface, or display the floating window in the interconnection mode in the application startup interface in the case where a communication connection is established with the mobile terminal.

[0084] The floating window in the mirror mode displays the mirror screen provided by the mobile terminal, and the floating window in the interconnection mode displays the interconnection screen provided by the mobile terminal. The interconnection screen is the screen of the customized user interface in the interconnection mode.

[0085] In some embodiments, in the mirror mode, the mirror picture is carried on the mirror virtual screen of the mobile terminal, the display content of the mobile terminal screen is consistent with the display content of the mirror virtual screen, and the display size of the mirror picture is consistent with the screen size of the mobile terminal, such as the same size ratio. In the case of updating the content of the mobile terminal screen, the mirror picture is updated synchronously.

[0086] In some embodiments, the interconnection mode refers to the mode when the interconnection device and the mobile terminal establish a communication connection. The interconnection picture in the interconnection mode is carried on the background virtual screen of the mobile terminal, which is invisible on the mobile terminal. The mobile terminal in the interconnection mode can be in the screen-off state.

[0087] In some embodiments, the customized user interface includes the second application icons. Optionally, the user can customize the display content of the customized user interface, such as filtering the second application icons displayed in the floating window, adjusting the display form and arrangement position of the second application icons. It should be noted that the content adjustment in the customized user interface does not affect the screen picture of the mobile terminal.

[0088] Optionally, the customized user interface can also display important information in the form of cards, such as schedule information, incoming call information, new message prompt information, music information, etc. The customized user interface can support page turning, display information cards in the main interface, and display second application icons of other applications in other interfaces. The user can select to add or delete the applications displayed in the customized user interface.

[0089] For example, FIG. 4 is a state diagram of the connection between the interconnection device and the mobile terminal before connection according to an example embodiment of the present application. The mobile terminal picture is displayed as a desktop home page 410. The desktop home page 410 includes application icons 401 of applications A to K on the mobile terminal. The interconnection device picture is displayed as an application startup interface 420. The application startup interface 420 includes application icons 400 of applications 1 to 12. Optionally, before the interconnection device and the mobile terminal establish a communication connection, the mobile terminal can be in any state, such as a lock screen state, a black screen state, or an unlocked state.

[0090] FIG. 5 is a picture diagram of the interconnection device and the mobile terminal in the mirror mode according to an example embodiment of the present application. In the mirror mode, the top frame of the floating window displays “mirror mode” and the floating window controls (including the return control 501, the home return control 502, the mode switching control 503, the screen switching control 504, and the close control 505). In the case of displaying the desktop home page on the mobile terminal, the desktop home page of the mobile terminal is synchronously displayed in the floating window. The interconnection device displays application icons 520 of applications A to E in the application startup interface 510.

[0091] FIG. 6 is a schematic diagram of a screen of the interconnection device and the mobile terminal in the interconnection mode according to an example embodiment of the present application. In the interconnection mode, the top border of the floating window displays "interconnection mode" and the floating window controls (including the return control 601, the home return control 602, the mode switching control 603, the screen switching control 604, and the close control 605), and the customized user interface 600 is displayed in the floating window. The customized user interface 600 includes the information card 606 and the frequently used application shortcut icon 607. The information card 606 and the frequently used application shortcut icon 607 can be used to start an application. The mobile terminal displays the screen-off screen 610.

[0092] FIG. 7 is a schematic diagram of a comparison of screens in the interconnection mode and the mirror mode according to an example embodiment of the present application. When the interconnection device receives a triggering operation on the first application icon 700 corresponding to application C, the running screen 701 of application C is displayed in the floating window in the mirror mode and the interconnection mode. In the mirror mode, the mobile terminal synchronously displays the running screen 701 of application C. Since the screen 701 in the mirror mode is carried on the mirror virtual screen, the screen content of the mirror virtual screen is displayed on the mobile terminal screen, and in the case of screen-off of the mobile terminal, the floating window screen is easily interrupted. In the interconnection mode, since the floating window displays the content carried on the background virtual screen of the mobile terminal, the mobile terminal can display the screen-off screen 702.

[0093] The mobile terminal displays the screen-off screen including clock information. Optionally, in the case that the mobile terminal is not configured to display the screen-off screen, the mobile terminal can be in a black screen state. The interconnection device displays the application icons of applications A to E in the mobile terminal in the application start interface.

[0094] Optionally, in the case that the interconnection device is a car machine, the Carlink connection can be established between the car machine and the mobile terminal to realize the interaction between the car machine and the mobile terminal in the mirror mode and the interconnection mode.

[0095] In some embodiments, after the interconnection device and the mobile terminal establish the communication connection, the floating window can display the mirror screen in the mirror mode by default, or display the interconnection screen in the interconnection mode by default. The default floating window mode after the connection is established can be determined by the configuration operation, and the floating window mode can also be kept as the floating window mode used in the historical communication connection.

[0096] Optionally, after the interconnection device and the mobile terminal establish the communication connection, the floating window mode can be determined by the interconnection device and notified to the mobile terminal, or determined by the mobile terminal and notified to the interconnection device.

[0097] In some embodiments, in a case where the floating window mode is determined by the interconnection device, the interconnection device can send a mode enabling instruction to the mobile terminal in a case where a communication connection is established with the mobile terminal. The mode enabling instruction is used to indicate the floating window mode in which the floating window is enabled, and the mobile terminal is used to provide a picture to the interconnection device in accordance with the floating window mode indicated by the mode enabling instruction. Then, the interconnection device configures the floating window according to the determined floating window mode.

[0098] In a possible implementation, the interconnection device sends a mode enabling instruction to the mobile terminal, the mode enabling instruction indicating a default floating window mode configured in the interconnection device. For example, the default floating window mode is the mirror mode, and the mode enabling instruction is used to indicate that the floating window is enabled in the mirror mode.

[0099] In another possible implementation, the interconnection device records a historical floating window mode, and in a case where the floating window mode does not change, sends a mode enabling instruction to the mobile terminal, the mode enabling instruction indicating the historical floating window mode. For example, the historical floating window mode is the interconnection mode, and the mode enabling instruction indicates that the floating window is enabled in the interconnection mode. In a case where the floating window mode is switched from the interconnection mode to the mirror mode, and the communication connection between the interconnection device and the mobile terminal is disconnected, the historical floating window mode becomes the mirror mode, and the interconnection device subsequently sends a mode enabling instruction to the mobile terminal, the mode enabling instruction indicating the mirror mode.

[0100] Optionally, in a case where the interconnection device is a car machine, the floating window mode can also be determined according to the number of occupants. Since the floating window is displayed synchronously with the mobile terminal in the mirror mode, it is easy to leak the user's private information. However, the display content of the customized user interface in the interconnection mode can be customized by the user, which is beneficial to protect personal privacy. In a case where the number of occupants of the vehicle is small, such as a single driver scenario, the interconnection device can adopt the mirror mode to enjoy rich mobile terminal services. In a case where the number of occupants is large, such as a passenger scenario, the interconnection device can adopt the interconnection mode to protect the user's privacy.

[0101] In yet another possible implementation, in a case where the interconnection device is a car machine, the car machine records a correspondence between the number of occupants and the floating window mode. In a case where the number of occupants is one, the interconnection device sends a mode enabling instruction to the mobile terminal, the mode enabling instruction indicating the mirror mode. In a case where the number of occupants is at least two, the interconnection device sends a mode enabling instruction to the mobile terminal, the mode enabling instruction indicating the interconnection mode.

[0102] In some other embodiments, in a case where the floating window mode is determined by the mobile terminal, the interconnection device can receive a mode enabling instruction sent by the mobile terminal in a case where a communication connection is established with the mobile terminal. The mode enabling instruction is used to indicate the floating window mode in which the floating window is enabled. Then, the interconnection device configures the floating window based on the floating window mode indicated by the mode enabling instruction.

[0103] Optionally, the mobile terminal can configure a default floating window mode, record a history floating window mode, and record a corresponding relationship between a scene and a floating window mode.

[0104] In a possible implementation, the mobile terminal determines a current scene according to a device connection condition, a current location, a current time, and sensor data. In a case where the current scene is a user-alone scene, the interconnected device receives a mode enabling instruction indicating the mirror mode sent by the mobile terminal. In a case where the current scene is a public scene, the interconnected device receives a mode enabling instruction indicating the interconnection mode sent by the mobile terminal.

[0105] For example, in a case where the mobile terminal establishes a communication connection with an electronic device under a different user account or a stranger device, or in a case where the current time, location, and sensor data represent that the mobile terminal is in a public scene, such as a holiday travel scene, a commuting scene, or the like, for example, the light sensor detects that the current scene is bright, the mobile terminal determines that the current scene is a public scene, and sends a mode enabling instruction indicating the interconnection mode to the interconnected device. In a case where the mobile terminal establishes a communication connection with an electronic device under the same user account, or in a case where the current time, location, and sensor data represent that the mobile terminal is in a user-alone scene, such as a home scene, a lunch break scene, or the like, for example, the light sensor detects that the current scene is dark, the mobile terminal determines that the current scene is a user-alone scene, and sends a mode enabling instruction indicating the mirror mode to the interconnected device.

[0106] In some embodiments, the floating window mode can be flexibly switched between the mirror mode and the interconnection mode, and the mode switching is implemented through a switching operation. Optionally, the switching operation on the floating window mode can include a triggering operation on a mode switching control.

[0107] For example, FIG. 8 is a mode switching schematic diagram provided by an example embodiment of the present application. In a case where the interconnected device receives a triggering operation on the floating window top “mirror mode” control, the floating window mode is switched to the interconnection mode, the floating window top displays the “interconnection mode” control, the customized user interface is displayed in the floating window, and the mobile terminal can be in a screen-off state. Subsequently, the interconnected device receives a triggering operation on the floating window top “interconnection mode” control, the floating window mode is switched to the mirror mode, the floating window top displays the “mirror mode” control, and the mobile terminal displays the desktop home page of the mobile terminal synchronously with the floating window.

[0108] Optionally, the interconnected device can display a switching animation in the floating window during the floating window mode switching process.

[0109] Optionally, the switching operation on the floating window mode can be received by the mobile terminal or the interconnected device.

[0110] In the case that the switching operation of the floating window mode is implemented by the interconnection device receiving, the interconnection device switches the floating window mode of the floating window in response to the triggering operation of the mode switching control in the floating window; and sends a mode switching instruction to the mobile terminal based on the switched floating window mode, the mode switching instruction being used to instruct to switch the floating window mode of the floating window, and the mobile terminal being used to provide a picture conforming to the switched floating window mode to the interconnection device based on the mode switching instruction.

[0111] As to the mobile terminal providing the picture conforming to the switched floating window mode to the interconnection device, the embodiment on the mobile terminal side is not described in the present application.

[0112] As shown in FIG. 8, the interconnection device receives the triggering operation of the “mirror mode” control, and switches the floating window mode from the interconnection mode to the mirror mode. Then, the interconnection device sends a mode switching instruction to the mobile terminal, the mode switching instruction being used to instruct to switch to the mirror mode.

[0113] In the case that the switching operation of the floating window mode is implemented by the mobile terminal receiving, the interconnection device receives the mode switching instruction sent by the mobile terminal, the mode switching instruction being used to instruct to switch the floating window mode of the floating window; and configures the floating window based on the switched floating window mode indicated by the mode switching instruction.

[0114] Optionally, in the case that the mobile terminal receives the mode switching operation, the mode switching operation can include the triggering operation of the control, the voice input operation, the gesture operation, etc., which are not limited in the present embodiment.

[0115] In some embodiments, the interconnection device can display a home return control in the floating window, the home return control being different from the return control, the return control being used to perform a single return operation, such as returning to the historical page before the page jump after the page jump, and the home return control being used to return to the main interface.

[0116] In the main interface returning process, the interconnection device sends a home return instruction to the mobile terminal in response to the triggering operation of the home return control in the floating window, the mobile terminal being used to close the target application based on the home return instruction, and provide a home picture to the interconnection device, wherein the home picture provided by the mobile terminal is different in different floating window modes. Subsequently, the interconnection device displays the home picture in the floating window.

[0117] In a possible implementation, the interconnection device sends a home return event to the mobile terminal in response to the triggering operation of the home return control, the home return event being contained in the home return instruction. The mobile terminal calls a system interface, updates the application picture in the virtual screen to the home page of the application, and then sends a successful home return notification to the interconnection device, and sends the picture data of the home picture.

[0118] In some embodiments, the home page provided by the mobile terminal in the mirror mode is the desktop home page of the mobile terminal, and the home page provided by the mobile terminal in the interconnection mode is the home page of the customized user interface.

[0119] For example, as shown in FIG. 8, the interconnection device sends a home page return instruction to the mobile terminal in response to a triggering operation on the home page return control 800 in the floating window. The return control 801 is used to perform a single return operation.

[0120] In a possible implementation scenario, the interconnection device first displays the desktop home page provided by the mobile terminal in the mirror mode, while the mobile terminal displays the desktop home page. When the interconnection device receives a triggering operation on a first application icon in the application starting interface, or receives a triggering operation on a second application icon on the desktop home page in the floating window, the interconnection device stops displaying the desktop home page of the mobile terminal in the floating window, and then displays an application interface of a currently started application, which is displayed in both the floating window and the mobile terminal. Subsequently, the interconnection device switches the floating window mode to the interconnection mode when receiving a triggering operation on the mode switching control. In the case that the mobile terminal is in a screen-off state, the floating window in the interconnection mode still displays the application page. When the interconnection device subsequently receives a triggering operation on the home page return control, the interconnection device displays the home page of the customized user interface in the floating window, instead of the desktop home page of the mobile terminal.

[0121] In the embodiments of the present application, the display manners of the floating window pages in different floating window modes are different, and the display of the mobile terminal is also different. In the interconnection mode, the customized user interface can be displayed, which is beneficial to guarantee user privacy. In the mirror mode, the mirror page is displayed in the floating window, which is beneficial to the mobile terminal to provide rich services. The mirror page conforms to the operation habit of the mobile terminal, and the operation convenience can be improved.

[0122] In the case that the interconnection device and the mobile terminal establish a communication connection, the floating window mode can be determined by the interconnection device or the mobile terminal, the mode switching can be initiated by the interconnection device or the mobile terminal, and the floating window mode can be synchronized between the interconnection device and the mobile terminal through instruction interaction, which is beneficial to improve the setting flexibility of the floating window mode.

[0123] Since the home pages in different floating window modes are different, the interconnection device can return to the home page in the current floating window mode when receiving a triggering operation on the home page return control, so that the floating window has the home page return capability, and the function richness of the floating window is improved.

[0124] In some embodiments, in order to avoid that the floating window blocks the display page of the interconnection device, the floating window provides a closing control. The interconnection device also provides a floating window icon to display the floating window again.

[0125] In some embodiments, the interconnection device can stop displaying the floating window and display the floating window icon in response to a triggering operation on the closing control in the floating window. The interconnection device can also re-display the floating window in response to a triggering operation on the floating window icon.

[0126] Optionally, the floating window icon can display the connection status between the mobile terminal and the interconnection device, such as displaying the terminal name of the mobile terminal in communication connection with the interconnection device and the connection status.

[0127] In some embodiments, the floating window mode of the re-displayed floating window is consistent with the floating window mode before the floating window is closed.

[0128] In some embodiments, the floating window mode of the re-displayed floating window is the floating window mode indicated by the mode switching instruction sent by the mobile terminal to the interconnection device after the floating window is closed.

[0129] Optionally, the interconnection device can also switch the floating window mode in response to a long pressing operation on the floating window icon.

[0130] For example, FIG. 9 shows an implementation schematic diagram of the process of closing the floating window and displaying the desktop home page according to an example embodiment of the present application. The interconnection device first displays the application screen of application C in the mirroring mode in synchronization with the mobile terminal, and then closes the floating window, displays the floating window icon 901, and displays “interconnection” on the floating window icon 901, indicating that the interconnection device is in communication connection with the mobile terminal. At this time, the mobile terminal exits the application screen and displays the desktop home page. Subsequently, the interconnection device re-displays the floating window in the mirroring mode in response to a clicking operation on the floating window icon 901, and displays the desktop home page of the mobile terminal in the floating window according to the screen of the mobile terminal.

[0131] It should be noted that when the interconnection device starts and controls the application program in the mobile terminal, the application program still runs in the mobile terminal, not in the interconnection device. In order to realize the above-mentioned screen display in the interconnection device, the interconnection device and the mobile terminal need to interact with each other, that is, the interconnection device needs to transmit a request to the mobile terminal in response to a triggering operation on the closing control, and the mobile terminal decides whether to provide the screen.

[0132] In some embodiments, the interconnection device sends a floating window closing instruction to the mobile terminal in response to a triggering operation on the closing control in the floating window, and the mobile terminal stops providing the screen to the interconnection device based on the floating window closing instruction. In the case that the mobile terminal stops providing the screen, the interconnection device stops displaying the floating window and displays the floating window icon.

[0133] In a possible implementation, the interconnection device sends a stop application event to the mobile terminal in response to the triggering operation on the close control in the floating window, where the stop application event is included in the floating window close instruction. The mobile terminal invokes a system interface to close the application in the virtual screen, and then sends a successful closing notification to the interconnection device.

[0134] In some embodiments, the interconnection device sends a floating window opening instruction to the mobile terminal in response to the triggering operation on the floating window icon, and the mobile terminal re-provides a picture to the interconnection device based on the floating window opening instruction, and then the interconnection device re-displays the picture provided by the mobile terminal in the floating window.

[0135] In a possible implementation, the interconnection device sends an application starting event to the mobile terminal in response to the triggering operation on the floating window icon, where the application starting event is included in the floating window starting instruction. The mobile terminal invokes a system interface to draw an application picture of the application in the virtual screen, and then sends a successful starting notification to the interconnection device.

[0136] In the embodiments of the present application, the interconnection device can hide the floating window or reopen the floating window, which reduces the interference of the floating window occupying the display space of the interconnection device, and is beneficial to improve the display flexibility of the floating window.

[0137] The interconnection device sends the floating window closing instruction to notify the mobile terminal to stop providing the picture, and sends the floating window opening instruction to notify the mobile terminal to re-provide the picture, thereby realizing the control of the floating window, and being beneficial to improve the display flexibility of the floating window.

[0138] In some embodiments, the screen display direction of the mobile terminal includes a horizontal screen direction and a vertical screen direction. Correspondingly, when the floating window displays the picture provided by the mobile terminal, the picture can also be displayed in the horizontal screen direction or the vertical screen direction.

[0139] In some possible application scenarios, the floating window needs to display a horizontal screen picture in the mirror mode or the interconnection mode. For example, in a video playing scenario, the floating window displays a picture of horizontal screen video playing, and in a game scenario, the floating window displays a horizontal screen game picture.

[0140] Optionally, the interconnection device can configure the floating window matched with the screen direction based on the screen direction indicated by the screen direction switching notification in a case where the screen direction switching notification sent by the mobile terminal is received.

[0141] In some embodiments, the screen direction switching notification is sent by the mobile terminal to the interconnection device in a case where it is determined that there is a screen direction switching event, and is used to indicate the screen direction.

[0142] The screen direction switching event is used to represent that the display direction of the picture content in the screen of the mobile terminal is changed. In the case that the screen switching event exists, the interconnection device configures the floating window matching the screen direction.

[0143] It should be noted that the interconnection device does not have the ability to determine the screen direction switching event. In the case that the user operation is received, the interconnection device forwards the operation event to the mobile terminal to determine whether the screen direction switching event exists. In the case that the mobile terminal determines that the screen direction switching event exists, the interconnection device can receive the screen direction switching notification sent by the mobile terminal.

[0144] The screen direction switching event triggering the screen direction switching notification includes at least one of the following:

[0145] 1. The screen direction of the mobile terminal is changed.

[0146] In a possible application scenario, in the case that the screen direction of the mobile terminal is changed, the mobile terminal can automatically switch the display direction of the application picture and send the screen switching notification to the interconnection device. In the case that the screen switching notification is received, the interconnection device configures the floating window matching the screen direction of the mobile terminal.

[0147] For example, in the process that the mobile terminal plays a video, the screen direction of the mobile terminal is changed from the vertical screen to the horizontal screen, so that the video picture is played in full screen on the screen of the mobile terminal. The interconnection device receives the screen direction switching notification sent by the mobile terminal, and then configures the floating window to display the horizontal screen playing picture of the video application according to the screen direction indicated by the notification.

[0148] 2. The mobile terminal receives the trigger operation on the screen direction switching control in the target application program.

[0149] Optionally, the trigger operation on the screen direction switching control can include a click operation, a voice input operation, and can also be a visual control operation triggered by human eyes. The embodiments of the present application do not limit the trigger operation.

[0150] Optionally, the screen direction switching control can be a full screen control in the application program. For example, a video full screen playing control in a video playing application.

[0151] Optionally, the screen direction switching control can also be a horizontal screen mode control in the application program. For example, a browser or social software has a horizontal screen display mode and a vertical screen display mode. In the case that the mobile terminal receives the trigger operation on the horizontal screen mode control, the browser or social software enters the horizontal screen display mode and displays the horizontal screen picture.

[0152] In the embodiments of the present application, the controls capable of changing the display direction of the application screen in the mobile terminal screen can all be used as the screen direction switching control in the target application program.

[0153] 3. The mobile terminal receives the reverse control instruction sent by the interconnected device, and the reverse control instruction is used to trigger the screen direction switching control in the target application program.

[0154] In some embodiments, the reverse control instruction is used to forward the operation event to the mobile terminal in the case that the interconnected device receives the user operation. In the case that the operation event indicates the triggering of the screen direction switching control in the target application program, the mobile terminal determines that the screen direction switching event exists.

[0155] Optionally, the reverse control instruction can include the operation coordinates and the operation type of the user operation.

[0156] For example, in the case that the user clicks or touches the floating window, the interconnected device sends the click event or the touch event to the mobile terminal, and the touch event includes the click or touch position, so that the mobile device determines whether the screen direction switching event exists.

[0157] Optionally, the screen direction switching control in the target application program can include the full screen control, the horizontal screen mode control and other controls capable of changing the display direction of the application program in the mobile terminal screen, and the embodiments of the present application do not limit this.

[0158] In some possible application scenarios, in the case that the interconnected device has a display requirement, the screen provided by the mobile terminal can occupy the display space and cause display interference to the interconnected device. For example, in the vehicle driving scenario, the vehicle screen needs to display the navigation screen, the vehicle running condition and the like, and the floating window can interfere with the screen display of the vehicle.

[0159] Optionally, the interconnected device can configure the floating window in the horizontal screen state based on the horizontal screen floating window size in the case that the screen direction indicated by the screen direction switching notification is the horizontal screen direction. The horizontal screen floating window size can be consistent with the screen size of the mobile terminal in the horizontal screen state, or the horizontal screen floating window size is the same as the screen size of the mobile terminal in the horizontal screen state.

[0160] For example, FIG. 10 shows an implementation schematic diagram of the screen direction switching process in the mirror mode according to an exemplary embodiment of the present application. The mobile terminal and the interconnected device synchronously display the application C screen 1000 in the mirror mode. The application C is a video application, and the application C screen 1000 includes the application C video screen 1010 and the application C content screen 1020. The full screen control 1001 is displayed in the application C video screen 1010, and is used to display the application C video screen 1010 in the mobile terminal in full screen.

[0161] The interconnection device forwards the touch event to the mobile terminal in the case of receiving the touch operation. The mobile terminal determines that the touch operation is used to trigger the full-screen control according to the touch event, and then full-screen displays the application C video picture 1010, and sends a screen direction switching notification to the interconnection device, instructing the interconnection device to configure a horizontal screen floating window in the screen size in the horizontal screen state, and full-window display the application C video picture 1010 in the floating window. In the case that the interconnection device is not touchable, the interconnection device can receive a click operation and forward a click event to the mobile terminal.

[0162] For example, FIG. 11 shows an implementation schematic diagram of a screen direction switching process in the interconnection mode provided by an example embodiment of the present application. The mobile terminal can display a screen-off picture 1101 in the interconnection mode, and the interconnection device displays an application C picture 1102. The application C is a video application, and the application C picture 1102 includes an application C video picture 1103 and an application C content picture 1104. The full-screen control 1105 is displayed in the application C video picture 1103, and is used to full-screen display the application C video picture 1103 in the mobile terminal.

[0163] The interconnection device forwards the touch event to the mobile terminal in the case of receiving the touch operation. The mobile terminal determines that the touch operation is used to trigger the full-screen control according to the touch event, still displays the screen-off picture 1101, full-screen displays the application C video picture 1103 in the background virtual screen, and sends a screen direction switching notification to the interconnection device, instructing the interconnection device to configure a horizontal screen floating window in the screen size in the horizontal screen state, and full-window display the application C video picture 1103 in the floating window. In the case that the interconnection device is not touchable, the interconnection device can receive a click operation and forward a click event to the mobile terminal.

[0164] In some other possible application scenarios, the user can have a demand for full-screen displaying an application interface in the interconnection device. In the case that the mobile terminal projection picture does not interfere with the picture display of the interconnection device, the interconnection device can configure a floating window size to full-screen display the picture provided by the mobile terminal. For example, in the vehicle parking scenario, the vehicle machine can full-screen display the picture provided by the mobile terminal.

[0165] Optionally, in the case that the screen direction indicated by the screen direction switching notification is a horizontal screen direction, the interconnection device can configure the floating window in the full-screen state based on the screen size of the interconnection device.

[0166] In a possible implementation, the interconnection device configures the floating window size to be the same as the screen size of the interconnection device.

[0167] In another possible implementation, the interconnection device configures the floating window in the full-screen state according to a size ratio corresponding to the screen size of the interconnection device.

[0168] For example, FIG. 12 shows an implementation schematic diagram of a screen orientation switching process according to another example embodiment of the present application. Since the interface display of the screen orientation switching process in the mirror mode is similar to that in the interconnection mode, the mobile terminal can keep the screen off in the interconnection mode, and thus the present example is described by taking the mirror mode as an example. The mobile terminal and the interconnection device synchronously display an application C picture 1200 in the mirror mode. The application C is a video application, and the application C picture includes an application C video picture 1201 and an application C content picture 1202. A full screen control 1203 is displayed in the application C video picture, and is used to display the application C video picture 1201 in full screen in the mobile terminal.

[0169] When the interconnection device receives the click operation (touch operation), the interconnection device forwards the click event (touch event) to the mobile terminal. According to the click event (touch event), the mobile terminal determines that the full screen control is triggered, displays the application C video picture 1201 in full screen, and sends a screen orientation switching notification to the interconnection device, instructing the interconnection device to configure a full screen floating window with the screen size of the interconnection device, and display the application C video picture 1201 in full screen.

[0170] It should be noted that when the screen orientation indicated by the screen orientation switching notification is the horizontal screen orientation, the floating window pictures in the mirror mode and the interconnection mode are carried on different virtual screens of the mobile terminal, and thus the screen orientation switching process of the mobile terminal in the mirror mode is different from that in the interconnection mode.

[0171] Optionally, the interconnection device can send a floating window state notification to the mobile terminal after configuring the floating window state to be the full screen state or the horizontal screen state, so as to instruct the floating window state configured by the interconnection device, so that the mobile terminal configures a virtual screen according to the floating window state, and provides a picture.

[0172] In the embodiments of the present application, the interconnection device can configure a floating window matching the screen orientation in the case of screen orientation switching, and improve the adaptation of the floating window to the application picture.

[0173] In the embodiments of the present application, the interconnection device can configure a floating window matching the screen orientation in the case of screen orientation switching, and improve the adaptation of the floating window to the application picture.

[0174] In the case of the horizontal screen orientation, the interconnection device can configure a horizontal screen floating window, so as to reduce the interference of the floating window to the picture display of the interconnection device. The interconnection device can also configure a full screen floating window, so that the floating window can display the application picture in full screen on the interconnection device, and enrich the display mode of the floating window.

[0175] The above embodiments illustrate that the interconnection device, in the case of receiving a triggering operation on the full-screen control of the application in the floating window, configures the landscape floating window to display the application interface.

[0176] In some embodiments, the floating window can also provide a full-screen control, so that the interconnection device displays the application interface in the floating window in full screen.

[0177] Optionally, the interconnection device can send a full-screen instruction to the mobile terminal in response to the triggering operation on the full-screen control in the floating window. The mobile terminal provides a full-screen interface to the interconnection device based on the full-screen instruction. Then, the interconnection device configures the floating window in full screen.

[0178] It should be noted that the full-screen control in the floating window is different from the full-screen control in the application interface. The interconnection device can determine whether the full-screen control in the floating window is triggered, but cannot determine whether the full-screen control in the application interface is triggered. The mobile terminal determines whether the full-screen control in the application interface is triggered by forwarding the event.

[0179] Optionally, in the case that the application can adapt to the screen size of the interconnection device or adapt to the landscape mode of other interconnection devices except the current interconnection device, the mobile terminal can provide a full-screen interface to the interconnection device according to the interface display mode of the application.

[0180] In an exemplary example, a video application can have different interface display modes on different electronic devices. On a smartphone, it can be displayed as a quick browsing page for switching video content by sliding. On an interconnection device such as a tablet, car machine, or television, it can be displayed as a video list page for triggering video playback by clicking. In the case that the current interconnection device is a car machine, and the video application can display the video list page in landscape on the car machine, or can display the video list page in landscape on other interconnection devices such as a tablet, a television, or a personal computer, the mobile terminal provides a full-screen interface to the interconnection device to display the video list page.

[0181] Optionally, the floating window in full screen can also display the application interface in the form of parallel window or stretched screen. The parallel window is a picture adaptation mode designed by the application for a tablet or a folding screen. In the parallel window, the application interface can be displayed as two parallel interfaces. For example, the application homepage and the item detail interface of a shopping application are displayed in the parallel window.

[0182] For example, as shown in FIG. 13, in response to a triggering operation on the full screen control 1300 in the floating window, the interconnection device sends a full screen instruction to the mobile terminal. In the case that application C does not have a display mode adapted to the interconnection device, the interconnection device displays the application C video screen 1303 on one side of the parallel window and the application C content screen 1304 on the other side of the parallel window according to the screen provided by the mobile terminal.

[0183] Optionally, for the application program not adapted to the parallel window, the floating window can display the application interface after the screen is stretched in the full screen state, or display the application interface in the center without changing the screen size of the application interface in the full screen state.

[0184] For example, as shown in FIG. 13, in response to a triggering operation on the full screen control 1300 in the floating window, the interconnection device sends a full screen instruction to the mobile terminal. In the case that application C does not have a display mode adapted to the interconnection device, and is not adapted to the parallel window, the interconnection device displays the application C video screen 1305 and the application C content screen 1306 arranged in up-down direction in the center of the floating window in the full screen state, or displays the application C video screen 1307, the application C content screen 1308, and the application C video directory screen 1309 hidden outside the screen before the screen is stretched in the stretched screen according to the screen provided by the mobile terminal.

[0185] Optionally, in response to a re-triggering operation on the full screen control 1300 in the floating window, the interconnection device sends a recovery instruction to the mobile terminal. The mobile terminal provides a vertical screen to the interconnection device based on the recovery instruction, so that the interconnection device configures the floating window in the vertical screen state based on the vertical screen size.

[0186] In some embodiments, the floating window state includes a horizontal screen state, a vertical screen state, and a full screen state. The floating window size in the horizontal screen state and the vertical screen state is determined based on the screen size of the mobile terminal, and the floating window size in the full screen state is determined based on the screen size of the interconnection device. The mirror virtual screen size needs to be determined based on the screen size of the mobile terminal, and the background virtual screen can be determined based on the screen size of the mobile terminal or the screen size of the interconnection device. Since the size of the mirror virtual screen cannot be determined based on the screen size of the interconnection device, the screen needs to be moved from the mirror virtual screen to the background virtual screen when switching the full screen floating window in the mirror mode.

[0187] Referring to FIG. 14, FIG. 14 is a schematic diagram of a display screen of the interconnected device in a parallel window mode according to an example embodiment of the present application. When the interconnected device receives a click operation on the full screen control 1401 in the floating window, the interconnected device displays the application C parallel window content A and the application C parallel window content B in the parallel window 1402. Since the size of the full screen floating window is different from the size of the horizontal screen floating window, the full screen floating window needs to be switched in the mirror mode, the mirror virtual screen needs to be closed, the background virtual screen needs to be started, and the screen needs to be carried on the background virtual screen to obtain a full screen, so that the mobile terminal is switched from displaying the application C screen 1400 to displaying the desktop home page 1403 when the parallel window 1402 is displayed. Optionally, the mobile terminal can also be turned off.

[0188] In the example embodiment, the interconnected device can configure the full screen floating window and display a full screen when receiving a trigger operation on the full screen control in the floating window, so that the application screen in the floating window can be played in full screen without the application program providing a full screen control, which enriches the display function of the floating window.

[0189] In some example embodiments, the interconnected device can select the application program allowed to be displayed on the interconnected device from the application programs in the mobile terminal, and display the first application icon corresponding to the filtered application program in the application starting interface.

[0190] Referring to FIG. 15, FIG. 15 is a flowchart of a display process of the first application icon according to an example embodiment of the present application. The process includes the following steps.

[0191] In step 1501, the interconnected device receives the first application list sent by the mobile terminal, and the first application list contains the application programs in the mobile terminal.

[0192] In some example embodiments, the mobile terminal notifies the interconnected device of the application programs in the mobile terminal by sending the first application list. The first application list only needs to store the probability information of the application programs in the mobile terminal, such as the package name of the application program and the ID of the application program. Optionally, the first application list can contain all the application programs in the mobile terminal which can be projected to the interconnected device.

[0193] In step 1502, the second application list is determined based on the first application list, and the second application list contains the application programs filtered from the first application list.

[0194] In some example embodiments, the second application list is the list of the application programs allowed to display the first application icon in the application starting interface of the interconnected device in the first application list.

[0195] Optionally, in order to avoid repeated display of application icons, the interconnection device can select the mobile terminal application program that is not repeated with the local application program according to the repetition of the local application program and the application program on the mobile terminal, and display the corresponding first application icon.

[0196] In some embodiments, the second application list can also be the application program list of the application program allowed to display the application screen in the floating window of the interconnection device in the first application list.

[0197] Optionally, in order to protect user privacy, the interconnection device can be internally provided with an application program white list, which is used to record the application programs allowed to be started by the interconnection device. The white list can be customized by the user. The interconnection device adds the application programs existing in the white list in the first application list to the second application list.

[0198] Optionally, in order to maintain the security of the interconnection device and the mobile terminal, the interconnection device can also be provided with an application program black list, which is used to prohibit the application program from starting malicious programs through interface jumping. The interconnection device removes the application programs existing in the black list from the first application list to obtain the second application list.

[0199] Step 1503, based on the second application list, an application information acquisition request is sent to the mobile terminal, and the application information acquisition request is used to acquire the application information of the application program in the second application list.

[0200] In some embodiments, the application information of the application program in the second application list is the application information required for displaying the first application icon in the application start interface of the interconnection device. Optionally, the application information can include application name, application package name, application ID, application icon, etc.

[0201] In one possible scenario, the interconnection device can make the screen jump to the application screen of the application program outside the second application list through the application jump between the application programs.

[0202] In another possible scenario, the interconnection device can receive a triggering operation on the second application icon in the mirror mode, prompting the mobile terminal to start the application program outside the second application list.

[0203] In order to solve the problems in the above scenarios and avoid the application program not belonging to the second application list to display the application screen in the interconnection device, optionally, the mobile terminal can record the second application list according to the application information acquisition request, and avoid providing the interconnection device with the application screen of the application program outside the second application list.

[0204] In some embodiments, in the case that the second application icon in the display screen of the floating window is triggered, the display screen of the floating window is provided by the mobile terminal, and the response logic of the triggering operation of the second application icon is also completed by the mobile terminal.

[0205] Optionally, the interconnection device can display the application screen in the floating window in response to the triggering operation of the second application icon in the display screen of the floating window, and in the case that the target application program indicated by the triggering operation belongs to the second application list.

[0206] In a possible implementation, in the case that the interconnection device receives the interaction operation of the user on the content of the display screen of the floating window, such as the PC receives the click operation of the user, or the PAD receives the touch operation of the user, the interconnection device sends the reverse control instruction containing the interaction event to the mobile terminal, and the reverse control instruction is used to trigger the target application program to start. In the case that the mobile terminal determines that the interaction operation of the user indicated by the interaction event is the triggering operation of the second application icon in the display screen of the floating window, and the mobile terminal determines that the target application program indicated by the triggering operation belongs to the second application list, the mobile terminal provides the application screen to the interconnection device, and then the interconnection device displays the application screen in the floating window.

[0207] Optionally, the interconnection device can also display the application start failure prompt information in response to the triggering operation of the second application icon in the display screen of the floating window, and in the case that the target application program indicated by the triggering operation does not belong to the second application list. For example, the interconnection device displays "the application is prohibited to start", or displays "application start failure".

[0208] In a possible implementation, in the case that the interconnection device receives the interaction operation of the user on the content of the display screen of the floating window, the interconnection device sends the reverse control instruction containing the interaction event to the mobile terminal, and the reverse control instruction is used to trigger the target application program to start. In the case that the mobile terminal determines that the interaction operation of the user indicated by the interaction event is the triggering operation of the second application icon in the display screen of the floating window, and the mobile terminal determines that the target application program indicated by the triggering operation does not belong to the second application list, the mobile terminal prohibits the target application program to start, and informs the interconnection device of the start failure, and then the interconnection device displays the application start failure prompt information in the floating window.

[0209] In step 1504, the first application icon is displayed in the application start interface based on the application information sent by the mobile terminal.

[0210] Optionally, the interconnection device can display the first application icon in the application start interface according to the application information sent by the mobile terminal and the specific pattern, so as to distinguish the application icon of the local application program on the interconnection device and the first application icon. The interconnection device can also change the color of the application name and the like, and the embodiments of the present application do not perform.

[0211] In the embodiments of the present application, the interconnection device can determine the application program displaying the first application icon by screening the first application list provided by the mobile terminal, so as to avoid the same application program existing in the interconnection device and the mobile terminal from displaying the application icon repeatedly and causing application function redundancy.

[0212] The interconnection device can also receive the triggering operation on the second application icon, and display the application screen of the application program in the second application list in the floating window in the case that the triggered target application program belongs to the second application list, so as to avoid displaying the application interface of the application program outside the second application list.

[0213] In the case that the triggered target application program belongs to the second application list, the interconnection device can provide an application start failure prompt information to indicate that the application cannot be started, thereby improving the information feedback capability of the floating window.

[0214] In order to realize the above functions, the mobile terminal needs to perform instruction interaction with the interconnection device and provide the screen to the interconnection device according to the instruction. The following embodiments mainly illustrate the application display method from the mobile terminal side.

[0215] In some embodiments, the mobile terminal provides the screen to the interconnection device by sending the screen data to the interconnection device, and the interconnection device displays the screen in the floating window according to the screen data provided by the mobile terminal.

[0216] Referring to FIG. 16, FIG. 16 is a flowchart of the mobile terminal side application display method provided by an exemplary embodiment of the present application. The method includes the following steps.

[0217] Step 1601, in the case that the communication connection with the interconnection device is established, screen data is sent to the interconnection device, and the interconnection device is used to display the screen provided by the mobile terminal in the floating window in the application start interface based on the screen data.

[0218] Optionally, the communication connection between the interconnection device and the mobile terminal can be WIFI connection, Bluetooth connection, wired connection and the like, and the embodiments of the present application do not limit the communication connection mode between the interconnection device and the mobile terminal.

[0219] In some embodiments, the screen data sent by the mobile terminal is used to support the interconnection device to realize the screen display. In the case that the interconnection device needs to display different screens, the mobile terminal provides different screen data for the interconnection device.

[0220] Optionally, the picture data provided by the mobile terminal for the interconnection device can include picture data for displaying a home page picture, and picture data for displaying an application picture of an application program. The home page picture and the application picture are displayed in the floating window of the interconnection device. The home page picture is used to display application icons of the application programs in the mobile terminal, so as to subsequently trigger the display of the application picture.

[0221] In some embodiments, the application start interface is used to display the application icons, so that the interconnection device starts the application program upon receiving a triggering operation on the application icon. The application start interface of the interconnection device displays the application icons of the local application programs of the interconnection device, and the first application icons of the application programs in the mobile terminal.

[0222] Step 1602, starting the target application program, the target application program being the first application icon in the application start interface, or the application program indicated by the second application icon in the picture displayed by the floating window, the first application icon and the second application icon being the icons of the application programs in the mobile terminal.

[0223] In some embodiments, the first application icon is used to realize the quick start of the application program on the mobile terminal. In order to distinguish the first application icon from the application icons of the application programs on the interconnection device, optionally, the interconnection device can display an application mark on the first application icon when displaying the first application icon, indicating that the application program originates from the mobile terminal. The application mark can be a specific pattern, such as a mobile terminal pattern. Optionally, the interconnection device can also change the display color of the application name of the application program on the mobile terminal on the interconnection device, and the present application does not limit the distinguishing method of the first application icon representing the application and the local application of the interconnection device.

[0224] In some embodiments, the second application icon is the icon of the application program in the mobile terminal displayed in the floating window. Optionally, the second application icon in the floating window and the first application icon in the application start interface can represent the same application program, or can represent different application programs. For example, the second application icon includes the application icons of all the application programs in the mobile terminal, and the first application icon includes the application icons of part of the application programs that allow quick start.

[0225] In some embodiments, the interconnection device sends a program start instruction to the mobile terminal in response to the triggering operation on the first application icon in the application start interface or the second application icon in the picture displayed by the floating window, and the mobile terminal starts the target application program indicated by the program start instruction upon receiving the program start instruction.

[0226] Step 1603, sending picture data of the target application program to the interconnection device, and the interconnection device is used to display the running picture of the target application program in the floating window based on the picture data of the target application program.

[0227] Optionally, the picture data sent by the mobile terminal can be audio and video stream data, including at least one of audio data and video data. When the audio and video stream data is audio stream data, the interconnection device plays the audio data corresponding to the audio stream data through a sound playing unit such as a sound box; when the audio and video stream data is video stream data, the interconnection device plays the video data corresponding to the video stream data in the floating window; when the audio and video stream data is both audio stream data and video stream data, the sound playing unit of the interconnection device plays the audio data corresponding to the audio stream data, and simultaneously plays the video data corresponding to the video stream data in the floating window.

[0228] In the embodiments of the present application, the mobile terminal can send picture data to the interconnection device in the case that the interconnection device starts the application program of the mobile terminal through the first application icon of the application starting interface or through the second application icon in the floating window, so as to support the interconnection device to start the application program in different manners and realize the multi-entry starting of the application program in the mobile terminal on the interconnection device. Moreover, the picture data provided by the mobile terminal is used to display the picture in the floating window, instead of in a newly created window, which is beneficial to reduce the interference of the application picture of the mobile terminal on the interconnection device.

[0229] In some embodiments, the floating window displayed by the interconnection device has different floating window modes, and the picture data provided by the mobile terminal is different in different floating window modes. The floating window modes include a mirror mode and an interconnection mode.

[0230] It should be noted that when the mobile terminal provides picture data for the interconnection device, the mobile terminal needs to first determine the display picture carried by the virtual screen in the mobile terminal, and then send the picture data corresponding to the display picture to the interconnection device, so as to display the corresponding picture in the floating window.

[0231] In some embodiments, the virtual screen adopted by the mobile terminal is different in different floating window modes. In the mirror mode, the mobile terminal uses a mirror virtual screen to carry a mirror picture. Since the application program is started in the mirror mode, the application program is actually started on the screen of the mobile terminal, and thus the content of the mirror picture is consistent with the display content of the screen of the mobile terminal. In the case that the mobile terminal is in the screen-off state, the mirror picture display is interrupted.

[0232] In the interconnection mode, the mobile terminal uses a background virtual screen to carry an interconnection picture. The background virtual screen is different from the mirror virtual screen, and the background virtual screen does not need to synchronously display the same picture as the screen of the mobile terminal, but determines the display content of the interconnection picture in the background of the mobile terminal, and then determines the picture data corresponding to the interconnection picture. In the interconnection mode, the mobile terminal can be in the screen-off state.

[0233] In some embodiments, the mobile terminal performs different picture data sending steps in different floating window modes.

[0234] Optionally, the mobile terminal sends picture data of a mirror picture to the interconnection device in the case that the floating window is in the mirror mode. The mirror picture is carried in a mirror virtual screen. The interconnection device receives the picture data and displays the mirror picture in the floating window in the mirror mode. The mirror picture can be understood as a projection of the content of the screen of the mobile terminal.

[0235] Optionally, the mobile terminal sends picture data of an interconnection picture to the interconnection device in the case that the floating window is in the interconnection mode. The interconnection picture is a picture of a customized user interface in the interconnection mode. The interconnection mode refers to a mode in which the interconnection device and the mobile terminal establish a communication connection. The interconnection picture is carried in a background virtual screen. The interconnection device receives the picture data and displays the interconnection picture in the floating window in the interconnection mode.

[0236] The customized user interface includes a second application icon. The user can customize the display content of the customized user interface, such as filtering the second application icon displayed in the floating window, adjusting the display form and arrangement position of the second application icon. It should be noted that the content adjustment in the customized user interface does not affect the screen picture of the mobile terminal.

[0237] Optionally, the customized user interface can also display important information in the form of a card, such as schedule information, incoming call information, new message prompt information, music information, etc. The customized user interface can support page turning. The information card is displayed in the main interface, and the second application icon of other application is displayed in other interface. The user can select to add or delete the application displayed in the customized user interface. Optionally, the second application icon of the frequently used application can also be displayed at the bottom of the customized user interface, so as to realize the quick start of the frequently used application.

[0238] In some embodiments, after the interconnection device and the mobile terminal establish a communication connection, the floating window can display the mirror picture in the mirror mode by default, or display the interconnection picture in the interconnection mode by default. The default floating window mode after the connection is established can be determined by a configuration operation. The floating window mode can also be kept as the floating window mode used in the historical communication connection.

[0239] Optionally, after the interconnection device and the mobile terminal establish a communication connection, the floating window mode can be determined by the interconnection device and notified to the mobile terminal, or determined by the mobile terminal and notified to the interconnection device.

[0240] In some embodiments, in the case that the floating window mode is determined by the interconnection device, in the case that the mobile terminal has established a communication connection with the interconnection device, the interconnection device sends a mode enabling instruction to the mobile terminal, and the mobile terminal receives the mode enabling instruction sent by the interconnection device. The mode enabling instruction is used to indicate the floating window mode of the floating window enabling. Then, the mobile terminal generates the picture data based on the floating window mode indicated by the mode enabling instruction.

[0241] In a possible implementation, the mobile terminal receives a mode enabling instruction indicating a default floating window mode, which is configured inside the interconnection device.

[0242] In another possible implementation, the interconnection device records a historical floating window mode. In the case that the floating window mode does not change, the mobile terminal receives a mode enabling instruction sent by the interconnection device, which indicates the historical floating window mode. For example, the historical floating window mode is the interconnection mode, the mode enabling instruction indicates that the floating window enables the interconnection mode, in the case that the floating window mode is switched from the interconnection mode to the mirror mode and the communication connection between the interconnection device and the mobile terminal is disconnected, the historical floating window mode becomes the mirror mode, and the interconnection device subsequently sends a mode enabling instruction to the mobile terminal, which indicates the mirror mode.

[0243] Optionally, in the case that the interconnection device is a car machine, the floating window mode can also be determined according to the number of occupants. Since the floating window is synchronously displayed with the mobile terminal in the mirror mode, it is easy to leak the private information of the user. The display content of the customized user interface in the interconnection mode can be defined by the user, which is beneficial to protect the personal privacy. In the case that the number of occupants of the vehicle is small, such as a single driving scenario, the interconnection device can adopt the mirror mode to enjoy rich mobile terminal services, and in the case that the number of occupants is large, such as a passenger carrying scenario, the interconnection device can adopt the interconnection mode to protect the user privacy.

[0244] In yet another possible implementation, in the case that the interconnection device is a car machine, the car machine records a correspondence between the number of occupants and the floating window mode. In the case that the number of occupants is one, the interconnection device sends a mode enabling instruction to the mobile terminal, which indicates the mirror mode, and in the case that the number of occupants is at least two, the interconnection device sends a mode enabling instruction to the mobile terminal, which indicates the interconnection mode.

[0245] In some other embodiments, in the case that the floating window mode is determined by the mobile terminal, the mobile terminal can send a mode enabling instruction to the interconnection device based on a mode setting operation in the case that the mobile terminal has established a communication connection with the interconnection device and has received the mode setting operation. The mode setting operation is used to set the floating window mode of the floating window at the interconnection device. The interconnection device is used to receive the mode enabling instruction sent by the mobile terminal, and then configure the floating window based on the floating window mode indicated by the mode enabling instruction. Then, the mobile terminal generates the picture data based on the floating window mode indicated by the mode setting operation.

[0246] Optionally, the mode setting operation can include a triggering operation on the mode setting control, a voice input operation, a shortcut gesture operation, or the like for setting the floating window mode, and the embodiments of the present application do not limit the specific operation mode of the mode setting operation.

[0247] Optionally, the mobile terminal can configure a default floating window mode, record a historical floating window mode, and also record a corresponding relationship between a scene and a floating window mode.

[0248] In a possible implementation, the mobile terminal determines a current scene according to a device connection condition, a current location, a current time, and sensor data. In a case where the current scene is a user-alone scene, the interconnected device receives a mode enabling instruction indicating the mirroring mode sent by the mobile terminal. In a case where the current scene is a public scene, the interconnected device receives a mode enabling instruction indicating the interconnected mode sent by the mobile terminal.

[0249] For example, in a case where the mobile terminal establishes a communication connection with an electronic device under a different user account or a stranger device, or in a case where the current time, location, and sensor data represent that the mobile terminal is in a public scene, such as a holiday travel scene, a commuting scene, or the like, for example, the light sensor detects that the current scene is bright, the mobile terminal determines that the current scene is a public scene, and sends a mode enabling instruction indicating the interconnected mode to the interconnected device. In a case where the mobile terminal establishes a communication connection with an electronic device under the same user account, or in a case where the current time, location, and sensor data represent that the mobile terminal is in an alone scene, such as a home scene, a lunch break scene, or the like, for example, the light sensor detects that the current scene is dark, the mobile terminal determines that the current scene is an alone scene, and sends a mode enabling instruction indicating the mirroring mode to the interconnected device.

[0250] Regarding the floating window configuration process, optionally, the mobile terminal first creates a virtual screen according to the floating window mode, then carries a display picture corresponding to the floating window mode on the virtual screen, encodes the continuous display pictures to obtain video stream data, and finally sends the video stream data to the interconnected device, so as to configure the floating window display picture by the interconnected device.

[0251] In a possible implementation, in a case where the mirroring mode is started, the interconnected device sends a request for starting the mirroring mode floating window to the mobile terminal by calling a program interface. The mobile terminal calls an internal system interface to create a mirroring virtual screen, and notifies the interconnected device that the preparation is completed, and then the interconnected device creates the floating window. In a case where the mobile terminal displays the mirroring virtual screen has content update, the mobile terminal encodes the picture content of the mirroring virtual screen, packs in a specified format, and then sends to the interconnected device. The interconnected device receives the video stream data, and draws a picture according to the decoded video stream data on the floating window.

[0252] In another possible implementation, in the case of starting the interconnection mode, the interconnection device sends a request for starting the interconnection mode floating window to the mobile terminal by calling a program interface. The mobile terminal calls an internal system interface to create a background virtual screen and informs the interconnection device that the preparation is completed. Then, the interconnection device creates the floating window, and the mobile terminal starts the customized user interface on the background virtual screen. In the case of content update of the background virtual screen, the mobile terminal encodes the picture content of the background virtual screen, packs the picture content in a specified format, and then sends the picture content to the interconnection device. The interconnection device receives the video stream data, draws the picture according to the decoded video stream data, and displays the picture on the floating window. The display content of the background virtual screen is not displayed on the screen of the mobile terminal.

[0253] In some embodiments, the floating window mode can be flexibly switched between the mirroring mode and the interconnection mode, and the mode switching is realized by a switching operation. Alternatively, the switching operation of the floating window mode can be received by the mobile terminal or the interconnection device.

[0254] In the case that the switching operation of the floating window mode is received by the interconnection device, the interconnection device switches the floating window mode of the floating window in response to a triggering operation on a mode switching control in the floating window, and then sends a mode switching instruction to the mobile terminal. The mobile terminal receives the mode switching instruction sent by the interconnection device. The mode switching instruction is used to indicate the switching of the floating window mode of the floating window. Then, the mobile terminal generates picture data based on the switched floating window mode indicated by the mode switching instruction, and sends the picture data to the interconnection device, so as to provide the interconnection device with a picture that meets the switched floating window mode.

[0255] In some embodiments, in the case that the mobile terminal receives the mode switching instruction sent by the interconnection device or receives the switching operation of the floating window mode, the mobile terminal first destroys the virtual screen used to carry the picture before the mode switching, and then creates a virtual screen that matches the switched floating window mode. After the creation of the virtual screen is successful, the mobile terminal generates picture data according to the picture carried by the virtual screen, and sends the picture data to the interconnection device.

[0256] In some embodiments, the mode switching instruction contains a mode switching event, and the mode switching event is used to indicate the switching of the floating window mode of the floating window.

[0257] In a possible implementation, the interconnection device sends a mode switching event to the mobile terminal in response to a triggering operation on the mode switching control in the floating window, and the mobile terminal first closes the current virtual screen and then creates a virtual screen in accordance with the floating window mode after switching. In this case, the mobile terminal starts a customized user interface in the background virtual screen when the background virtual screen is created. Subsequently, the mobile terminal feeds back a mode switching success message to the interconnection device, draws a picture in the newly created virtual screen, generates picture data, and sends the picture data to the interconnection device.

[0258] In addition, in the case where the switching operation of the floating window mode is implemented by the mobile terminal, the mobile terminal sends a mode switching instruction to the interconnection device when the mode switching operation is received. In this case, the mode switching operation is used to switch the floating window mode of the floating window at the interconnection device, and the interconnection device is configured to configure the floating window based on the floating window mode after switching indicated by the mode switching instruction. Then, the mobile terminal generates picture data based on the floating window mode after switching indicated by the mode switching operation, and sends the picture data to the interconnection device, so as to provide the interconnection device with a picture in accordance with the floating window mode after switching.

[0259] In a possible implementation, the mobile terminal sends a mode switching event to the interconnection device when the mode switching operation is received, so that the interconnection device configures the floating window based on the floating window mode after switching indicated by the mode switching instruction. In addition, the mobile terminal closes the current virtual screen and then creates a virtual screen in accordance with the floating window mode after switching. In this case, the mobile terminal starts a customized user interface in the background virtual screen when the background virtual screen is created. Subsequently, the mobile terminal interacts with the interconnection device to feed back a mode switching success message, draws a picture in the newly created virtual screen, generates picture data, and sends the picture data to the interconnection device.

[0260] Optionally, the mode switching operation can include a triggering operation on a control, a voice input operation, a gesture operation, etc., which are not limited in the embodiment.

[0261] In some embodiments, the picture data generation process is different in different floating window mode switching processes.

[0262] In a possible implementation, the mobile terminal determines to switch to the interconnection mode when the mode switching instruction sent by the interconnection device is received or the switching operation of the floating window mode is received in the mirroring mode. The mobile terminal first destroys the mirroring virtual screen, creates a background virtual screen, and then generates picture data based on the interconnection picture carried by the background virtual screen and sends the picture data to the interconnection device.

[0263] In another possible implementation, the mobile terminal determines to switch to the mirror mode when receiving a mode switching instruction sent by the interconnection device in the interconnection mode, or receiving a switching operation of the floating window mode, the mobile terminal first destroys the background virtual screen, creates a mirror virtual screen, and then generates picture data according to a mirror picture carried by the mirror virtual screen, and sends the picture data to the interconnection device.

[0264] In the embodiments of the present application, the display modes of the floating window pictures in different floating window modes are different, and the picture data provided by the mobile terminal is also different, wherein the picture data for displaying the customized user interface can be provided in the interconnection mode, which is beneficial to guarantee the user privacy; the picture data for displaying the mirror picture can be provided in the mirror mode, which is beneficial to the mobile terminal to provide rich services, the mirror picture conforms to the operation habit of the mobile terminal, and the operation convenience can be improved.

[0265] In the case that the interconnection device and the mobile terminal establish a communication connection, the floating window mode can be determined by the interconnection device or the mobile terminal, the mode switching can be initiated by the interconnection device or the mobile terminal, and the floating window mode can be synchronized between the interconnection device and the mobile terminal through instruction interaction, which is beneficial to improve the setting flexibility of the floating window mode.

[0266] The following embodiments take the interconnection device as a car machine and the mobile terminal as a mobile phone as an example, and describe the floating window starting process in the case that the car machine sends a mode starting instruction to the mobile phone, and describe the floating window mode switching process in the case that the car machine receives a mode switching operation.

[0267] It should be noted that the mode starting instruction can also be sent by the mobile phone to the car machine, and the mode switching operation can also be received by the mobile phone and then the car machine is notified of the mode switching event, and since the execution logic is similar, the embodiments of the present application will not be described herein.

[0268] The car machine is provided with a Carlink HMI and a car machine SDK, the mobile phone is provided with a mobile phone SDK, an interconnection management program and a mobile phone system, and a third-party application program is installed on the mobile phone. The car machine and the mobile phone realize data interaction through the Carlink protocol. Optionally, different communication protocols can be used between the interconnection device and the mobile terminal according to actual needs, and the mobile phone system on the mobile phone can be an Android system or other system.

[0269] Referring to FIG. 17, FIG. 17 is a timing diagram of a floating window starting process in a mirror mode according to an example embodiment of the present application. The Carlink HMI 1701 and the car machine SDK 1702 of the car machine, the mobile phone SDK 1703, the interconnection management program 1704 and the mobile phone system 1705 of the mobile phone are shown in the figure.

[0270] After the car machine and the mobile phone establish a communication connection, the Carlink HMI 1701 calls the car machine SDK 1702 interface, requests to start the floating window in mirror mode; the car machine SDK 1702 sends an enable mode event to the mobile phone SDK 1703 through the Carlink protocol, which represents the enablement of mirror mode; the mobile phone SDK 1703 then calls back to notify the interconnection management program 1704 of the enable mode event, that is, forwards the enable mode event; after receiving the enable mode event, the interconnection management program 1704 calls the mobile phone system 1705 interface to create a mirror virtual screen.

[0271] Subsequently, the interconnection management program 1704 calls the mobile phone SDK 1703 interface to notify the car machine SDK 1702 of the mode change, that is, notifies the car machine SDK 1702 of the mode change message through the Carlink protocol; the car machine SDK 1702 calls back to notify the Carlink HMI 1701 of the mode change message, so as to determine that the mobile phone is ready; the Carlink HMI 1701 then applies for a floating window according to the current mode state information, and subsequently calls the SDK interface to update the screen parameters, and then updates the surface container.

[0272] After receiving the mode change message, the car machine SDK 1702 returns an ACK (Acknowledge character) to the interconnection management program 1704 through the mobile phone SDK 1703; the interconnection management program 1704 starts to push the stream.

[0273] In the case of virtual screen content update, the interconnection management program 1704 pushes the encoded audio and video stream to the car machine SDK 1702 through the Carlink protocol; the car machine SDK 1702 decodes the audio and video stream, renders and outputs to the surface container, and applies rotation and plays sound.

[0274] Among them, the application rotation refers to adjusting the floating window to full screen or landscape display application picture when the application rotation is detected. The audio and video stream is encoded by the interconnection management program 1704 using an encoder, and the encoded audio and video stream is packaged in a specified format and sent to the car machine SDK 1702, such as RTP (Real-Time Transport Protocol) message format.

[0275] It should be noted that the difference between mirror mode and interconnection mode is only that the mobile terminal creates different virtual screens and carries different pictures on the virtual screens, and the data interaction mode between the interconnection device and the mobile terminal in the mirror mode and the interconnection mode is basically the same.

[0276] In some embodiments, the Carlink HMI 1701 of the car machine first notifies the car machine SDK 1702 of an enable mode event, and then the car machine SDK 1702 forwards the notification to the mobile phone SDK 1703, and the mobile phone SDK 1703 calls the interconnection management program 1704 in turn, the interconnection management program 1704 calls the system interface to create a virtual screen, and then sends a mode change message to the car machine, and the car machine SDK 1702 of the car machine responds to the interconnection management program 1704 to confirm the message, so that the interconnection management program 1704 pushes the audio and video stream subsequently.

[0277] Specifically, the floating window starting process in the interconnection mode is as follows. Referring to FIG. 18, FIG. 18 is a timing diagram of a floating window starting process in an interconnection mode according to an example embodiment of the present application. The Carlink HMI 1801 and the car machine SDK 1802 of the car machine, the mobile phone SDK 1803, the interconnection management program 1804 and the mobile phone system 1805 are shown in the figure.

[0278] After the car machine and the mobile phone establish a communication connection, the Carlink HMI 1801 calls the car machine SDK 1802 interface to request to start the floating window in the interconnection mode; the car machine SDK 1802 sends an enable mode event to the mobile phone SDK 1803 through the Carlink protocol to represent the enablement of the interconnection mode; the mobile phone SDK 1803 then calls the interconnection management program 1804 to notify the enable mode event, that is, forwards the enable mode event; after receiving the enable mode event, the interconnection management program 1804 calls the mobile phone system 1805 interface to create a background virtual screen.

[0279] It should be noted that the difference between the mirror mode and the interconnection mode also includes that, in the case that the background virtual screen is successfully created, the mobile phone system 1805 will start a customized user interface on the current virtual screen.

[0280] In the case that the background virtual screen is successfully created, the interconnection management program 1804 calls the mobile phone SDK 1803 interface to notify the car machine SDK 1802 of the mode change, that is, notifies the car machine SDK 1802 of the mode change message through the Carlink protocol; the car machine SDK 1802 calls the Carlink HMI 1801 to notify the mode change message, so as to determine that the mobile phone is ready; the Carlink HMI 1801 then applies for a floating window according to the current mode state information, and subsequently calls the SDK interface to update the screen projection parameters, and then updates the surface container.

[0281] After receiving the mode change message, the car machine SDK 1802 returns ACK to the interconnection management program 1804 through the mobile phone SDK 1803; the interconnection management program 1804 starts streaming.

[0282] In the case of virtual screen content update, the interconnection management program 1804 pushes the encoded audio and video stream to the car machine SDK 1802 through the Carlink protocol; the car machine SDK 1802 decodes the audio and video stream, renders the output to the surface container, and applies rotation and plays the sound.

[0283] Wherein, the application rotation refers to adjusting the floating window to full screen or landscape display application picture when detecting application rotation. The audio and video stream is encoded by the interconnection management program 1804 using the encoder, and the encoded audio and video stream is packaged in a specified format and sent to the car machine SDK 1802, such as RTP message format.

[0284] In some embodiments, in the case that the car machine receives a mode switching operation, the floating window mode can be flexibly switched according to the mode switching operation. Since the bidirectional switching process between the mirror mode and the interconnection mode is similar, the present application takes the switching from the mirror mode to the interconnection mode as an example to illustrate the mode switching process, and the specific process is as follows.

[0285] Referring to FIG. 19, FIG. 19 is a timing diagram of the mode switching process provided by an exemplary embodiment of the present application. The figure shows the Carlink HMI 1901 and the car machine SDK 1902 of the car machine, the phone SDK 1903, the interconnection management program 1904 and the phone system 1905 of the mobile phone.

[0286] In the case that the user clicks the mode switching button, the Carlink HMI 1901 calls the SDK interface to request switching to the interconnection mode, and displays the mode switching animation; the car machine SDK 1902 sends the request to the phone SDK 1903 through the Carlink protocol after encapsulation, and notifies the phone SDK 1903 of the mode switching event; the phone SDK 1903 calls back and notifies (forwards) the mode switching event to the interconnection management program 1904; the interconnection management program 1904 destroys the mirror virtual screen, releases the related resources, and then calls the phone system 1905 interface to create a background virtual screen.

[0287] It should be noted that in the case of switching to the interconnection mode, the interconnection management program 1904 needs to additionally call the phone system 1905 interface to start the customized user interface on the current virtual screen, and in the case of switching to the mirror mode, this step does not need to be performed.

[0288] In the case of successful creation of the background virtual screen, the interconnection manager 1904 calls the mobile phone SDK 1903 to notify the car machine SDK 1902 of successful change of the floating window mode, wherein the mobile phone SDK 1903 encapsulates the mode change message through the Carlink protocol and sends it to the car machine SDK 1902; the car machine SDK 1902 calls back to notify the Carlink HMI 1901 of the mode change message; the Carlink HMI 1901 applies for a floating window according to the current mode state information, and subsequently calls an SDK interface to update the screen parameters, and then updates the surface container; and the Carlink HMI 1901 cancels the switching animation and updates the floating window mode prompt.

[0289] In the case of virtual screen content update, the interconnection manager 1904 pushes the encoded audio and video stream to the car machine SDK 1902 through the Carlink protocol; the car machine SDK 1902 decodes the audio and video stream, renders and outputs it to the surface container, and applies rotation and plays the sound.

[0290] Among them, the application rotation refers to adjusting the floating window to full screen or landscape display application picture when the application rotation is detected. The audio and video stream is encoded by the interconnection manager 1904 using an encoder, and the encoded audio and video stream is packaged in a specified format and sent to the car machine SDK 1902, such as RTP message format.

[0291] In some embodiments, the interconnection device can display a home page return control in the floating window, which is different from the return control used for performing a single return operation, such as returning to the historical page before page jumping after page jumping, and the home page return control is used for returning to the main interface.

[0292] Optionally, the mobile terminal can first receive the home page return instruction sent by the interconnection device, then close the target application based on the home page return instruction, and send the screen data of the home page picture to the interconnection device. Among them, the home page picture is different in different floating window modes, and in the mirror mode, the home page is the desktop home page of the mobile terminal, and in the interconnection mode, the home page is the home page of the customized user interface. The interconnection device is used to display the home page picture in the floating window based on the screen data of the home page picture.

[0293] In a possible implementation, the interconnection device sends a home page return event to the mobile terminal in response to the triggering operation of the home page return control, and the home page return event is contained in the home page return instruction. The mobile terminal calls a system interface to update the application picture to the home page of the application program in the virtual screen, and then sends a successful home page return notification to the interconnection device and sends the screen data of the home page picture.

[0294] In a possible implementation scenario, the mobile terminal first provides the mirror mode to the interconnection device with the picture data of the desktop homepage of the mobile terminal, and meanwhile the mobile terminal displays the desktop homepage picture. In the case that the interconnection device receives a triggering operation on the first application icon in the application starting interface or receives a triggering operation on the second application icon on the desktop homepage in the floating window, the operation instruction is fed back to the mobile terminal, the mobile terminal stops providing the picture data of the desktop homepage, and then provides the picture data of the application interface of the currently started application, which is displayed in both the floating window and the mobile terminal. Subsequently, the mobile terminal switches the floating window mode to the interconnection mode. In the case that the mobile terminal is screen-off, the mobile terminal still provides the picture data of the application picture. The mobile terminal subsequently receives the homepage returning instruction sent by the interconnection device, and provides the picture data of the customized user interface homepage to the interconnection device, instead of the picture data of the desktop homepage.

[0295] In the embodiments of the present application, since the homepages in different floating window modes are different, the mobile terminal can provide the picture data of the homepage corresponding to the current floating window mode in the case that the homepage returning instruction is received, so that the floating window has the homepage returning capability, and the functional richness of the floating window is improved.

[0296] In some embodiments, in order to avoid that the floating window shields the display picture of the interconnection device, the floating window provides a closing control. The interconnection device also provides a floating window floating mark to display the floating window again. The mobile terminal determines whether to send the picture data according to the floating window opening and closing instruction fed back by the interconnection device.

[0297] In some embodiments, the interconnection device sends a floating window closing instruction to the mobile terminal in response to the triggering operation on the closing control in the floating window, and stops displaying the floating window. The mobile terminal receives the floating window closing instruction sent by the interconnection device. The floating window closing instruction is sent in the case that the triggering operation on the closing control in the floating window is received, and the interconnection device displays the floating window floating mark in the case that the floating window is stopped from being displayed. Then, the mobile terminal stops sending the picture data to the interconnection device based on the floating window closing instruction.

[0298] Optionally, the floating window floating mark can display the connection status of the mobile terminal and the interconnection device, such as the terminal name and the connection status of the mobile terminal in communication connection with the interconnection device.

[0299] Optionally, the floating window closing instruction can include a stop application event, which instructs the mobile terminal to exit the application program.

[0300] In a possible implementation, the interconnection device sends a stop application event to the mobile terminal in response to the triggering operation on the closing control in the floating window, and the stop application event is included in the floating window closing instruction. The mobile terminal calls a system interface to close the application program in the virtual screen, and then sends a successful closing notification to the interconnection device.

[0301] In some embodiments, the interconnection device sends a floating window opening instruction to the mobile terminal in response to the triggering operation on the floating window icon when the floating window is closed, and the floating window is re-displayed. The mobile terminal receives the floating window opening instruction sent by the interconnection device, and the floating window opening instruction is sent in response to the triggering operation on the floating window icon. Subsequently, the mobile terminal re-sends the picture data to the interconnection device based on the floating window opening instruction.

[0302] In some embodiments, the floating window mode of the re-displayed floating window is consistent with the floating window mode before the floating window is closed.

[0303] Optionally, the floating window opening instruction can include an application starting event, indicating the mobile terminal to restart the application program.

[0304] In a possible implementation, the interconnection device sends an application starting event to the mobile terminal in response to the triggering operation on the floating window icon, and the application starting event is included in the floating window starting instruction. The mobile terminal calls the system interface to draw the application picture of the application program in the virtual screen, and then sends a successful starting notification to the interconnection device.

[0305] Optionally, when the mobile terminal receives the floating window closing instruction, the mobile terminal can stop providing the application picture while closing the current application program, and subsequently display the main page in the current floating window mode when receiving the floating window opening instruction. For example, the mobile terminal desktop main page in the mirror mode, and the customized user interface main page in the interconnection mode.

[0306] Optionally, the mobile terminal can also stop providing the application picture when the mobile terminal receives the floating window closing instruction, and maintain the running state of the application program, and subsequently re-provide the application data of the application picture displayed before the floating window is closed, so as to restore the display of the application picture of the application program before the floating window is closed without restarting the application program.

[0307] In the embodiments of the present application, the mobile terminal can determine to stop or re-provide the picture data according to the floating window closing instruction or the floating window opening instruction sent by the interconnection device, which is conducive to supporting the interconnection device to open and close the floating window, and improving the coordination between the interconnection device and the mobile terminal.

[0308] The following embodiments take the interconnection device as a car machine and the mobile terminal as a mobile phone as an example to illustrate the floating window closing process.

[0309] The car machine is provided with a Carlink HMI and a car machine SDK, the mobile phone is provided with a mobile phone SDK, an interconnection management program and a mobile phone system, and a third-party application is installed on the mobile phone. The car machine and the mobile phone realize data interaction through the Carlink protocol. Optionally, different communication protocols can be used between the interconnection device and the mobile terminal according to actual needs, and the mobile phone system on the mobile phone can be an Android system or other systems.

[0310] Referring to FIG. 20, FIG. 20 is a timing diagram of a floating window closing process according to an example embodiment of the present application. The Carlink HMI 2001 and the car machine SDK 2002 of the car machine, the mobile phone SDK 2003, the interconnection management program 2004 and the mobile phone system 2005 of the mobile phone, and the third-party application 2006 installed on the mobile phone are shown in the figure.

[0311] The Carlink HMI 2001 notifies the car machine SDK 2002 that the user needs to stop an application in the case that the user clicks the close button of the current projection window (floating window); the car machine SDK 2002 sends a stop application event to the mobile phone SDK 2003 through the Carlink protocol; the mobile phone SDK 2003 calls back to notify the interconnection management program 2004 of a new stop application event; the interconnection management program 2004 calls a system interface to close the application running on the virtual screen; and the mobile phone system 2005 exits the third-party application 2006. The third-party application 2006 is closed on the current virtual screen.

[0312] It should be noted that, in addition to the stop application event, the car machine and the mobile phone can also transmit an application start event, an application pause event and an application resume event through the Carlink protocol. The application start event is transmitted in the case that the car machine receives an application start operation, the application pause event is transmitted in the case that the car machine receives a pause operation, and the application resume event is transmitted in the case that the car machine receives a resume operation. Optionally, the resume operation can be a trigger operation on the floating window icon, for resuming the display of the floating window and the display of the application screen in the floating window. Optionally, the car machine (i.e. the interconnection device) can display a close control, a pause control, a resume control and a start control for the user to implement the above operations. For example, the close control can be a floating window close button, the pause control can be a screen pause button, and the start control can be an application icon.

[0313] The mobile phone system 2005 notifies the interconnection management program 2004 that the third-party application 2006 is successfully stopped; the interconnection management program 2004 calls the interface of the mobile phone SDK 2003 to notify the Carlink HMI 2001 of the application state change; the Carlink HMI 2001 hides the floating window according to the current application state information, displays the floating window tag, and subsequently calls the SDK interface to stop the screen projection; and the Carlink HMI 2001 stops the screen projection.

[0314] In some embodiments, the screen display direction of the mobile terminal includes a horizontal screen direction and a vertical screen direction. In order to realize that the floating window displays the picture in the horizontal screen direction or the vertical screen direction, the mobile terminal can send a notification to instruct the interconnected device to display the floating window in different screen directions.

[0315] In some possible implementation manners, the mobile terminal sends a screen direction switching notification to the interconnected device in the case where there is a screen direction switching event. The interconnected device is configured to configure the floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification.

[0316] The screen direction switching notification is sent by the mobile terminal to the interconnected device in the case where it is determined that there is a screen direction switching event, and is used to indicate the screen direction.

[0317] The screen direction switching event is used to represent that the display direction of the picture content in the screen of the mobile terminal is changed. In the case where there is a screen switching event, the interconnected device is configured to configure the floating window matching the screen direction.

[0318] In some possible implementation scenarios, in the case where the full-screen control in the application interface in the floating window in the mirror mode is triggered, the interconnected device notifies the mobile terminal of the screen direction switching event, and the mobile terminal injects the screen direction switching event into the mirror virtual screen (the background virtual screen in the interconnected mode) to make the application receive the screen direction switching event. The application initiates a horizontal screen switching request to the mobile terminal system, and the mobile terminal system sends a screen direction switching notification to the interconnected device, such as a notification of the HMI of the interconnected device, in the case where it is monitored that the switching request, so that the interconnected device creates a new horizontal screen floating window, receives a data stream of the picture data, and decodes and renders.

[0319] Optionally, in the case where the application picture in the floating window is triggered, the floating window can display an application control bar, which includes a return control for triggering the application program to exit the horizontal screen floating window full-screen display and restore the vertical screen floating window display. The system return control or gesture operation instruction of the interconnected device can also be used to realize the above-mentioned exit operation.

[0320] In the case of triggering the recovery of the floating window display in the vertical screen, the mobile terminal system monitors the vertical screen switching event, notifies the interconnection device of the event, and the interconnection device creates a floating window according to the vertical screen size of the mobile terminal, receives a data stream of the picture data, and decodes and renders the picture data to make the floating window display the application picture.

[0321] The screen direction switching event can include at least one of the following:

[0322] 1. The screen direction changes.

[0323] In a possible application scenario, the mobile terminal can automatically switch the display direction of the application picture in the case of a change in the screen direction, and send a screen switching notification to the interconnection device. The interconnection device configures a floating window matching the screen direction of the mobile terminal in the case of receiving the screen switching notification.

[0324] For example, during the playing of a video by the mobile terminal, the screen direction of the mobile terminal changes from the vertical screen to the horizontal screen, so that the video picture is played in full screen on the mobile terminal screen. The interconnection device receives the screen direction switching notification sent by the mobile terminal, and then configures a floating window to display the horizontal screen playing picture of the video application according to the screen direction indicated by the notification.

[0325] 2. A triggering operation is received on the screen direction switching control in the target application program.

[0326] Optionally, the triggering operation on the screen direction switching control can include a click operation, a voice input operation, or a visual control operation triggered by the human eye, and the embodiments of the present application do not limit the triggering operation.

[0327] Optionally, the screen direction switching control can be a full screen control in the application program. For example, a video full screen playing control in a video playing application.

[0328] Optionally, the screen direction switching control can also be a horizontal screen mode control in the application program. For example, a browser or social software has a horizontal screen display mode and a vertical screen display mode. In the case of receiving a triggering operation on the horizontal screen mode control by the mobile terminal, the browser or social software enters the horizontal screen display mode and displays the horizontal screen picture.

[0329] In the embodiments of the present application, the control capable of changing the display direction of the application program in the mobile terminal screen can be used as the screen direction switching control in the target application program.

[0330] 3. A reverse control instruction sent by the interconnection device is received, and the reverse control instruction is used to trigger the screen direction switching control in the target application program.

[0331] In some embodiments, the interconnection device displays the application picture in the floating window, receives a triggering operation on the screen orientation switching control in the application picture, and then sends a reverse control instruction to the mobile terminal according to the triggering operation, instructing the mobile terminal to provide a picture after screen orientation switching, and receives a screen orientation switching notification sent by the mobile terminal.

[0332] In some embodiments, the reverse control instruction is used to forward an operation event to the mobile terminal in the case that the interconnection device receives a user operation. In the case that the operation event instructs to trigger the screen orientation switching control in the target application program, the mobile terminal determines that there is a screen orientation switching event.

[0333] Optionally, the reverse control instruction sent by the interconnection device to the mobile terminal can include touch coordinates of a touch point on the screen of the interconnection device and a touch operation type. For example, in the case that the user touches the floating window, the interconnection device sends a touch event to the mobile terminal, and the touch event includes a touch position, so that the mobile device determines whether there is a screen orientation switching event.

[0334] Optionally, the touch operation type can include a click operation, a sliding operation, a long press operation, etc. In a possible implementation, the mobile terminal determines the control operated by the touch operation according to the touch coordinates fed back by the interconnection device, then runs the application program to respond to the touch operation, and then sends picture data to the interconnection device according to the response picture of the application program on the virtual screen.

[0335] Optionally, in the case that the display screen of the interconnection device does not have a touch function, the reverse control instruction can also include operation coordinates and an operation type. For example, click coordinates of a click operation, and continuous trajectories of drag coordinates of a drag operation.

[0336] Optionally, the screen orientation switching control in the target application program can include a full-screen control, a horizontal screen mode control, etc. that can be used to change the display direction of the application program in the screen of the mobile terminal, and the embodiments of the present application do not limit this.

[0337] In some embodiments, the mobile terminal receives a floating window state notification sent by the interconnection device in the case that the screen orientation indicated by the screen orientation switching notification is a horizontal screen orientation. The floating window state notification is used to indicate a floating window state of the floating window configured by the interconnection device, and the floating window state includes a horizontal screen state and a full-screen state. Then, the mobile terminal configures a virtual screen based on the floating window state indicated by the floating window state notification. The virtual screen is used to carry a picture provided by the mobile terminal, and the size of the virtual screen is different in the horizontal screen state and the full-screen state.

[0338] Optionally, the screen direction switching notification can be used to instruct the interconnected device to switch the floating window from the portrait screen state to the landscape screen state, or to instruct the interconnected device to switch the floating window from the portrait screen state to the full screen state.

[0339] In some embodiments, the floating window state notification is sent to the mobile terminal by the interconnected device after the interconnected device configures the floating window state matching the screen direction according to the screen direction switching notification sent by the mobile terminal, and is used to notify the mobile terminal that the floating window state configured by the interconnected device is the landscape screen state or the full screen state.

[0340] In some embodiments, the screen size of the virtual screen needs to match the size of the floating window so as to display the picture carried by the virtual screen in the floating window. In the landscape screen state, the size of the floating window is determined based on the landscape floating window size, and in the full screen state, the size of the floating window is determined based on the screen size of the interconnected device.

[0341] In one possible implementation, the mobile terminal sends the screen direction switching notification representing the landscape direction to the interconnected device, the interconnected device configures the floating window according to the landscape floating window size, and then sends the floating window state notification representing the landscape screen state. Subsequently, the mobile terminal configures the virtual screen with the size of the landscape floating window size based on the floating window state indicated by the floating window state notification.

[0342] In another possible implementation, the mobile terminal sends the screen direction switching notification representing the landscape direction to the interconnected device, the interconnected device configures the floating window according to the screen size of the interconnected device, and then sends the floating window state notification representing the full screen state. Subsequently, the mobile terminal configures the virtual screen with the size of the screen of the interconnected device based on the floating window state indicated by the floating window state notification.

[0343] In the embodiments of the present application, the mobile terminal can send the screen direction switching notification to the interconnected device in the case of screen direction switching, so as to adjust the floating window picture by the interconnected device and improve the adaptation of the floating window to the application picture.

[0344] In the embodiments of the present application, the mobile terminal can send the screen direction switching notification to the interconnected device in the case of screen direction switching, so as to adjust the floating window picture by the interconnected device and improve the adaptation of the floating window to the application picture.

[0345] In the case of the screen direction being the landscape direction, the mobile terminal can configure the landscape virtual screen, so as to provide the picture data matching the screen direction to the interconnected device, make the interconnected device display the landscape floating window, avoid the floating window occupying too much display space and affecting the picture display of the interconnected device, and the mobile terminal can also configure the full screen virtual screen, so that the floating window can display the application picture on the interconnected device in the full screen mode, and the display mode of the floating window is enriched.

[0346] In some embodiments, the floating window can also provide a full screen control, so that the interconnection device displays the application picture through the full screen state floating window. The floating window size of the full screen state floating window is consistent with the screen size of the interconnection device, such as the same size, or the same size ratio.

[0347] Optionally, the mobile terminal can receive the full screen instruction sent by the interconnection device. The full screen instruction is sent in the case that the trigger operation on the full screen control in the floating window is received. Then, the mobile terminal sends the picture data of the full screen picture to the interconnection device based on the full screen instruction.

[0348] Optionally, the full screen picture data can be the picture data of the application picture adapted to the interconnection device, the picture data of the application picture displayed in parallel window, the picture data of the portrait picture displayed in the center, or the picture data of the application picture stretched to display. As shown in FIG. 13, the display difference of different picture data is exemplary, and the embodiments of the present application will not be described again.

[0349] In some embodiments, the floating window state includes a landscape state, a portrait state and a full screen state. The floating window size of the landscape state and the portrait state is determined based on the screen size of the mobile terminal, and the floating window size of the full screen state is determined based on the screen size of the interconnection device. The mirror virtual screen size needs to be determined based on the screen size of the mobile terminal, and the background virtual screen can be determined based on the screen size of the mobile terminal or the screen size of the interconnection device. Since the size of the mirror virtual screen cannot be determined based on the screen size of the interconnection device, the picture needs to be moved from the mirror virtual screen to the background virtual screen when the full screen floating window is switched in the mirror mode.

[0350] In some possible implementation scenarios, in the mirror mode, when the first application icon or the second application icon is triggered, the mobile terminal starts the application and displays the application picture on the screen; when the full screen control in the floating window is triggered, the interconnection device sends a request to the mobile terminal to display the full screen state floating window; the mobile terminal moves the application from the mirror virtual screen to the background virtual screen with the same screen size as the screen size of the interconnection device.

[0351] Optionally, the background virtual screen can be displayed in full screen, parallel window, compatible mode (including picture centering, stretching or using the existing adaptation mode), etc.

[0352] In the case of moving to the background virtual screen, the mobile terminal no longer displays the current application, and sends a message to the interconnection device to notify the interconnection device that the mode switching is successful, and the subsequent display content of the background virtual screen, i.e. the picture data, is encoded and pushed to the interconnection device. After receiving the mode switching success message, the interconnection device switches the display container and uses the full screen surface to display the picture data pushed by the mobile terminal.

[0353] Optionally, in the case that the full-screen control is triggered again, the interconnection device restores the display of the original floating window. Specifically, the interconnection device sends a restoration request to the mobile terminal, the mobile terminal stacks the application from the background virtual screen back to the mirror virtual screen, so that the mirror virtual screen restores the display of the application picture of the application, the mobile terminal sends a mode switching success message to the interconnection device, and the mirror picture of the mirror virtual screen is subsequently pushed to the interconnection device. After receiving the mode switching success message, the interconnection device switches the display container, so that the floating window surface displays the picture data content pushed by the mobile terminal.

[0354] In some possible implementation scenarios, in the interconnection mode, in the case that the first application icon or the second application icon is triggered, the mobile terminal starts the application and displays the application picture on the screen; in the case that the full-screen control in the floating window is triggered, the interconnection device sends a request for displaying the full-screen state floating window to the mobile terminal; and the mobile terminal modifies the size of the background virtual screen to be equal to the size of the screen of the interconnection device, and then triggers the application to be re-laid out and displayed on the background virtual screen. Optionally, the display mode can be full-screen display, parallel window, compatible mode (including picture centering, stretching, or using an existing adaptation mode), and the like.

[0355] In the case that the full-screen control is triggered again, the interconnection device restores the display of the original floating window. Specifically, the interconnection device sends a restoration request to the mobile terminal; the mobile terminal restores the size of the background virtual screen to be equal to the size of the screen of the mobile terminal, and the mirror picture of the mirror virtual screen is subsequently pushed to the interconnection device. After receiving the mode switching success message, the interconnection device switches the display container, so that the floating window surface displays the picture data content pushed by the mobile terminal.

[0356] In the embodiments of the present application, the mobile terminal can send the picture data of the full-screen picture in the case of receiving the full-screen instruction, so that the interconnection device can play the application picture in full screen without the application program providing the full-screen control, and the display function of the floating window is enriched.

[0357] In some embodiments, the interconnection device can screen the application programs in the mobile terminal, and display the first application icons corresponding to the screened application programs in the application starting interface. The mobile terminal can provide application information according to the screening of the interconnection device, so as to be displayed by the interconnection device.

[0358] The process in which the mobile terminal provides the application information can include the following steps, as shown in FIG. 21.

[0359] Step 2101, in the case that a communication connection is established with the interconnection device, a first application list is sent to the interconnection device, and the first application list contains the application programs in the mobile terminal.

[0360] Optionally, the first application list can represent the application programs by using one of the application ID, the application name, and the application package name.

[0361] In a possible implementation, when the interconnection device establishes a communication connection with the mobile terminal, the interconnection device first sends a request for obtaining the first application list to the mobile terminal, and the mobile terminal sends the first application list to the interconnection device upon receiving the request.

[0362] In step 2102, the application information obtaining request sent by the interconnection device is received, and the application information obtaining request is used to obtain the application information of the application programs in the second application list, which contains the application programs filtered from the first application list by the interconnection device.

[0363] In some embodiments, the interconnection device determines the second application list based on the first application list, and the second application list is a list of application programs in the first application list that are allowed to display the first application icons on the application startup interface of the interconnection device.

[0364] Optionally, in order to avoid repeated display of the application icons, the interconnection device can select the mobile terminal application programs that are not repeated with the local application programs according to the repetition of the local application programs and the application programs on the mobile terminal, and display the first application icons corresponding to the mobile terminal application programs.

[0365] In some embodiments, the second application list can also be a list of application programs in the first application list that are allowed to display the application screens in the floating window of the interconnection device.

[0366] Optionally, in order to protect the user privacy, the interconnection device can be internally provided with an application program white list, which is used to record the application programs allowed to be started by the interconnection device. The white list can be customized by the user. The interconnection device adds the application programs in the first application list that exist in the application program white list to the second application list.

[0367] Optionally, in order to maintain the device security of the interconnection device and the mobile terminal, the interconnection device can also be provided with an application program black list, which is used to prohibit the application programs from starting malicious programs through the interface jump mode. The interconnection device removes the application programs existing in the black list from the first application list to obtain the second application list.

[0368] In some embodiments, the application information of the application programs in the second application list is the application information required for displaying the first application icons on the application startup interface of the interconnection device. Optionally, the application information can include the application name, the application package name, the application ID, and the application icon.

[0369] In step 2103, the application information is sent to the interconnection device, and the interconnection device is used to display the first application icons on the application startup interface based on the application information.

[0370] Optionally, the interconnection device can also display the application name in the application start interface, and can also take measures such as changing the color of the name and adding special patterns to the icon to distinguish the first application icon from the local application icon.

[0371] In some embodiments, the floating window mode of the floating window includes an interconnection mode. In the interconnection mode, the floating window displays an interconnection picture, which is a picture of the customized user interface in the interconnection mode.

[0372] In some embodiments, the interconnection device screens the application programs provided by the mobile terminal, and the mobile terminal updates the customized user interface according to the screened applications, so as to avoid displaying the application programs not allowed to be displayed on the screen of the interconnection device in the customized user interface.

[0373] Optionally, the mobile terminal can update the application icons in the customized user interface based on the second application list, wherein the updated customized user interface does not contain the application icons of the application programs outside the second application list.

[0374] In a possible implementation, the customized user interface first displays the second application icons of all the application programs that can be displayed on the interconnection device in the mobile terminal according to the second application list. In the case that the interconnection device updates the second application list, the mobile terminal sends the application information of the application programs belonging to the second application list to the interconnection device, so that the interconnection device displays the updated customized user interface.

[0375] For example, the customized user interface displays the application icons or card information of the application program A, the application program B and the application program C, the second application list determined by the interconnection device no longer includes the application program A, the application program B and the application program C, but includes the application program A and the application program B, the mobile terminal determines to provide the application information of the application program A and the application program B to the interconnection device, and the interconnection device displays the application icons or card information of the application program A and the application program B in the customized user interface.

[0376] In a possible scenario, the interconnection device can make the picture jump to the application picture of the application program outside the second application list through the application jump between the application programs.

[0377] In another possible scenario, the interconnection device can receive the triggering operation on the second application icon in the mirror mode, so as to prompt the mobile terminal to start the application program outside the second application list.

[0378] In some embodiments, in order to solve the problems in the above scenarios, to avoid the application program not belonging to the second application list from displaying the application screen in the interconnection device, the mobile terminal records the second application list upon receiving the application information acquisition condition sent by the interconnection device, and when starting the application program, can determine whether the application program can be started according to the second application list.

[0379] In some embodiments, the mobile terminal can start the target application program in response to the application start event, and the target application program indicated by the application start event belongs to the second application list.

[0380] In some embodiments, the application start event indicates that the application program is started, including that the interconnection device notifies the mobile terminal that the application start event exists through the reverse control instruction in response to the trigger operation of the second application icon in the screen displayed by the floating window.

[0381] In a possible implementation, the interconnection device sends the reverse control instruction containing the interaction event to the mobile terminal upon receiving the interaction operation of the user on the content of the screen displayed by the floating window, such as that the PC receives the click operation of the user and the PAD receives the touch operation of the user, and the reverse control instruction is used to trigger the start of the target application program. In the case that the mobile terminal determines that the interaction operation of the user indicated by the interaction event is the trigger operation of the second application icon in the screen displayed by the floating window, and the mobile terminal determines that the target application program indicated by the trigger operation belongs to the second application list, the system interface is called to start the target application program to the virtual screen, the application screen is drawn on the virtual screen, and the application screen is provided to the interconnection device, and then the interconnection device displays the application screen in the floating window.

[0382] The application start event can also be that the interconnection device notifies the mobile terminal that the application start event exists in response to the trigger operation of the application icon in the application start interface.

[0383] In a possible implementation, the interconnection device determines that the application start event exists upon receiving the trigger operation of the application icon in the application start interface by the user, and sends the application start event to the mobile terminal. Then, the mobile terminal calls the system interface to start the target application program to the virtual screen in the case that the target application program indicated by the application start event belongs to the second application list, draws the application screen on the virtual screen, and provides the application screen to the interconnection device.

[0384] In some other embodiments, the mobile terminal can prohibit starting the target application program in response to the application start event, and the target application program indicated by the application start event does not belong to the second application list; then, the mobile terminal sends the application start failure notification to the interconnection device. The interconnection device is used to display the application start failure prompt information based on the application start failure notification.

[0385] In a possible implementation, the interconnection device sends a reverse control instruction containing the interaction event to the mobile terminal to trigger the target application to start, in the case that the interconnection device receives the user's interaction operation on the content of the picture displayed by the floating window. In the case that the mobile terminal determines that the interaction operation of the user indicated by the interaction event is a trigger operation on the second application icon in the picture displayed by the floating window, and the mobile terminal determines that the target application indicated by the trigger operation does not belong to the second application list, the mobile terminal prohibits the target application to start, and notifies the interconnection device of the failure to start, and then the interconnection device displays the application start failure prompt information in the floating window.

[0386] In another possible implementation, the interconnection device determines that there is an application switching event, and sends an application start event to the mobile terminal, in the case that the interconnection device receives the user's trigger operation on the application icon in the application start interface. Then the mobile terminal notifies the interconnection device of the failure to start, in the case that the target application indicated by the application start event does not belong to the second application list, and then the interconnection device displays the application start failure prompt information in the floating window.

[0387] In the embodiments of the present application, the mobile terminal can cooperate with the interconnection device to screen the application programs, determine the application programs displaying the first application icons, and avoid the same application programs existing in the interconnection device and the mobile terminal from displaying the application icons repeatedly, thereby causing the application function redundancy.

[0388] The mobile terminal can also update the customized user interface according to the second application list, avoid the mobile terminal from starting the application programs that are not allowed to be displayed in the floating window, and ensure the safety of the user's personal information.

[0389] The mobile terminal can start the application programs allowed to start according to the second application list, avoid starting the application programs that are not allowed to be displayed in the floating window, and also prohibit the application programs not allowed to start from starting according to the second application list, and feed back the application start failure notification, so that the interconnection device displays the failure prompt, and the information feedback capability of the floating window is improved.

[0390] The following embodiments take the interconnection device as a car machine and the mobile terminal as a mobile phone as an example to describe the acquisition process of the first application list and the second application list, the application start process, and the reverse control process. The reverse control process can be used to start the application in the floating window, such as starting through the application icon in the desktop home page of the mobile terminal in the mirror mode, and starting through the card or the application icon in the customized user interface in the interconnection mode, and can also be used to implement the reverse control in the application program and update the application picture.

[0391] The vehicle's infotainment system includes a CarLink HMI and a vehicle SDK, while the mobile phone includes a mobile SDK, a connectivity management program, and a mobile operating system, with third-party applications installed on the phone. Data interaction between the vehicle's infotainment system and the mobile phone is achieved using the CarLink protocol. Optionally, different communication protocols can be used between the connected devices and the mobile terminal as needed, and the mobile phone's operating system can be Android or another system.

[0392] In some embodiments, the mobile phone sends a first application list to the vehicle's infotainment system. After receiving the first application list, the vehicle's infotainment system requests application information from the second application list from the mobile phone. The second application list includes applications selected by the vehicle's infotainment system from the first application list.

[0393] The process of the vehicle infotainment system obtaining the first application list is described in detail below. Referring to Figure 22, which is a timing diagram of the first application list acquisition process provided in an exemplary embodiment of this application, the figure shows the Carlink HMI 2201 and vehicle infotainment system SDK 2202 of the vehicle infotainment system, and the mobile phone SDK 2203 and connectivity management program 2204 of the mobile phone.

[0394] After the vehicle's infotainment system establishes a communication connection with the mobile phone, the Carlink HMI2201 sends a request to the mobile phone to retrieve the application list information. Specifically, the Carlink HMI2201 in the vehicle sends the application list information retrieval request to the vehicle's SDK2202, which then forwards the request to the mobile phone SDK2203 via the Carlink protocol. Upon receiving the request, the mobile phone SDK2203 forwards it to the connectivity management program 2204.

[0395] After receiving the request, the connectivity management program 2204 will return an application list, which will then be sent to the Carlink HMI 2201 via the mobile SDK 2203 and the vehicle SDK 2202. Upon receiving the application list, the Carlink HMI 2201 will delete unnecessary applications while retaining the target application list information, i.e., the ID list.

[0396] Alternatively, in addition to the application ID, the application list can also use the application name or application package name to identify the application.

[0397] In some embodiments, after obtaining the first application list, the vehicle infotainment system determines a second application list and requests application information of the applications in the second application list from the mobile phone. Referring to Figure 23, which is a timing diagram of the application information acquisition process provided in an exemplary embodiment of this application, the figure shows the Carlink HMI 2301 and vehicle infotainment system SDK 2302 of the vehicle infotainment system, and the mobile phone SDK 2303 and connectivity management program 2304 of the mobile phone.

[0398] After obtaining the second application list, the Carlink HMI 2301 sends the second application list information to the interconnection management program 2304 via the car machine SDK 2302 and the mobile phone SDK 2303.

[0399] Specifically, the Carlink HMI 2301 of the car machine performs list filtering to determine the application list (the second application list) that needs to be fused and displayed. The fusion display refers to the fusion display of the application icons of the application programs on the mobile phone and the application icons of the local application programs of the car machine. Then, the Carlink HMI 2301 requests the car machine SDK 2302 to obtain the application detailed information of the specified ID set (application IDs recorded in the second application list), such as the application package name, the application ID, the application name, and the application icon. The car machine SDK 2302 forwards the application detailed information message to the mobile phone SDK 2303 through the Carlink protocol. The mobile phone SDK 2303 sends a request for obtaining the application detailed information of the specified ID set to the interconnection management program 2304. The interconnection management program 2304 records the car machine-selected application list on the car, that is, the second application list, so as to facilitate the mobile phone to subsequently judge whether the application program is allowed to be on the car.

[0400] Optionally, the car machine can filter out the local application with the same name in the first application program and record the mobile phone application different from the local application in the second application list.

[0401] After receiving the above-mentioned obtaining request, the interconnection management program 2304 returns the application detailed information of the specified ID set, calls the mobile phone SDK 2303 interface, and returns the application list detailed message to the car machine SDK 2302 through the Carlink protocol. The car machine SDK 2302 returns the application detailed information of the specified ID set to the Carlink HMI 2301. Then, according to the application ID, the application name, the application package name, and the icon information contained in the application detailed information, the application list information is displayed on the application startup interface.

[0402] In some embodiments, the car machine displays the application list information on the application startup interface, that is, the car machine mixes and displays the first application icon of the mobile phone and the application icon of the local application on the application startup interface. The first application icon is used to realize the quick startup of the mobile phone application on the car machine.

[0403] The process of the car machine side quick startup of the application program is described below. Referring to FIG. 24, FIG. 24 is a timing diagram of the application startup process. The Carlink HMI 2401 and the car machine SDK 2402 of the car machine, the mobile phone SDK 2403, the interconnection management program 2404, and the mobile phone system 2405 of the mobile phone, and the third-party application program 2406 installed on the mobile phone are shown in the figure.

[0404] The application startup process is similar to the floating window closing process shown in FIG. 20. The difference is that in the application startup process, the car machine sends an application startup event to the mobile phone through the Carlink protocol, the third-party application 2406 draws the application picture on the virtual screen to provide the application content to the mobile phone system 2405, and the interconnection management program 2404 pushes the audio and video stream to the car machine SDK 2402 for the car machine to display the picture and play the sound.

[0405] Specifically, in the case that the user clicks a certain application icon (the first application icon) on the current car machine screen, the Carlink HMI 2401 notifies the car machine SDK 2402 that the user needs to start a certain application; the car machine SDK 2402 sends an application startup event to the mobile phone SDK 2403 through the Carlink protocol; the mobile phone SDK 2403 calls back to notify the interconnection management program 2404 of a new application startup application event; the interconnection management program 2404 calls a system interface to start the specified application to the virtual screen; and the mobile phone system 2405 starts the third-party application program 2406. The third-party application program 2406 draws the application picture on the current virtual screen and subsequently submits the application content on the virtual screen to the mobile phone system 2405.

[0406] Subsequently, the mobile phone system 2405 notifies the interconnection management program 2404 that the third-party application program 2406 is successfully started; the interconnection management program 2404 calls the mobile phone SDK 2403 interface to notify the car machine SDK 2402 of the application state change, wherein the mobile phone SDK 2403 notifies the car machine SDK 2402 of the application state change message through the Carlink protocol; the car machine SDK 2402 calls back to notify the Carlink HMI 2401 of the application state change; and the Carlink HMI 2401 applies for a floating window according to the current application state information and subsequently calls the SDK interface to update the screen projection parameters and further update the surface container.

[0407] After receiving the application state change message, the car machine SDK 2402 returns an ACK to the interconnection management program 2404 through the mobile phone SDK 2403; and the interconnection management program 2404 starts the streaming.

[0408] In the case that there is new content on the virtual screen, the interconnection management program 2404 pushes the encoded audio and video stream to the car machine SDK 2402 through the Carlink protocol; the car machine SDK 2402 decodes the audio and video stream, renders the output to the surface container, and applies rotation to play the sound.

[0409] The application rotation pointer adjusts the floating window to full screen or a landscape display application screen when detecting application rotation. The audio and video stream is encoded by the interconnection management program 2404 using an encoder, and the encoded audio and video stream is packaged in a specified format and sent to the car machine SDK 2402, such as an RTP message format.

[0410] In some embodiments, in addition to starting the application program of the mobile phone through the first application icon in the application start interface, the car machine can also display a second application icon in the floating window, and display the application screen when receiving the triggering operation of the user on the second application icon. The car machine can also update the application screen when receiving the touch operation.

[0411] The car machine function in these embodiments is realized by reverse control of the mobile terminal by the car machine. The reverse control process is specifically described below. Referring to FIG. 25, which is a timing diagram of the reverse control process of the interconnection device. The car machine Carlink HMI 2501 and the car machine SDK 2502, the mobile phone mobile phone SDK 2503, the interconnection management program 2504 and the mobile phone system 2505, and the third-party application program 2506 installed on the mobile phone are shown in the figure.

[0412] When the user touches the application screen in the current projection window (i.e., the floating window), the Carlink HMI 2501 calls the car machine SDK 2502 interface to notify the user touch event to the mobile phone SDK 2503. Specifically, the Carlink HMI 2501 notifies the user touch event to the car machine SDK 2502, which sends the touch event to the mobile phone SDK 2503 through the Carlink protocol; the mobile phone SDK 2503 calls back the new touch event to the interconnection management program 2504, and then injects the mobile phone system 2505, which distributes the touch event to the third-party application program 2506, so that the third-party application program 2506 draws a new interface on the virtual screen according to the touch position.

[0413] When the virtual screen has content updates, the third-party application program 2506 submits the application content; the mobile phone system 2505 notifies the interconnection management program 2504 that the virtual screen has new data, and submits the audio and video stream to the encoder for encoding, and notifies the interconnection management program 2504 of the encoding result; the interconnection management program 2504 packages the encoded audio and video stream in a specified format, such as an RTP format, and then pushes it to the car machine SDK 2502 through the Carlink protocol, which decodes the audio and video stream and renders it to the surface display.

[0414] Referring to FIG. 26, which is a structural diagram of an application display device provided by an exemplary embodiment of the present application. The device includes the following modules.

[0415] The sending module 2601 is configured to send picture data to the interconnection device in a case where a communication connection is established with the interconnection device, and the interconnection device is configured to display a picture provided by the mobile terminal in a floating window in an application starting interface based on the picture data.

[0416] The starting module 2602 is configured to start a target application program, and the target application program is a first application icon in the application starting interface or an application program indicated by a second application icon in the picture displayed by the floating window, and the first application icon and the second application icon are icons of application programs in the mobile terminal.

[0417] The sending module 2601 is further configured to send the picture data of the target application program to the interconnection device, and the interconnection device is configured to display a running picture of the target application program in the floating window based on the picture data of the target application program.

[0418] Optionally, the floating window mode of the floating window includes a mirror mode and an interconnection mode.

[0419] The sending module 2601 is further configured to:

[0420] send the picture data of a mirror picture to the interconnection device in a case where the floating window is in the mirror mode;

[0421] or,

[0422] send the picture data of an interconnection picture to the interconnection device in a case where the floating window is in the interconnection mode, and the interconnection picture is a picture of a customized user interface in the interconnection mode, and the interconnection mode refers to a mode in which the interconnection device is in a communication connection with the mobile terminal.

[0423] Optionally, the apparatus further includes a data generating module configured to:

[0424] receive a mode enabling instruction sent by the interconnection device in a case where a communication connection is established with the interconnection device, and the mode enabling instruction is used to indicate the floating window mode of the floating window; and generate the picture data based on the floating window mode indicated by the mode enabling instruction.

[0425] or,

[0426] In a case that a communication connection is established with the interconnection device and a mode setting operation is received, a mode enabling instruction is sent to the interconnection device based on the mode setting operation, the mode setting operation is used to set the floating window mode of the floating window at the interconnection device, the interconnection device is used to configure the floating window based on the floating window mode indicated by the mode enabling instruction; the picture data is generated based on the floating window mode indicated by the mode setting operation.

[0427] Optionally, the data generation module is further used to:

[0428] receive a mode switching instruction sent by the interconnection device, the mode switching instruction is used to indicate to switch the floating window mode of the floating window; the picture data is generated based on the switched floating window mode indicated by the mode switching instruction;

[0429] or,

[0430] In a case that a mode switching operation is received, a mode switching instruction is sent to the interconnection device, the mode switching operation is used to switch the floating window mode of the floating window at the interconnection device, the interconnection device is used to configure the floating window based on the switched floating window mode indicated by the mode switching instruction; the picture data is generated based on the switched floating window mode indicated by the mode switching operation.

[0431] Optionally, the device further comprises a return module, which is used to:

[0432] receive a homepage return instruction sent by the interconnection device;

[0433] close the target application program based on the homepage return instruction, and send the picture data of a homepage picture to the interconnection device, the homepage picture is different in different floating window modes, and the interconnection device is used to display the homepage picture in the floating window based on the picture data of the homepage picture.

[0434] Optionally, the device further comprises an open / close module, which is used to:

[0435] receive a floating window closing instruction sent by the interconnection device, the floating window closing instruction is sent in a case that a trigger operation on a closing control in the floating window is received, and the interconnection device displays a floating window floating mark in a case that the display of the floating window is stopped;

[0436] stop sending the picture data to the interconnection device based on the floating window closing instruction;

[0437] receive a floating window opening instruction sent by the interconnection device, the floating window opening instruction is sent in a case that a trigger operation on the floating window floating mark is received;

[0438] retransmit the picture data to the interconnection device based on the floating window opening instruction.

[0439] Optionally, the direction switching module is configured to:

[0440] in a case where a screen direction switching event exists, send a screen direction switching notification to the interconnection device, the interconnection device being configured to configure the floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification.

[0441] Optionally, the screen direction switching event comprises at least one of:

[0442] a change in screen direction;

[0443] receiving a triggering operation on a screen direction switching control within the target application program;

[0444] receiving a reverse control instruction sent by the interconnection device, the reverse control instruction being configured to trigger the screen direction switching control within the target application program.

[0445] Optionally, the apparatus further comprises a screen configuration module configured to:

[0446] in a case where the screen direction indicated by the screen direction switching notification is a horizontal screen direction, receive a floating window state notification sent by the interconnection device, the floating window state notification being configured to indicate a floating window state of the floating window configured by the interconnection device, the floating window state comprising a horizontal screen state and a full screen state;

[0447] configure a virtual screen based on the floating window state indicated by the floating window state notification, the virtual screen being configured to carry a picture provided by the mobile terminal, and the size of the virtual screen being different in the horizontal screen state and the full screen state.

[0448] Optionally, the apparatus further comprises a data transmission module configured to:

[0449] receive a full screen instruction sent by the interconnection device, the full screen instruction being sent in a case where a triggering operation on a full screen control in the floating window is received;

[0450] transmit the picture data of a full screen picture to the interconnection device based on the full screen instruction.

[0451] Optionally, the sending module 2601 is further configured to:

[0452] in a case where a communication connection is established with the interconnection device, send a first application list to the interconnection device, the first application list comprising application programs in the mobile terminal;

[0453] receiving an application information acquisition request sent by the interconnection device, the application information acquisition request being used to acquire application information of an application program in a second application list, the second application list containing the application program filtered from the first application list by the interconnection device;

[0454] sending the application information to the interconnection device, the interconnection device being used to display the first application icon in the application starting interface based on the application information.

[0455] Optionally, the floating window mode of the floating window includes an interconnection mode, and the floating window displays an interconnection picture in the interconnection mode, the interconnection picture being a picture of a customized user interface in the interconnection mode.

[0456] The apparatus further includes an updating module, configured to:

[0457] updating the application icon in the customized user interface based on the second application list, wherein the customized user interface after the updating does not contain the application icon of the application program outside the second application list.

[0458] Optionally, the starting module 2602 is further configured to:

[0459] starting the target application program in response to an application starting event, and in a case where the target application program indicated by the application starting event belongs to the second application list.

[0460] Optionally, the apparatus further includes an inhibiting starting module, configured to:

[0461] inhibiting starting the target application program in response to the application starting event, and in a case where the target application program indicated by the application starting event does not belong to the second application list.

[0462] sending an application starting failure notification to the interconnection device, the interconnection device being used to display application starting failure prompt information based on the application starting failure notification.

[0463] In the embodiments of the present application, the mobile terminal can send picture data to the interconnection device in a case where the interconnection device starts the application program of the mobile terminal through the first application icon of the application starting interface or starts the application program of the mobile terminal through the second application icon in the floating window, thereby supporting the interconnection device to start the application program in different manners and realizing the multi-entry starting of the application program in the mobile terminal on the interconnection device. Moreover, the picture data provided by the mobile terminal is used to display the picture in the floating window instead of in a newly created window, which is conducive to reducing the interference of the application picture of the mobile terminal on the interconnection device.

[0464] Referring to FIG. 27, FIG. 27 is a structural diagram of an application display device according to an example embodiment of the present application. The device comprises the following modules.

[0465] a display module 2701, configured to display a first application icon and a floating window in an application start interface in a case where a communication connection is established with a mobile terminal, the floating window being configured to display a screen provided by the mobile terminal;

[0466] The display module 2701 is further configured to display an application screen in the floating window in response to a triggering operation on the first application icon in the application start interface or a second application icon in the screen displayed by the floating window, the application screen being a running screen of a target application program indicated by the triggering operation.

[0467] The first application icon and the second application icon are icons of application programs in the mobile terminal.

[0468] Optionally, the floating window mode of the floating window comprises a mirror mode and an interconnection mode.

[0469] The display module 2701 is further configured to:

[0470] display the floating window in the mirror mode in the application start interface, wherein the floating window in the mirror mode displays a mirror screen provided by the mobile terminal.

[0471] or,

[0472] display the floating window in the interconnection mode in the application start interface, wherein the floating window in the interconnection mode displays an interconnection screen provided by the mobile terminal, the interconnection screen being a screen of a customized user interface in the interconnection mode, the interconnection mode being a mode in which the interconnection device and the mobile terminal are in a communication connection.

[0473] Optionally, the device further comprises an instruction transmission module, configured to:

[0474] in a case where a communication connection is established with the mobile terminal, send a mode enabling instruction to the mobile terminal, the mode enabling instruction being configured to indicate the floating window mode in which the floating window is enabled, the mobile terminal being configured to provide a screen conforming to the floating window mode indicated by the mode enabling instruction to the interconnection device;

[0475] or,

[0476] in a case where a communication connection is established with the mobile terminal, receive a mode enabling instruction sent by the mobile terminal, the mode enabling instruction being configured to indicate the floating window mode in which the floating window is enabled; and configure the floating window based on the floating window mode indicated by the mode enabling instruction.

[0477] Optionally, the apparatus further comprises a mode switching module, configured to:

[0478] in response to a triggering operation on a mode switching control in the floating window, switching the floating window mode of the floating window; and sending a mode switching instruction to the mobile terminal based on the switched floating window mode, the mode switching instruction being used to instruct to switch the floating window mode of the floating window, and the mobile terminal being configured to provide a picture conforming to the switched floating window mode to the interconnected device based on the mode switching instruction;

[0479] or,

[0480] receiving the mode switching instruction sent by the mobile terminal, the mode switching instruction being used to instruct to switch the floating window mode of the floating window; and configuring the floating window based on the switched floating window mode instructed by the mode switching instruction.

[0481] Optionally, the apparatus further comprises a return module, configured to:

[0482] in response to a triggering operation on a homepage return control in the floating window, sending a homepage return instruction to the mobile terminal, the mobile terminal being configured to close the target application based on the homepage return instruction and provide a homepage picture to the interconnected device, wherein the homepage picture provided by the mobile terminal is different in different floating window modes;

[0483] displaying the homepage picture in the floating window.

[0484] Optionally, the display module 2701 is further configured to:

[0485] in response to a triggering operation on a closing control in the floating window, stopping displaying the floating window and displaying a floating window floating mark;

[0486] in response to a triggering operation on the floating window floating mark, redisplaying the floating window.

[0487] Optionally, the apparatus further comprises an opening and closing module, configured to:

[0488] in response to a triggering operation on the closing control in the floating window, sending a floating window closing instruction to the mobile terminal, the mobile terminal being configured to stop providing a picture to the interconnected device based on the floating window closing instruction;

[0489] in response to a triggering operation on the floating window floating mark, sending a floating window opening instruction to the mobile terminal, the mobile terminal being configured to redisplay a picture to the interconnected device based on the floating window opening instruction.

[0490] Optionally, the apparatus further comprises a floating window configuration module, configured to:

[0491] In a case that the mobile terminal receives the screen direction switching notification sent by the mobile terminal, the floating window matching the screen direction indicated by the screen direction switching notification is configured based on the screen direction indicated by the screen direction switching notification.

[0492] Optionally, the screen direction switching event triggering the screen direction switching notification comprises at least one of:

[0493] The screen direction of the mobile terminal changes;

[0494] The mobile terminal receives a triggering operation on the screen direction switching control in the target application;

[0495] The mobile terminal receives a reverse control instruction sent by the interconnected device, and the reverse control instruction is used to trigger the screen direction switching control in the target application.

[0496] Optionally, the floating window configuration module is further used for:

[0497] In a case that the screen direction indicated by the screen direction switching notification is a horizontal screen direction, the floating window in the horizontal screen state is configured based on a horizontal screen floating window size;

[0498] Or,

[0499] In a case that the screen direction indicated by the screen direction switching notification is a horizontal screen direction, the floating window in the full screen state is configured based on a screen size of the interconnected device.

[0500] Optionally, the floating window configuration module is further used for:

[0501] In response to a triggering operation on the full screen control in the floating window, a full screen instruction is sent to the mobile terminal, and the mobile terminal is used to provide a full screen picture to the interconnected device based on the full screen instruction;

[0502] The floating window in the full screen state is configured.

[0503] Optionally, the starting module is further used for:

[0504] A first application list sent by the mobile terminal is received, and the first application list contains application programs in the mobile terminal;

[0505] A second application list is determined based on the first application list, and the second application list contains application programs selected from the first application list;

[0506] An application information acquisition request is sent to the mobile terminal based on the second application list, and the application information acquisition request is used to acquire application information of application programs in the second application list.

[0507] display the first application icon in the application starting interface based on the application information sent by the mobile terminal.

[0508] Optionally, the display module 2701 is further configured to:

[0509] In response to the trigger operation on the second application icon in the display screen of the floating window, and in the case that the target application program indicated by the trigger operation belongs to the second application list, display an application screen in the floating window.

[0510] Optionally, the display module 2701 is further configured to:

[0511] In response to the trigger operation on the second application icon in the display screen of the floating window, and in the case that the target application program indicated by the trigger operation does not belong to the second application list, display an application starting failure prompt information.

[0512] In the embodiments of the present application, the interconnection device can provide the first application icon for starting the mobile terminal application program in the application starting interface, and can also provide the second application icon for starting the mobile terminal application program in the floating window, so that the mobile terminal application program can be started in multiple ways on the interconnection device, and the application screen is displayed in the floating window, rather than in a newly created window, which is conducive to reducing the interference of the mobile terminal application screen on the interconnection device.

[0513] Referring to FIG. 28, FIG. 28 shows a structural block diagram of an electronic device according to an exemplary embodiment of the present application. The electronic device includes a processor 2801 and a memory 2802.

[0514] Optionally, the processor 2801 utilizes various interfaces and lines to connect various parts of the entire computer device, and performs various functions of the computer device and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 2802, and calling data stored in the memory 2802. Optionally, the processor 2801 can be implemented in at least one of a hardware form of a digital signal processing (DSP), a field-programmable gate array (FPGA), a programmable logic array (PLA). The processor 2801 can be integrated with one or several combinations of a central processing unit (CPU), a graphic processing unit (GPU), a neural-network processing unit (NPU), and a baseband chip, etc. Among them, the CPU is mainly used to process operating systems, user interfaces, and application programs, etc.; the GPU is used to render and draw the content to be displayed on the touch display screen; the NPU is used to implement artificial intelligence (AI) functions; and the baseband chip is used to process wireless communication. It can be understood that the above baseband chip can also not be integrated into the processor 2801, but be implemented by a separate chip.

[0515] The memory 2802 can be a random access memory (RAM), and can also include a read-only memory (ROM). Optionally, the memory 2802 includes a non-transitory computer-readable storage medium. The memory 2802 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 2802 can include a program storage area and a data storage area, wherein the program storage area can store instructions for implementing an operating system, instructions for at least one function (such as a sound playing function, an image playing function, etc.), instructions for implementing each of the methods described below, etc.; and the data storage area can store data created according to the use of the computer device (such as audio data, a phone book, etc.).

[0516] In addition, those skilled in the art can understand that the structure of the computer device shown in the above-described drawings does not constitute a limitation on the computer device, and the computer device can include more or fewer components than those shown, or combine certain components, or different component arrangements.

[0517] The embodiment of the present application further provides a computer readable storage medium, wherein at least one computer instruction is stored in the computer readable storage medium, and the computer instruction is loaded and executed by a processor to realize the application display method in the above embodiment.

[0518] Optionally, the computer readable storage medium can include a ROM, a RAM, a solid state disk (SSD, Solid State Drives) or an optical disk, etc. The RAM can include a resistance random access memory (ReRAM, Resistance Random Access Memory) and a dynamic random access memory (DRAM, Dynamic Random Access Memory).

[0519] The embodiment of the present application further provides a computer program product, which includes computer instructions stored in a computer readable storage medium; a processor of an electronic device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to enable the electronic device to execute the application display method in the above embodiment.

[0520] The above description is only optional embodiments of the present application, and is not used to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

An application display method, the method is used for a mobile terminal, the method comprises: In the case of establishing a communication connection with an interconnection device, sending picture data to the interconnection device, the interconnection device is used for displaying the picture provided by the mobile terminal in a floating window in an application start interface based on the picture data; Starting a target application program, the target application program is a first application icon in the application start interface, or an application program indicated by a second application icon in the picture displayed by the floating window, the first application icon and the second application icon are icons of application programs in the mobile terminal; Sending the picture data of the target application program to the interconnection device, the interconnection device is used for displaying a running picture of the target application program in the floating window based on the picture data of the target application program. The method of claim 1, wherein, The floating window mode of the floating window includes a mirror mode and an interconnection mode; The sending of the picture data to the interconnection device comprises: In the case that the floating window is in the mirror mode, sending the picture data of a mirror picture to the interconnection device; Or, In the case that the floating window is in the interconnection mode, sending the picture data of an interconnection picture to the interconnection device, the interconnection picture is a picture of a customized user interface in the interconnection mode, the interconnection mode refers to a mode in which the interconnection device is in communication connection with the mobile terminal. The method of claim 2, wherein, The method comprises: In the case of establishing a communication connection with the interconnection device, receiving a mode enabling instruction sent by the interconnection device, the mode enabling instruction is used for indicating the floating window mode of the floating window; generating the picture data based on the floating window mode indicated by the mode enabling instruction; Or, In the case of establishing a communication connection with the interconnection device and receiving a mode setting operation, sending a mode enabling instruction to the interconnection device based on the mode setting operation, the mode setting operation is used for setting the floating window mode of the floating window at the interconnection device, the interconnection device is used for configuring the floating window based on the floating window mode indicated by the mode enabling instruction; generating the picture data based on the floating window mode indicated by the mode setting operation. The method of claim 2, wherein, The method further comprises: Receiving a mode switching instruction sent by the interconnection device, the mode switching instruction is used for indicating to switch the floating window mode of the floating window; generating the picture data based on the floating window mode after switching indicated by the mode switching instruction; Or, In the case of receiving a mode switching operation, sending a mode switching instruction to the interconnection device, the mode switching operation is used for switching the floating window mode of the floating window at the interconnection device, the interconnection device is used for configuring the floating window based on the floating window mode after switching indicated by the mode switching instruction; generating the picture data based on the floating window mode after switching indicated by the mode switching operation. The method of claim 2, wherein, The method further comprises: Receiving a home page return instruction sent by the interconnection device; The method further comprises: The method according to any one of claims 1 to 5, wherein The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method according to any one of claims 1 to 5, wherein The method further comprises: The method further comprises: The method of claim 7, wherein, The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method of claim 7, wherein, The method further comprises: The method further comprises: The method further comprises: The method according to any one of claims 1 to 5, wherein The method further comprises: The method further comprises: The method further comprises: The method according to any one of claims 1 to 5, wherein The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further comprises: The method further The method of claim 11, wherein, The floating window mode of the floating window comprises an interconnection mode, and the floating window displays an interconnection picture in the interconnection mode, the interconnection picture being a picture of a customized user interface in the interconnection mode; The method further comprises: updating application icons in the customized user interface based on the second application list, wherein the application icons of application programs outside the second application list are not contained in the updated customized user interface. The method of claim 11, wherein, The starting of the target application program comprises: starting the target application program in response to an application starting event and in the case that the target application program indicated by the application starting event belongs to the second application list. The method of claim 13, wherein, The method further comprises: inhibiting the starting of the target application program in response to the application starting event and in the case that the target application program indicated by the application starting event does not belong to the second application list; sending an application starting failure notification to the interconnection device, the interconnection device being configured to display application starting failure prompt information based on the application starting failure notification. An application display method, the method being used for an interconnection device, the method comprising: displaying a first application icon and a floating window in an application starting interface in the case that a communication connection is established with a mobile terminal, the floating window being configured to display a picture provided by the mobile terminal; displaying an application picture in the floating window in response to a triggering operation on the first application icon in the application starting interface or a second application icon in the picture displayed by the floating window, the application picture being a running picture of a target application program indicated by the triggering operation; wherein the first application icon and the second application icon are icons of application programs in the mobile terminal. The method of claim 15, wherein, The floating window mode of the floating window comprises a mirror mode and an interconnection mode; The displaying of the floating window in the application starting interface comprises: displaying the floating window in the mirror mode in the application starting interface, wherein the floating window in the mirror mode displays a mirror picture provided by the mobile terminal; or, displaying the floating window in the interconnection mode in the application starting interface, wherein the floating window in the interconnection mode displays an interconnection picture provided by the mobile terminal, the interconnection picture being a picture of a customized user interface in the interconnection mode, the interconnection mode indicating a mode in which the interconnection device and the mobile terminal establish a communication connection. The method of claim 16, wherein, The method comprises: sending a mode enabling instruction to the mobile terminal in the case that a communication connection is established with the mobile terminal, the mode enabling instruction being configured to indicate the floating window mode in which the floating window is enabled, the mobile terminal being configured to provide a picture conforming to the floating window mode indicated by the mode enabling instruction to the interconnection device; or, receiving a mode enabling instruction sent by the mobile terminal in the case that a communication connection is established with the mobile terminal, the mode enabling instruction being configured to indicate the floating window mode in which the floating window is enabled; and configuring the floating window based on the floating window mode indicated by the mode enabling instruction. The method of claim 16, wherein, The method further comprises: in response to a triggering operation on a mode switching control in the floating window, switching the floating window mode of the floating window; based on the switched floating window mode, sending a mode switching instruction to the mobile terminal, the mode switching instruction being used to instruct to switch the floating window mode of the floating window, the mobile terminal being configured to provide a picture conforming to the switched floating window mode to the interconnected device based on the mode switching instruction; or, receiving the mode switching instruction sent by the mobile terminal, the mode switching instruction being used to instruct to switch the floating window mode of the floating window; and configuring the floating window based on the switched floating window mode indicated by the mode switching instruction. The method of claim 16, wherein, The method further comprises: in response to a triggering operation on a homepage return control in the floating window, sending a homepage return instruction to the mobile terminal, the mobile terminal being configured to close the target application and provide a homepage picture to the interconnected device based on the homepage return instruction, wherein the homepage picture provided by the mobile terminal is different in different floating window modes; displaying the homepage picture in the floating window. The method according to any one of claims 15 to 19, wherein The method further comprises: in response to a triggering operation on a closing control in the floating window, stopping displaying the floating window and displaying a floating window floating mark; in response to a triggering operation on the floating window floating mark, redisplaying the floating window. The method of claim 20, wherein, The method further comprises: in response to a triggering operation on the closing control in the floating window, sending a floating window closing instruction to the mobile terminal, the mobile terminal being configured to stop providing a picture to the interconnected device based on the floating window closing instruction; in response to a triggering operation on the floating window floating mark, sending a floating window opening instruction to the mobile terminal, the mobile terminal being configured to redisplay a picture to the interconnected device based on the floating window opening instruction. The method according to any one of claims 15 to 19, wherein The method further comprises: in a case where the screen direction switching notification sent by the mobile terminal is received, configuring the floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification. The method of claim 22, wherein, The screen direction switching event triggering the screen direction switching notification comprises at least one of: a screen direction of the mobile terminal changes; the mobile terminal receives a triggering operation on a screen direction switching control in the target application; the mobile terminal receives a reverse control instruction sent by the interconnected device, and the reverse control instruction is used to trigger the screen direction switching control in the target application. The method of claim 22, wherein, The configuring the floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification comprises: in a case where the screen direction indicated by the screen direction switching notification is a horizontal screen direction, configuring the floating window in a horizontal screen state based on a horizontal screen floating window size; or, in a case where the screen direction indicated by the screen direction switching notification is a horizontal screen direction, configuring the floating window in a full screen state based on a screen size of the interconnected device. The method according to any one of claims 15 to 19, wherein The method further comprises: in response to a triggering operation on a full screen control in the floating window, sending a full screen instruction to the mobile terminal, the mobile terminal being configured to provide a full screen picture to the interconnected device based on the full screen instruction; configuring the floating window in a full screen state. The method according to any one of claims 15 to 19, wherein The first application icon is displayed in the application starting interface, and the method comprises the following steps: receiving a first application list sent by the mobile terminal, the first application list comprising application programs in the mobile terminal; determining a second application list based on the first application list, the second application list comprising application programs selected from the first application list; sending an application information acquisition request based on the second application list to the mobile terminal, the application information acquisition request being used to acquire application information of application programs in the second application list; displaying the first application icon in the application starting interface based on the application information sent by the mobile terminal. The method of claim 26, wherein, The application screen is displayed in the floating window in response to the triggering operation on the second application icon in the floating window displayed screen, and the method comprises the following steps: displaying an application screen in the floating window in response to the triggering operation on the second application icon in the floating window displayed screen, and the target application program indicated by the triggering operation belonging to the second application list. The method of claim 27, wherein, The method further comprises: displaying an application starting failure prompt information in response to the triggering operation on the second application icon in the floating window displayed screen, and the target application program indicated by the triggering operation not belonging to the second application list. An application display device, the device comprising: a sending module, configured to send screen data to an interconnection device in the case that a communication connection is established with the interconnection device, the interconnection device being used to display a screen provided by a mobile terminal in a floating window in an application starting interface based on the screen data; a starting module, configured to start a target application program, the target application program being a first application icon in the application starting interface or an application program indicated by a second application icon in a floating window displayed screen, the first application icon and the second application icon being icons of application programs in the mobile terminal; the sending module is further configured to send the screen data of the target application program to the interconnection device, the interconnection device being used to display a running screen of the target application program in the floating window based on the screen data of the target application program. An application display device, the device comprising: a display module, configured to display a first application icon and a floating window in an application starting interface in the case that a communication connection is established with a mobile terminal, the floating window being used to display a screen provided by the mobile terminal; the display module is further configured to display an application screen in the floating window in response to a triggering operation on the first application icon in the application starting interface or a second application icon in a floating window displayed screen, the application screen being a running screen of a target application program indicated by the triggering operation; wherein the first application icon and the second application icon are icons of application programs in the mobile terminal. An electronic device, comprising a processor and a memory; the memory stores at least one computer instruction for being executed by the processor to implement the application display method as claimed in any one of claims 1 to 14, or implement the application display method as claimed in any one of claims 15 to 28. A computer readable storage medium, in which at least one computer instruction is stored, the computer instruction is loaded and executed by a processor to implement the application display method as claimed in any one of claims 1 to 14, or implement the application display method as claimed in any one of claims 15 to 28. A computer program product, comprising computer instructions stored in a computer readable storage medium; a processor of an electronic device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the application display method as claimed in any one of claims 1 to 14, or implements the application display method as claimed in any one of claims 15 to 28.

Images