Application display method and device, electronic equipment, medium and program product

By sending screen data and startup modules in the application startup interface of the interconnected device in the device interconnected scenario, the startup and display of mobile terminal applications is realized in various ways, which solves the complex operation and interference problems, and improves the convenience of device interconnectedness and User experience.

CN119024996APending Publication Date: 2024-11-26GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411126339.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-15
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

In the device interconnection scenario, during the screen projection between a car computer and a mobile phone, users need to manually select content and transmit data, resulting in complex and inconvenient operation, and the prior art is difficult to effectively avoid interference from mobile terminal application screens against interconnected devices.

Method used

Provides an application display method and device, which realizes the startup of a mobile terminal application by sending screen data and a startup module in the application startup interface of an interconnected device, and displays the application screen in a floating window instead of creating a new window. Reduce interference to connected devices.

Benefits of technology

It simplifies user operations, improves the convenience of interconnection between devices, and effectively avoids interference from mobile terminal application screens against interconnected devices, improving display efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024996A_ABST
    Figure CN119024996A_ABST
Patent Text Reader

Abstract

The invention discloses an application display method and device, electronic equipment, a medium and a program product, and relates to the technical field of equipment interconnection.The method comprises the steps that under the condition that communication connection with interconnection equipment is established, picture data is sent to the interconnection equipment, and the interconnection equipment is used for displaying the application on the basis of the picture data; displaying a picture provided by the mobile terminal in a floating window in the application starting interface; a target application program is started, the target application program is a first application icon in the application starting interface or an application program indicated by a second application icon in a picture displayed by the floating window, and the first application icon and the second application icon are icons of application programs in the mobile terminal; sending the picture data of the target application program to an interconnection device, wherein the interconnection device is used for displaying a running picture of the target application program in the floating window based on the picture data of the target application program; the application program in the mobile terminal is started through multiple entrances, and the application content is displayed through the floating window, so that the interference to the interconnection equipment can be reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of device interconnection, and in particular to an application display method, device, electronic device, medium and program product. Background Art

[0002] With the continuous development of device interconnection technology, more and more car computers support interconnection with mobile phones.

[0003] In the related technology, when the car computer and the mobile phone are interconnected, the user first needs to select the content to be projected (such as an application) on the mobile phone, and then the mobile phone transmits the screen of the projected content to the car computer, which then displays it in full screen on the car computer screen. Summary of the invention

[0004] The embodiments of the present application provide an application display method, device, electronic device, medium and program product. The technical solution is as follows:

[0005] On the one hand, an embodiment of the present application provides an application display method, which is used in a mobile terminal, and the method includes:

[0006] When a communication connection is established with an interconnected device, sending screen data to the interconnected device, the interconnected device is used to display the screen provided by the mobile terminal in a floating window in an application startup interface based on the screen data;

[0007] Launching a target application, wherein the target application is a first application icon in the application launch interface, or an application indicated by a second application icon in the screen displayed by the floating window, wherein the first application icon and the second application icon are icons of applications in the mobile terminal;

[0008] The screen data of the target application is sent to the interconnected device, and the interconnected device is used to display the running screen of the target application in the floating window based on the screen data of the target application.

[0009] On the other hand, an embodiment of the present application provides an application display method, which is used for an interconnected device, and the method includes:

[0010] When a communication connection is established with the mobile terminal, displaying a first application icon and a floating window in an application startup interface, wherein the floating window is used to display a screen provided by the mobile terminal;

[0011] In response to a triggering operation on the first application icon in the application launch interface or the second application icon in the screen displayed in the floating window, displaying an application screen in the floating window, the application screen being a running screen of the target application indicated by the triggering operation;

[0012] The first application icon and the second application icon are icons of application programs in the mobile terminal.

[0013] On the other hand, an embodiment of the present application provides an application display device, the device comprising:

[0014] A sending module, used for sending screen data to the interconnected device when a communication connection is established with the interconnected device, and the interconnected device is used for displaying the screen provided by the mobile terminal in a floating window in the application startup interface based on the screen data;

[0015] a launch module, used to launch a target application, the target application is a first application icon in the application launch interface, or an application indicated by a second application icon in the screen displayed by the floating window, the first application icon and the second application icon are icons of applications in the mobile terminal;

[0016] The sending module is further used to send the screen data of the target application to the interconnected device, and the interconnected device is used to display the running screen of the target application in the floating window based on the screen data of the target application.

[0017] On the other hand, an embodiment of the present application provides an application display device, the device comprising:

[0018] A display module, configured to display a first application icon and a floating window in an application startup interface when a communication connection is established with a mobile terminal, wherein the floating window is configured to display a screen provided by the mobile terminal;

[0019] The display module is further configured to display an application screen in the floating window in response to a triggering operation on the first application icon in the application launch interface or the second application icon in the screen displayed in the floating window, wherein the application screen is a running screen of the target application indicated by the triggering operation;

[0020] The first application icon and the second application icon are icons of application programs in the mobile terminal.

[0021] On the other hand, an embodiment of the present application provides an electronic device, comprising a processor and a memory; the memory stores at least one computer instruction, and the at least one computer instruction is used to be executed by the processor to implement the application display method on the mobile terminal or interconnected device side as described in the above aspects.

[0022] On the other hand, an embodiment of the present application provides a computer-readable storage medium, in which at least one computer instruction is stored, and the computer instruction is loaded and executed by a processor to implement the application display method on the mobile terminal or interconnected device side as described in the above aspects.

[0023] On the other hand, an embodiment of the present application provides a computer program product, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; a processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the application display method on the mobile terminal or interconnected device side as described in the above aspects.

[0024] In the embodiment of the present application, when the mobile terminal provides screen data, the interconnected device can start the application of the mobile terminal through the first application icon in the application start interface, and can also start the application of the mobile terminal through the second application icon in the floating window, so that the mobile terminal application can be started on the interconnected device in multiple ways, and then the interconnected device displays the application screen according to the screen data provided by the mobile terminal. Among them, the application screen is displayed in the floating window, not in the new window, which is conducive to reducing the interference of the mobile terminal application screen on the interconnected device. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0026] Figure 1 is a schematic diagram of an implementation environment of an application display method provided by an exemplary embodiment of the present application;

[0027] Figure 2 is a flowchart of an application display method on an interconnected device side provided by an exemplary embodiment of the present application;

[0028] Figure 3 is a schematic diagram of an interconnected device display screen provided by an exemplary embodiment of the present application;

[0029] Figure 4 It is a schematic diagram of the state of an interconnected device and a mobile terminal before connection provided by an exemplary embodiment of the present application;

[0030] Figure 5 is a schematic diagram of a screen of an interconnected device and a mobile terminal in a mirroring mode provided by an exemplary embodiment of the present application;

[0031] Figure 6 It is a schematic diagram of a screen of an interconnected device and a mobile terminal in an interconnected mode provided by an exemplary embodiment of the present application;

[0032] Figure 7 This is a schematic diagram of image comparison in an interconnection mode and a mirroring mode provided by an exemplary embodiment of the present application;

[0033] Figure 8 is a schematic diagram of mode switching provided by an exemplary embodiment of the present application;

[0034] Fig. 9 A schematic diagram of the implementation of the floating window closing and displaying process provided by an exemplary embodiment of the present application is shown;

[0035] Fig.10 A schematic diagram of implementing a screen direction switching process in a mirror mode provided by an exemplary embodiment of the present application is shown;

[0036] Fig.11 A schematic diagram showing an implementation of a screen direction switching process in an interconnected mode provided by an exemplary embodiment of the present application is shown;

[0037] Fig.12 A schematic diagram of implementing a screen direction switching process provided by another exemplary embodiment of the present application is shown;

[0038] Fig.13 A schematic diagram of a floating window in different full-screen states provided by an exemplary embodiment of the present application is shown;

[0039] Fig.14 A schematic diagram of an interconnected device screen displaying a floating window in a parallel window manner provided by an exemplary embodiment of the present application is shown;

[0040] Fig.15 is a flowchart of a display process of a first application icon provided by an exemplary embodiment of the present application;

[0041] Fig.16 is a flowchart of a method for displaying applications on a mobile terminal side provided by an exemplary embodiment of the present application;

[0042] Fig.17 is a timing diagram of a floating window startup process in a mirror mode provided by an exemplary embodiment of the present application;

[0043] Fig.18 is a timing diagram of a floating window startup process in an interconnected mode provided by an exemplary embodiment of the present application;

[0044] Fig.19is a timing diagram of a mode switching process provided by an exemplary embodiment of the present application;

[0045] Fig. 20 is a timing diagram of a floating window closing process provided by an exemplary embodiment of the present application;

[0046] Fig.21 is a flowchart of a process of providing application information by a mobile terminal provided by an exemplary embodiment of the present application;

[0047] Fig. 22 is a timing diagram of a first application list acquisition process provided by an exemplary embodiment of the present application;

[0048] Fig.23 is a timing diagram of an application information acquisition process provided by an exemplary embodiment of the present application;

[0049] Fig.24 is a timing diagram of an application startup process provided by an exemplary embodiment of the present application;

[0050] Fig.25 is a timing diagram of a reverse control process of an interconnected device provided by an exemplary embodiment of the present application;

[0051] Fig.26 is a structural diagram of an application display device provided by an exemplary embodiment of the present application;

[0052] Fig. 27 is a structural diagram of an application display device provided by an exemplary embodiment of the present application;

[0053] Fig.28 A structural block diagram of an electronic device provided by an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0054] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0055] See also Figure 1 , Figure 1 1 is a schematic diagram of an implementation environment of an application display method provided by an exemplary embodiment of the present application, including an interconnected device 101 and a mobile terminal 102. Among them, the interconnected device 101 is provided with an interconnected device HMI (Human Machine Interaction) 103 and an interconnected device SDK (Software Development Kit) 104, and the mobile terminal 102 is provided with a mobile terminal SDK 105, an interconnected management program 106 and a terminal system 107.

[0056] The mobile terminal 102 may be provided with a large number of applications, and application services are provided by starting the application. For example, the mobile terminal 102 may start a video application to play a video. Optionally, the mobile terminal 102 may include a portable mobile device such as a smart phone or a smart watch.

[0057] The interconnected device 101 is an external device independent of the mobile terminal, which can display the screen projection content of the mobile terminal 102. Optionally, the interconnected device 101 and the mobile terminal 102 can be personal devices under the same user account. Optionally, the interconnected device 101 may include electronic devices that can project screens, such as personal computers, tablet computers, televisions, and car computers. Optionally, an application may be provided in the interconnected device 101, and the application may be the same as or different from the application in the mobile terminal 102. The interconnected device 101 can control the application on the mobile terminal 102 through the interconnected device HMI103 and the interconnected device SDK104. The interconnected device 101 can receive the startup operation of the application on the mobile terminal 102 by displaying a floating window, or it can receive the startup operation of the application on the mobile terminal 102 by displaying the application icon on the application startup interface.

[0058] The interconnected device HMI 103 is used to display a screen on the interconnected device 101 according to the screen data transmitted by the mobile terminal 102, including displaying the running screen of the application on the mobile terminal 102, the running screen of the application on the interconnected device 101, and the interactive screen of the interconnected device 101. Optionally, when the interconnected device HMI 103 needs to display the running screen of the application on the mobile terminal 102, the interconnected device HMI 103 can receive user operations and pass operation instructions to the interconnected device SDK 104.

[0059] The interconnected device SDK 104 can interact with the mobile terminal SDK 105 on the mobile terminal 102, including passing instructions to the mobile terminal SDK 105 and receiving screen data encoded by the interconnected management program 106. The interconnected device SDK 104 is also used to decode the screen data encoded by the interconnected management program 106 so that the interconnected device HMI 103 displays the screen.

[0060] The mobile terminal SDK 105 is used to interact with the interconnected device SDK 104 , send the request sent by the interconnected device SDK 104 to the interconnected management program 106 , and send the response content of the interconnected management program 106 to the interconnected device SDK 104 .

[0061] The interconnection management program 106 is used to manage the information interaction between the interconnected device 101 and the mobile terminal 102. The interconnected device 101 cannot access the terminal system 107 on the mobile terminal 102, and needs to send a request to the interconnection management program 106 to start and reversely control the application on the mobile terminal 102 through the interconnection management program 106. The interconnection management program 106 is also used to send the encoded picture to the interconnected device SDK 104.

[0062] The terminal system 107 is used to manage the running of the application program in the background. The terminal system 107 determines the screen data of the application program by creating a virtual screen so that the interconnection management program 106 can encode the screen data and send it to the interconnection device 101.

[0063] Optionally, a communication connection may be established between the interconnected device 101 and the mobile terminal 102 via a wireless connection method such as WIFI (Wireless Fidelity) or Bluetooth, or a wired connection method.

[0064] In the embodiment of the present application, the interconnected device 101 can display the screen provided by the mobile terminal 102, receive the control operation of the application on the mobile terminal 102, transmit the instruction to the mobile terminal 102, and then update the displayed screen according to the screen data transmitted by the mobile terminal 102. The mobile terminal 102 can run the application according to the request of the interconnected device 101 and determine the screen data for display by the interconnected device 101.

[0065] The present application provides an application display method, which can start an application on a mobile terminal through a floating window or an application icon on an application startup interface of an interconnected device, and then display the running screen of the application in the floating window. The application is still running on the mobile terminal, which can effectively avoid the display of the application on the mobile terminal, occupying the display space, and interfering with the screen display of the interconnected device.

[0066] This method can be applied to interconnection scenarios such as the interconnection between mobile phones and car computers, the interconnection between PCs (Personal Computers) and mobile phones, and the interconnection between PADs (Portable Android Devices, i.e. tablets) and mobile phones. The Carlink interconnection protocol mentioned in this application is only used as a specific protocol standard to realize the car-machine screen projection function. This application does not limit the protocol used when devices are interconnected.

[0067] The following embodiments firstly describe in detail the method applied to an interconnected device as an example.

[0068] See also Figure 2 , Figure 2This is a flow chart of an application display method on an interconnected device side provided by an exemplary embodiment of the present application. The method includes the following steps.

[0069] Step 201: When a communication connection is established with a mobile terminal, a first application icon and a floating window are displayed in an application startup interface, where the floating window is used to display a screen provided by the mobile terminal.

[0070] Optionally, the communication connection established between the interconnected device and the mobile terminal may be a WIFI connection, a Bluetooth connection, a wired connection, etc. The embodiment of the present application does not limit the communication connection method between the interconnected device and the mobile terminal.

[0071] In some embodiments, the application launch interface is used to display an application icon so that the interconnected device can launch the application program when receiving a trigger operation on the application icon. The application launch interface of the interconnected device displays an application icon of a local application program of the interconnected device and a first application icon.

[0072] In some embodiments, the first application icon is an application icon of an application in a mobile terminal, and the first application icon is used to realize quick launch of an application on the mobile terminal. In order to distinguish the first application icon from the application icon of the application on the interconnected device, optionally, when displaying the first application icon, the interconnected device may display an application mark on the first application icon to indicate that the application is from the mobile terminal. The application mark may be a specific pattern, such as a mobile terminal pattern. Optionally, the interconnected device may also change the display color of the application name of the application on the mobile terminal on the interconnected device. This application does not limit the method of distinguishing the application represented by the first application icon from the local application of the interconnected device.

[0073] In some embodiments, the picture displayed in the floating window is provided by the mobile terminal, which means that the display content of the picture displayed in the floating window is determined by the mobile terminal, that is, the application on the mobile terminal runs on the mobile terminal and is displayed on the interconnected device.

[0074] Optionally, the screen displayed in the floating window may include a home screen and an application screen. The home screen displayed in the floating window is used to display application icons of applications in the mobile terminal so as to trigger the display of the application screen.

[0075] Step 202, in response to a triggering operation on a first application icon in the application launch interface or a second application icon in a screen displayed in a floating window, an application screen is displayed in the floating window, and the application screen is a running screen of a target application program indicated by the triggering operation.

[0076] In some embodiments, the second application icon is an icon of an application in the mobile terminal. Optionally, the second application icon in the floating window and the first application icon in the application launch interface may represent the same application or different applications.

[0077] In a possible implementation, the interconnected device selects an application from the mobile terminal, and displays a first application icon corresponding to the application in the application startup interface. The interconnected device displays second application icons corresponding to all applications in the mobile terminal in a floating window.

[0078] In another possible implementation, the interconnected device selects an application from the mobile terminal, displays a first application icon corresponding to the application on the application launch interface, and displays a second application icon corresponding to the application in a floating window, so that the first application icon and the second application icon can represent the same application.

[0079] It should be noted that in response to the triggering operation of the first application icon in the application interface, the interconnected device does not maintain the floating window display screen and create another display window to display the application screen, but stops displaying the second application icon in the floating window and starts displaying the application screen, which can avoid the new window occupying the display space of the interconnected device and reduce interference to the interconnected device.

[0080] For example, Figure 3 It is a schematic diagram of the display screen of an interconnected device provided by an exemplary embodiment of the present application. Among them, the application startup interface 301 shows applications 1 to 12 in the interconnected device. When the mobile terminal establishes a communication connection with the interconnected device, the interconnected device displays the first application icon corresponding to applications A to E and the floating window 302. Among them, the first application icon is displayed with an application identifier representing the mobile terminal application. The floating window 302 shows the second application icons corresponding to applications A to K in the mobile terminal. Among them, the first application icons corresponding to applications F to K do not exist in the application startup interface 301. When the interconnected device receives a trigger operation for the first application icon 303 corresponding to application C, or receives a trigger operation for the second application icon 304 corresponding to application C, the application C screen is displayed in the floating window 302.

[0081] Optionally, when the floating window displays application screens of other applications, the interconnected device may display the application screen of the application represented by the first application icon in the floating window in response to a triggering operation on the first application icon.

[0082] In the embodiment of the present application, the interconnected device can provide a first application icon for launching the mobile terminal application on the application launch interface, and can also provide a second application icon for launching the mobile terminal application in the floating window, so that the mobile terminal application can be launched on the interconnected device in a variety of ways. The application screen is displayed in the floating window instead of in a new window, which is conducive to reducing the interference of the mobile terminal application screen on the interconnected device.

[0083] In some embodiments, the floating window displayed by the interconnected device has different floating window modes, and the screens provided by the mobile terminal are different in different floating window modes. The floating window modes include mirror mode and interconnected mode.

[0084] Optionally, the interconnected device may display a floating window in a mirroring mode in the application startup interface when a communication connection is established with the mobile terminal, or display a floating window in an interconnected mode in the application startup interface.

[0085] The floating window in the mirror mode displays a mirror image provided by the mobile terminal, and the floating window in the interconnection mode displays an interconnection image provided by the mobile terminal. The interconnection image is an image of a customized user interface in the interconnection mode.

[0086] In some embodiments, in the mirroring mode, the mirrored image is carried on the mirrored virtual screen of the mobile terminal, the mobile terminal screen display content is consistent with the display content of the mirrored virtual screen, and the display size of the mirrored image is consistent with the screen size of the mobile terminal, such as the same size ratio. When the mobile terminal screen content is updated, the mirrored image is updated synchronously.

[0087] In some embodiments, the interconnection mode refers to the mode in which the interconnection device and the mobile terminal establish a communication connection. The interconnection screen in the interconnection mode is carried on the background virtual screen of the mobile terminal, and the background virtual screen is not visible on the mobile terminal. In the interconnection mode, the mobile terminal can be in a screen-off state.

[0088] In some embodiments, the customized user interface includes a second application icon. Optionally, the user can customize the display content of the customized user interface in the customized user interface, such as filtering the second application icon displayed in the floating window, adjusting the presentation form and arrangement position of the second application icon. It should be noted that the adjustment of the content in the customized user interface does not affect the screen image of the mobile terminal.

[0089] Optionally, the customized user interface can also display important information in the form of cards, such as schedule information, incoming call information, new message reminder information, music information, etc. The customized user interface can support page turning, display information cards on the main interface, and display second application icons of other applications on other interfaces. Users can choose to add or delete applications displayed in the customized user interface.

[0090] For example, Figure 4 4 is a schematic diagram of the state of an interconnected device and a mobile terminal before connection provided by an exemplary embodiment of the present application. Among them, the mobile terminal screen displays a desktop homepage 410. The desktop homepage 410 includes application icons 401 of applications A to K on the mobile terminal. The interconnected device screen displays an application startup interface 420. The application startup screen includes application icons 400 of applications 1 to 12. Optionally, before the interconnected device and the mobile terminal establish a communication connection, the mobile terminal can be in any state, such as a locked screen state, a black screen state, and an unlocked state.

[0091] Figure 5 This is a schematic diagram of the screen of the interconnected device and the mobile terminal in the mirror mode provided by an exemplary embodiment of the present application. In the mirror mode, the top border of the floating window displays "mirror mode" and the floating window controls (including return control 501, homepage return control 502, mode switching control 503, screen switching control 504 and close control 505). When the mobile terminal displays the desktop homepage, the mobile terminal desktop homepage is synchronously displayed in the floating window. The interconnected device displays the application icons 520 of applications A to E in the mobile terminal in the application startup interface 510.

[0092] Figure 6 6 is a schematic diagram of a screen of an interconnected device and a mobile terminal in an interconnected mode provided by an exemplary embodiment of the present application. In the interconnected mode, the top border of the floating window displays "interconnected mode" and floating window controls (including return control 601, homepage return control 602, mode switching control 603, screen switching control 604 and close control 605), and a customized user interface 600 is displayed in the floating window. The customized user interface 600 includes an information card 606 and a commonly used application shortcut icon 607. Among them, the information card 606 and the commonly used application shortcut icon 607 can both be used to start the application. The mobile terminal displays a screen-off screen 610.

[0093] Figure 7 It is a schematic diagram of screen comparison in interconnected mode and mirror mode provided by an exemplary embodiment of the present application. Among them, when the interconnected device receives a trigger operation for the first application icon 700 corresponding to application C, it displays the running screen 701 of application C in the floating window in the mirror mode and the interconnected mode. In the mirror mode, the mobile terminal synchronously displays the running screen 701 of application C. Since the screen 701 is carried on the mirrored virtual screen in the mirror mode, the screen content of the mirrored virtual screen is displayed on the mobile terminal screen. When the mobile terminal is off screen, it is easy to cause the floating window screen to be interrupted. In the interconnected mode, since the floating window displays the content carried on the background virtual screen of the mobile terminal, the mobile terminal can display the off screen screen 702.

[0094] The mobile terminal displays a screen-off image containing clock information. Optionally, when the mobile terminal does not set a screen-off image, the mobile terminal may also be in a black screen state. The interconnected device displays application icons of application A to application E in the mobile terminal in the application startup interface.

[0095] Optionally, when the interconnected device is a vehicle computer, a Carlink connection can be established between the vehicle computer and the mobile terminal to enable interaction between the vehicle computer and the mobile terminal in mirroring mode and interconnection mode.

[0096] In some embodiments, after the interconnected device establishes a communication connection with the mobile terminal, the floating window may display the mirrored screen in the mirroring mode by default, or display the interconnected screen in the interconnected mode by default. The default floating window mode after the connection is established can be determined by configuration operations, and the floating window mode can also remain the floating window mode adopted by the historical communication connection.

[0097] Optionally, after the interconnected device establishes a communication connection with the mobile terminal, the floating window mode may be determined by the interconnected device and notified to the mobile terminal, or may be determined by the mobile terminal and notified to the interconnected device.

[0098] In some embodiments, when the floating window mode is determined by the interconnected device, the interconnected device may send a mode activation instruction to the mobile terminal when a communication connection is established with the mobile terminal. The mode activation instruction is used to indicate the floating window mode for the floating window to be activated, and the mobile terminal is used to provide the interconnected device with a picture that conforms to the floating window mode indicated by the mode activation instruction. Then, the interconnected device configures the floating window according to the determined floating window mode.

[0099] In a possible implementation, the interconnected device sends a mode activation instruction indicating a default floating window mode to the mobile terminal, where the default floating window mode is configured inside the interconnected device. For example, the default floating window mode is a mirror mode, and the mode activation instruction is used to instruct the floating window to activate the mirror mode.

[0100] In another possible implementation, the interconnected device records the historical floating window mode, and sends a mode activation instruction indicating the historical floating window mode to the mobile terminal when the floating window mode remains unchanged. For example, the historical floating window mode is the interconnected mode, and the mode activation instruction instructs the floating window to enable the interconnected mode. After the floating window mode is switched from the interconnected mode to the mirror mode, when the communication connection between the interconnected device and the mobile terminal is disconnected, the historical floating window mode is changed to the mirror mode, and subsequently the interconnected device sends a mode activation instruction indicating the mirror mode to the mobile terminal.

[0101] Optionally, when the connected device is a car computer, the floating window mode can also be determined according to the number of passengers. Since the floating window is displayed synchronously with the mobile terminal in mirror mode, it is easy to leak user private information. The display content of the customized user interface in the interconnected mode can be customized by the user, which is conducive to protecting personal privacy. When the vehicle carries a small number of people, such as a single-person driving scenario, the connected device can adopt the mirroring mode to enjoy rich mobile terminal services. When the number of people on board is large, such as a passenger carrying scenario, the connected device can adopt the interconnected mode to protect user privacy.

[0102] In another possible implementation, when the interconnected device is a vehicle computer, the vehicle computer records the correspondence between the number of passengers and the floating window mode. When the number of passengers is one, the interconnected device sends a mode activation instruction indicating the mirror mode to the mobile terminal. When the number of passengers is at least two, the interconnected device sends a mode activation instruction indicating the interconnected mode to the mobile terminal.

[0103] In other embodiments, when the floating window mode is determined by the mobile terminal, the interconnected device can receive a mode activation instruction sent by the mobile terminal when a communication connection is established with the mobile terminal, and the mode activation instruction is used to indicate the floating window mode for activating the floating window; then, the interconnected device configures the floating window based on the floating window mode indicated by the mode activation instruction.

[0104] Optionally, the mobile terminal may be configured with a default floating window mode, may record historical floating window modes, and may also record corresponding relationships between scenes and floating window modes.

[0105] In a possible implementation, the mobile terminal determines the current scene according to the device connection status, the current location, the current time, and the sensor data. When the current scene is a scene where the user is alone, the interconnected device receives a mode activation instruction indicating the mirror mode sent by the mobile terminal. When the current scene is a public scene, the interconnected device receives a mode activation instruction indicating the interconnected mode sent by the mobile terminal.

[0106] Exemplarily, when the mobile terminal establishes a communication connection with an electronic device under a different user account or an unfamiliar device, or when the current time, location, and sensor data indicate that the mobile terminal is in a public scene, such as a holiday travel scene, a commuting scene, etc., and when the light sensor detects that the current scene is bright, the mobile terminal determines that the current scene is a public scene, and sends a mode activation instruction indicating the interconnection mode to the interconnected device. When the mobile terminal establishes a communication connection with an electronic device under the same user account, or when the current time, location, and sensor data indicate that the mobile terminal is in a solitary scene, such as a home scene, a lunch break scene, etc., and when the light sensor detects that the current scene is dim, the mobile terminal determines that the current scene is a solitary scene, and sends a mode activation instruction indicating the mirror mode to the interconnected device.

[0107] In some embodiments, the floating window mode can be flexibly switched between the mirror mode and the interconnection mode, and the mode switching is achieved through a switching operation. Optionally, the switching operation of the floating window mode may include a triggering operation of a mode switching control.

[0108] For example, Figure 8 This is a mode switching schematic diagram provided by an exemplary embodiment of the present application. When the interconnected device receives a trigger operation on the "mirror mode" control at the top of the floating window, the floating window mode is switched to the interconnected mode, the "interconnected mode" control is displayed at the top of the floating window, and the customized user interface is displayed in the floating window, and the mobile terminal can turn off the screen. Subsequently, the interconnected device receives a trigger operation on the "interconnected mode" control at the top of the floating window, the floating window mode is switched to the mirror mode, the "mirror mode" control is displayed at the top of the floating window, and the mobile terminal and the floating window synchronously display the desktop homepage of the mobile terminal.

[0109] Optionally, during the floating window mode switching process, the connected device may display a switching animation in the floating window.

[0110] Optionally, the floating window mode switching operation may be received and implemented by a mobile terminal, or may be received and implemented by an interconnected device.

[0111] In which, when the switching operation of the floating window mode is received and implemented by the interconnected device, the interconnected device switches the floating window mode of the floating window in response to the triggering operation of the mode switching control in the floating window; based on the switched floating window mode, a mode switching instruction is sent to the mobile terminal, and the mode switching instruction is used to instruct to switch the floating window mode of the floating window, and the mobile terminal is used to provide the interconnected device with a picture that conforms to the switched floating window mode based on the mode switching instruction.

[0112] Regarding the mobile terminal providing the interconnected device with a screen that conforms to the switched floating window mode, this is described in detail in the mobile terminal side embodiment, and is not described in the embodiment of the present application for the time being.

[0113] like Figure 8 As shown, the interconnected device receives a trigger operation on the "mirror mode" control and switches the floating window mode from the interconnected mode to the mirror mode. Then, the interconnected device sends a mode switching instruction for instructing the mobile terminal to switch to the mirror mode.

[0114] When the floating window mode switching operation is received and implemented by the mobile terminal, the interconnected device receives a mode switching instruction sent by the mobile terminal, where the mode switching instruction is used to indicate switching of the floating window mode of the floating window; and configures the floating window based on the switched floating window mode indicated by the mode switching instruction.

[0115] Optionally, when the mobile terminal receives a mode switching operation, the mode switching operation may include a trigger operation on a control, a voice input operation, a gesture operation, etc., which is not limited in this embodiment.

[0116] In some embodiments, the interconnected device can display a home return control in a floating window. The home return control is different from the return control. The return control is used to perform a single return operation, such as returning to the historical page before the jump after a page jump, while the home return control is used to return to the main interface.

[0117] During the process of returning to the main interface, the interconnected device responds to the triggering operation of the homepage return control in the floating window and sends a homepage return instruction to the mobile terminal, and the mobile terminal is used to close the target application based on the homepage return instruction and provide the interconnected device with a homepage screen, wherein the homepage screens provided by the mobile terminal in different floating window modes are different. Subsequently, the interconnected device displays the homepage screen in the floating window.

[0118] In a possible implementation, the interconnected device sends a homepage return event to the mobile terminal in response to a trigger operation on the homepage return control, and the homepage return event is included in a homepage return instruction. The mobile terminal calls the system interface, updates the application screen in the virtual screen to the main page of the application, and then sends a successful return to the homepage notification to the interconnected device and sends the screen data of the homepage screen.

[0119] In some embodiments, the home page screen provided by the mobile terminal in the mirroring mode is the desktop home page of the mobile terminal, and the home page screen provided by the mobile terminal in the interconnection mode is the home page of the customized user interface.

[0120] For example, Figure 8 As shown, the interconnected device sends a homepage return instruction to the mobile terminal in response to the triggering operation of the homepage return control 800 in the floating window. The return control 801 is used to perform a single return operation.

[0121] In a possible implementation scenario, the interconnected device first displays the desktop homepage provided by the mobile terminal in mirror mode, and the mobile terminal displays the desktop homepage screen at the same time. When the interconnected device receives a trigger operation on the first application icon in the application startup interface, or receives a trigger operation on the second application icon on the desktop homepage in the floating window, the floating window stops displaying the desktop homepage of the mobile terminal, and then displays the application interface of the currently started application, which is displayed both in the floating window and on the mobile terminal. Subsequently, when the interconnected device receives a trigger operation on the mode switching control, it switches the floating window mode to the interconnected mode. When the mobile terminal is off screen, the floating window in the interconnected mode still displays the application screen. When the interconnected device subsequently receives a trigger operation on the homepage return control, the homepage of the customized user interface is displayed in the floating window, and the desktop homepage of the mobile terminal is no longer displayed.

[0122] In the embodiments of the present application, the display methods of the floating window images in different floating window modes are different, and the display conditions of the mobile terminal are also different. Among them, a customized user interface can be displayed in the interconnected mode, which is conducive to ensuring user privacy; in the mirroring mode, the floating window displays a mirrored image, which is conducive to the mobile terminal providing rich services. The mirrored image conforms to the user's operating habits of the mobile terminal and can improve the convenience of operation.

[0123] Among them, when a communication connection is established between the interconnected device and the mobile terminal, the floating window mode can be determined by the interconnected device or by the mobile terminal, the mode switching can be initiated by the interconnected device or by the mobile terminal, and the floating window mode can be synchronized between the interconnected device and the mobile terminal through command interaction, which is conducive to improving the flexibility of setting the floating window mode.

[0124] Since the main pages in different floating window modes are different, the connected device can return to the main page in the current floating window mode when receiving a trigger operation on the home page return control, so that the floating window has the ability to return to the home page, thereby improving the functional richness of the floating window.

[0125] In some embodiments, in order to prevent the floating window from blocking the display screen of the interconnected device, the floating window provides a closing control. The interconnected device also provides a floating window float to redisplay the floating window.

[0126] In some embodiments, the interconnected device may stop displaying the floating window and display the floating window icon in response to a trigger operation on a close control in the floating window. The interconnected device may also redisplay the floating window in response to a trigger operation on the floating window icon.

[0127] Optionally, the floating window float may display the connection status between the mobile terminal and the Internet device, for example, the floating window float displays the terminal name and connection status of the mobile terminal that is communicatively connected to the Internet device.

[0128] In some embodiments, the floating window mode of the redisplayed floating window remains consistent with the floating window mode before the floating window is closed.

[0129] In some embodiments, after the floating window is closed, when the mobile terminal sends a mode switching instruction to the interconnected device, the floating window mode of the redisplayed floating window is the floating window mode indicated by the mode switching instruction.

[0130] Optionally, the connected device may also switch to the floating window mode when receiving a long press operation on the floating window float.

[0131] For example, Fig. 9 The following is a schematic diagram of the implementation of the floating window closing and display process provided by an exemplary embodiment of the present application. The interconnected device first displays the application screen of application C synchronously with the mobile terminal in the mirror mode, and then, upon receiving a click operation on the close control 900 in the floating window, closes the floating window, displays the floating window buoy 901, and displays "interconnected" on the floating window buoy 901, indicating that the interconnected device maintains a communication connection with the mobile terminal. At this time, the mobile terminal exits the application screen and displays the desktop homepage. Subsequently, upon receiving a click operation on the floating window buoy 901, the interconnected device redisplays the floating window in the mirror mode, and displays the desktop homepage of the mobile terminal in the floating window according to the mobile terminal screen.

[0132] It should be noted that when the interconnected device starts and controls the application in the mobile terminal, the application still runs on the mobile terminal, not on the interconnected device. In order to realize the above screen display on the interconnected device, the interconnected device and the mobile terminal need to interact with each other, that is, the interconnected device needs to transmit a request to the mobile terminal when receiving a trigger operation to close the control, and the mobile terminal decides whether to provide the screen.

[0133] In some embodiments, the interconnected device sends a floating window closing instruction to the mobile terminal in response to a triggering operation of closing a control in the floating window, wherein the mobile terminal is used to stop providing images to the interconnected device based on the floating window closing instruction. When the mobile terminal stops providing images, the interconnected device stops displaying the floating window and displays a floating window icon.

[0134] In a possible implementation, the interconnected device sends a stop application event to the mobile terminal in response to a trigger operation of closing the control in the floating window, and the stop application event is included in the floating window closing instruction. The mobile terminal calls the system interface to close the application in the virtual screen, and then sends a successful closing notification to the interconnected device.

[0135] In some embodiments, the interconnected device sends a floating window opening instruction to the mobile terminal in response to a triggering operation on the floating window float, and the mobile terminal is used to re-provide the picture to the interconnected device based on the floating window opening instruction. Subsequently, the interconnected device re-displays the picture provided by the mobile terminal in the floating window.

[0136] In a possible implementation, the interconnected device sends an application startup event to the mobile terminal in response to a trigger operation on the floating window float, and the application startup event is included in the floating window startup instruction. The mobile terminal calls the system interface, draws the application screen of the application on the virtual screen, and then sends a successful startup notification to the interconnected device.

[0137] In the embodiment of the present application, the interconnected device can hide the floating window or reopen the floating window, thereby reducing the interference of the floating window occupying the display space of the interconnected device on the interconnected device, which is conducive to improving the display flexibility of the floating window.

[0138] The interconnected device notifies the mobile terminal to stop providing images by sending a floating window closing instruction, and notifies the mobile terminal to provide images again by sending a floating window opening instruction, thereby realizing control over the floating window and improving the flexibility of the floating window display.

[0139] In some embodiments, the screen display direction of the mobile terminal includes a horizontal screen direction and a vertical screen direction. Accordingly, when the floating window displays the picture provided by the mobile terminal, the picture can also be displayed in the horizontal screen direction or the vertical screen direction.

[0140] In some possible application scenarios, the floating window needs to display a horizontal screen in the mirror mode or interconnected mode. For example, in the video playback scenario, the floating window displays the horizontal screen of the video playback, and in the game scenario, the floating window displays the horizontal screen of the game.

[0141] Optionally, when receiving a screen direction switching notification sent by a mobile terminal, the interconnected device may configure a floating window that matches the screen direction based on the screen direction indicated by the screen direction switching notification.

[0142] In some embodiments, the screen direction switching notification is sent by the mobile terminal to the interconnected device when it is determined that there is a screen direction switching event, to indicate the screen direction.

[0143] Among them, the screen direction switching event is used to indicate that the display direction of the picture content on the mobile terminal screen has changed. In the event of a screen switching event, the interconnected device configures a floating window that matches the screen direction.

[0144] It should be noted that the interconnected device does not have the ability to determine the screen direction switching event. When the interconnected device receives the user operation, it forwards the operation event to the mobile terminal, and the mobile terminal determines whether there is a screen direction switching event. When the mobile terminal determines that there is a screen direction switching event, the interconnected device can receive the screen direction switching notification sent by the mobile terminal.

[0145] The screen direction switching event that triggers the screen direction switching notification includes at least one of the following:

[0146] 1. The screen orientation of the mobile terminal changes.

[0147] In a possible application scenario, when the screen orientation of the mobile terminal changes, the mobile terminal can automatically switch the display orientation of the application screen and send a screen switching notification to the connected device. When the connected device receives the screen switching notification, it configures a floating window that matches the screen orientation of the mobile terminal.

[0148] For example, during the video playback process of the mobile terminal, the screen orientation of the mobile terminal changes from portrait to landscape, so that the video is played in full screen on the mobile terminal screen. The interconnected device receives the screen orientation switching notification sent by the mobile terminal, and then configures a floating window to display the landscape playback screen of the video application according to the screen orientation indicated by the notification.

[0149] 2. The mobile terminal receives a trigger operation on a screen direction switching control in the target application.

[0150] Optionally, the triggering operation of the screen direction switching control may include a click operation, a voice input operation, or a visual control operation triggered by the human eye. The embodiment of the present application does not limit the triggering operation.

[0151] Optionally, the screen direction switching control may be a full-screen control within an application, such as a full-screen video playback control in a video playback application.

[0152] Optionally, the screen orientation switching control may also be a landscape mode control within the application. For example, a browser or social software has a landscape display mode and a portrait display mode. When the mobile terminal receives a trigger operation on the landscape mode control, the browser or social software enters the landscape display mode and displays a landscape screen.

[0153] In the embodiment of the present application, any control that can be used to change the display direction of an application screen on a mobile terminal screen can be used as a screen direction switching control within a target application.

[0154] 3. The mobile terminal receives a reverse control instruction sent by the interconnected device, and the reverse control instruction is used to trigger a screen direction switching control in the target application.

[0155] In some embodiments, the reverse control instruction is used to forward the operation event to the mobile terminal when the interconnected device receives the user operation. When the operation event indicates triggering the screen direction switching control in the target application, the mobile terminal determines that there is a screen direction switching event.

[0156] Optionally, the reverse control instruction may include the operation coordinates and operation type of the user operation.

[0157] Exemplarily, when a user clicks or touches the floating window, the interconnected device sends a click event or a touch event to the mobile terminal, where the touch event includes the click or touch position, so that the mobile device determines whether there is a screen direction switching event.

[0158] Optionally, the screen direction switching control within the target application may include a full-screen control, a landscape mode control, or the like within the application that can be used to change the display direction of the application on the mobile terminal screen, which is not limited in this embodiment of the present application.

[0159] In some possible application scenarios, when the connected device has a display requirement, the screen provided by the mobile terminal may occupy the display space, causing display interference to the connected device. For example, in a vehicle driving scenario, the vehicle screen needs to display the navigation screen, vehicle operation status, etc., and the floating window may interfere with the display of the vehicle screen.

[0160] Optionally, when the screen orientation indicated by the screen orientation switching notification is the horizontal orientation, the interconnected device may configure the floating window in the horizontal state based on the horizontal floating window size. The horizontal floating window size may be consistent with the screen size of the mobile terminal in the horizontal state, or the horizontal floating window size may be in the same ratio as the screen size of the mobile terminal in the horizontal state.

[0161] For example, Fig.10 The present invention provides a schematic diagram of an implementation of a screen direction switching process in a mirror mode provided by an exemplary embodiment of the present application. The mobile terminal and the interconnected device synchronously display the application C screen 1000 in the mirror mode. The application C is a video application, and the application C screen 1000 includes an application C video screen 1010 and an application C content screen 1020. A full-screen control 1001 is displayed in the application C video screen 1010, which is used to display the application C video screen 1010 in full screen in the mobile terminal.

[0162] When receiving a touch operation, the interconnected device forwards the touch event to the mobile terminal. The mobile terminal determines that the touch operation is used to trigger the full-screen control according to the touch event, and then displays the video screen 1010 of application C in full screen, and sends a screen direction switching notification to the interconnected device, instructing the interconnected device to configure a horizontal screen floating window with the screen size in the horizontal screen state, and display the video screen 1010 of application C in full window in the floating window. Among them, when the interconnected device is not touchable, the interconnected device can receive a click operation and forward the click event to the mobile terminal.

[0163] For example, Fig.11 The following is a schematic diagram of an implementation of a screen direction switching process in an interconnected mode provided by an exemplary embodiment of the present application. The mobile terminal can display a screen-off screen 1101 in the interconnected mode, and the interconnected device displays an application C screen 1102. Application C is a video application, and the application C screen 1102 includes an application C video screen 1103 and an application C content screen 1104. A full-screen control 1105 is displayed in the application C video screen 1103, which is used to display the application C video screen 1103 in full screen in the mobile terminal.

[0164] When receiving a touch operation, the interconnected device forwards the touch event to the mobile terminal. The mobile terminal determines that the touch operation is used to trigger the full-screen control according to the touch event, and still displays the screen-off screen 1101, displays the video screen 1103 of application C in full screen on the background virtual screen, and sends a screen direction switching notification to the interconnected device, instructing the interconnected device to configure a horizontal screen floating window with the screen size in the horizontal screen state, and display the video screen 1103 of application C in full window in the floating window. Among them, when the interconnected device is not touchable, the interconnected device can receive a click operation and forward the click event to the mobile terminal.

[0165] In other possible application scenarios, users may have the need to display the application interface in full screen on the connected device. If the projection screen of the mobile terminal does not interfere with the screen display of the connected device, the connected device can configure the floating window size to display the screen provided by the mobile terminal in full screen. For example, in the scenario of vehicle parking, the vehicle computer can display the screen provided by the mobile terminal in full screen.

[0166] Optionally, when the screen orientation indicated by the screen orientation switching notification is a landscape orientation, the connected device may configure a floating window in a full-screen state based on a screen size of the connected device.

[0167] In a possible implementation, the interconnected device configures the floating window size to be the same as the screen size of the interconnected device.

[0168] In another possible implementation, the interconnected device configures the floating window in the full-screen state according to a size ratio corresponding to a screen size of the interconnected device.

[0169] For example, Fig.12 A schematic diagram of the implementation of the screen direction switching process provided by another exemplary embodiment of the present application is shown. Since the interface display of the screen direction switching process in the mirror mode is similar to that in the interconnected mode, the mobile terminal can keep the screen off in the interconnected mode, so this example is explained by taking the mirror mode as an example. The mobile terminal and the interconnected device synchronously display the application C screen 1200 in the mirror mode. Application C is a video application, and the application C screen includes an application C video screen 1201 and an application C content screen 1202. A full-screen control 1203 is displayed in the application C video screen, which is used to display the application C video screen 1201 in full screen in the mobile terminal.

[0170] When receiving a click operation (touch operation), the interconnected device forwards the click event (touch event) to the mobile terminal. The mobile terminal determines to trigger the full-screen control according to the click event (touch event), displays the video screen 1201 of application C in full screen, and sends a screen direction switching notification to the interconnected device, instructing the interconnected device to configure a full-screen floating window with the screen size of the interconnected device, and displays the video screen 1201 of application C in full screen.

[0171] It should be noted that when the screen direction indicated by the screen direction switching notification is landscape, the floating window images in mirror mode and interconnected mode are carried on different virtual screens on the mobile terminal. Therefore, the screen direction switching process on the mobile terminal side in mirror mode and interconnected mode is not the same.

[0172] Optionally, after configuring the floating window state to be full screen state or horizontal screen state, the interconnected device may send a floating window state notification to the mobile terminal, indicating the floating window state configured by the interconnected device, so that the mobile terminal configures the virtual screen according to the floating window state and provides a picture.

[0173] In the embodiment of the present application, the interconnected device can configure a floating window that matches the screen direction when the screen direction is switched, thereby improving the adaptability of the floating window to the application screen.

[0174] Among them, the mobile terminal can notify the interconnected device to configure a floating window that matches the screen direction when the three screen directions are switched, so that the floating window can match the screen direction in various situations, improve the matching degree between the floating window and the screen direction, and thus improve the display effect of the floating window.

[0175] When the screen orientation is horizontal, the connected device can be configured with a horizontal floating window to reduce the interference of the floating window on the screen display of the connected device. The connected device can also be configured with a full-screen floating window, so that the floating window can display the application screen in full screen on the connected device, enriching the display mode of the floating window.

[0176] The above embodiment illustrates that, when the interconnected device receives a triggering operation on the full-screen control of the application in the floating window, the interconnected device configures the horizontal floating window to display the application screen.

[0177] In some embodiments, the floating window can also provide a full-screen control, so that the connected device displays the application screen in the floating window in full screen.

[0178] Optionally, the interconnected device may send a full-screen instruction to the mobile terminal in response to a trigger operation on the full-screen control in the floating window. The mobile terminal is used to provide a full-screen image to the interconnected device based on the full-screen instruction. Then, the interconnected device configures the floating window in the full-screen state.

[0179] It should be noted that the full-screen control in the floating window is different from the full-screen control in the application interface in the floating window. The connected device can determine whether the full-screen control in the floating window is triggered, but cannot determine whether the full-screen control in the application interface is triggered. It is necessary to forward the event so that the mobile terminal can determine whether the full-screen control in the application interface is triggered.

[0180] Optionally, when the application can adapt to the screen size of the interconnected device, or adapt to the horizontal screen mode of other interconnected devices other than the current interconnected device, the mobile terminal can provide a full-screen image to the interconnected device according to the interface display mode of the application.

[0181] In an illustrative example, a video application may have different interface display modes on different electronic devices. Among them, on a smartphone, it may be displayed as a quick browsing page for switching video content by sliding, and on an interconnected device such as a tablet, a car computer, or a television, it may be displayed as a video list page for triggering video playback by clicking. When the current interconnected device is a car computer, and the video application can display the video list page in landscape mode on the car computer, or can display the video list page in landscape mode on other interconnected devices such as a tablet, a television, or a personal computer, the mobile terminal provides the interconnected device with a full-screen display of the video list page.

[0182] Optionally, the floating window in full screen mode can also display the application interface in parallel windows, screen stretching, etc. Among them, parallel windows are screen adaptation methods designed for tablets or folding screens. In parallel windows, the application interface can be displayed as two parallel interfaces. For example, the application homepage and item details interface of a shopping application are displayed in split screens in parallel windows.

[0183] For example, Fig.13As shown, the interconnected device responds to the triggering operation of the full-screen control 1300 in the floating window and sends a full-screen instruction to the mobile terminal. When application C does not have a display mode adapted to the interconnected device, the interconnected device displays the application C video screen 1303 on one side of the parallel window and displays the application C content screen 1304 on the other side of the parallel window according to the screen provided by the mobile terminal.

[0184] Optionally, for applications that are not compatible with parallel windows, the floating window can display a stretched application interface in full screen mode, or display the application interface in the center of the full screen mode without changing the screen size of the application interface.

[0185] For example, Fig.13 As shown, the interconnected device responds to the triggering operation of the full-screen control 1300 in the floating window and sends a full-screen instruction to the mobile terminal. When application C does not have a display mode that is compatible with the interconnected device and is not compatible with parallel windows, the interconnected device displays the application C video screen 1305 and the application C content screen 1306 arranged vertically in the center of the floating window in the full-screen state according to the picture provided by the mobile terminal, or displays the application C video screen 1307, the application C content screen 1308, and the application C video directory screen 1309 hidden outside the screen before the screen is stretched in the stretched screen.

[0186] Optionally, the interconnected device may send a recovery instruction to the mobile terminal in response to the re-triggering operation of the full-screen control 1300 in the floating window, and the mobile terminal provides a vertical screen image to the interconnected device based on the recovery instruction, so that the interconnected device configures the floating window in the vertical state based on the vertical floating window size.

[0187] In some embodiments, the floating window state includes a horizontal screen state, a vertical screen state and a full screen state. Among them, the floating window size in the horizontal screen state and the vertical screen state is determined based on the screen size of the mobile terminal, and the floating window size in the full screen state is determined based on the screen size of the interconnected device. The size of the mirrored virtual screen needs to be determined based on the screen size of the mobile terminal, while the background virtual screen can be determined based on the screen size of the mobile terminal or the screen size of the interconnected device. Since the size of the mirrored virtual screen cannot be determined based on the screen size of the interconnected device, switching the full-screen floating window in the mirroring mode requires moving the picture from the mirrored virtual screen to the background virtual screen.

[0188] See also Fig.14 , Fig.14A schematic diagram of an interconnected device screen displaying a floating window in a parallel window manner provided by an exemplary embodiment of the present application is shown. When the interconnected device receives a click operation on the full-screen control 1401 in the floating window, the parallel window content A of application C and the parallel window content B of application C are simultaneously displayed in the parallel window 1402. Since the size of the full-screen floating window is different from the size of the horizontal screen floating window, in order to switch the full-screen floating window in the mirror mode, it is necessary to close the mirror virtual screen, start the background virtual screen, and carry the picture on the background virtual screen to obtain the full-screen picture. Therefore, when displaying the parallel window 1402, the mobile terminal changes from displaying the application C picture 1400 to displaying the desktop homepage 1403. Optionally, the mobile terminal can also turn off the screen.

[0189] In an embodiment of the present application, the interconnected device can configure a full-screen floating window and display a full-screen image when receiving a trigger operation on a full-screen control in the floating window, so that the application image in the floating window can be played in full screen without the need for the application to provide a full-screen control, thereby enriching the display function of the floating window.

[0190] In some embodiments, the interconnected device may select applications allowed to be displayed on the interconnected device from the applications in the mobile terminal, and display the first application icons corresponding to the screened applications in the application launch interface.

[0191] See also Fig.15 , Fig.15 FIG. 1 is a flowchart of a display process of a first application icon provided by an exemplary embodiment of the present application. The process includes the following steps.

[0192] Step 1501: The interconnected device receives a first application list sent by a mobile terminal, where the first application list includes application programs in the mobile terminal.

[0193] In some embodiments, the mobile terminal notifies the interconnected device of the applications present in the mobile terminal by sending a first application list. The first application list only needs to store probabilistic information that can characterize the applications in the mobile terminal, such as the package name of the application and the ID (IDentity) of the application. Optionally, the first application list may include all applications in the mobile terminal that can be projected to the interconnected device.

[0194] Step 1502: Determine a second application list based on the first application list, where the second application list includes application programs screened from the first application list.

[0195] In some embodiments, the second application list is a list of application programs in the first application list that allow the first application icon to be displayed on the application launch interface of the interconnected device.

[0196] Optionally, to avoid repeated display of application icons, the interconnected device may select a mobile terminal application that does not overlap with the local application according to the overlap between the local application and the application on the mobile terminal, and display the corresponding first application icon.

[0197] In some embodiments, the second application list may also be a list of application programs in the first application list that are allowed to display application screens in the floating window of the interconnected device.

[0198] Optionally, in order to protect user privacy, an application whitelist may be provided inside the interconnected device, and the whitelist is used to record the applications that are allowed to be started by the interconnected device. The whitelist may be customized by the user. The interconnected device adds the applications that are in the first application list and exist in the application whitelist to the second application list.

[0199] Optionally, in order to maintain the device security of the interconnected device and the mobile terminal, the interconnected device may also set an application blacklist, which is used to prohibit the application from launching malicious programs through interface jumps. The interconnected device removes the applications in the blacklist from the first application list to obtain a second application list.

[0200] Step 1503: Send an application information acquisition request to the mobile terminal based on the second application list, where the application information acquisition request is used to acquire application information of the application programs in the second application list.

[0201] In some embodiments, the application information of the application program in the second application list is the application information required to display the first application icon on the application launch interface of the interconnected device. Optionally, the application information may include an application name, an application package name, an application ID, an application icon, and the like.

[0202] In a possible scenario, the interconnected device may jump between applications so that the screen jumps to an application screen of an application outside the second application list.

[0203] In another possible scenario, the interconnected device may receive a triggering operation on the second application icon in the mirroring mode, prompting the mobile terminal to start an application outside the second application list.

[0204] In order to solve the problem in the above scenario and avoid the application that does not belong to the second application list from displaying the application screen in the interconnected device, optionally, the mobile terminal can record the second application list according to the application information acquisition request to avoid providing the application screen of the application outside the second application list to the interconnected device.

[0205] In some embodiments, when the second application icon in the picture displayed in the floating window is triggered, the picture displayed by the interconnected device in the floating window is provided by the mobile terminal, and the response logic to the triggering operation of the second application icon is also completed by the mobile terminal.

[0206] Optionally, the interconnected device may display the application screen in the floating window in response to a trigger operation on the second application icon in the screen displayed in the floating window, and if the target application indicated by the trigger operation belongs to the second application list, wherein whether the target application indicated by the trigger operation belongs to the second application list is determined by the mobile terminal.

[0207] In a possible implementation, when the interconnected device receives an interactive operation of the user on the content of the screen displayed in the floating window, such as a PC receiving a click operation of the user and a PAD receiving a touch operation of the user, the interconnected device sends a reverse control instruction containing the interactive event to the mobile terminal, and the reverse control instruction is used to trigger the start of the target application. When the mobile terminal determines that the interactive operation of the user indicated by the interactive event is a triggering operation on the second application icon in the screen displayed in the floating window, and the mobile terminal determines that the target application indicated by the triggering operation belongs to the second application list, the mobile terminal provides the application screen to the interconnected device, and then the interconnected device displays the application screen in the floating window.

[0208] Optionally, the interconnected device may also display an application launch failure prompt message in response to a trigger operation on the second application icon in the screen displayed in the floating window, and if the target application indicated by the trigger operation does not belong to the second application list. For example, the interconnected device displays "The application is prohibited from launching" or "Application launch failed".

[0209] In a possible implementation, when the interconnected device receives an interactive operation of the user on the content of the screen displayed in the floating window, it sends a reverse control instruction containing the interactive event to the mobile terminal, and the reverse control instruction is used to trigger the start of the target application. When the mobile terminal determines that the interactive operation of the user indicated by the interactive event is a triggering operation on the second application icon in the screen displayed in the floating window, and the mobile terminal determines that the target application indicated by the triggering operation does not belong to the second application list, the mobile terminal prohibits the start of the target application and notifies the interconnected device of the startup failure, and then the interconnected device displays a prompt message of the application startup failure in the floating window.

[0210] Step 1504: display a first application icon in an application startup interface based on the application information sent by the mobile terminal.

[0211] Optionally, the interconnected device can display the first application icon in the application launch interface according to the application information sent by the mobile terminal and the specific pattern, so as to distinguish the application icon of the local application on the interconnected device from the first application icon. The interconnected device can also change the color of the application name, etc., which is not performed in the embodiment of the present application.

[0212] In the embodiment of the present application, the interconnected device can determine the application to display the first application icon by screening the first application list provided by the mobile terminal, thereby avoiding repeated display of application icons for the same application existing in the interconnected device and the mobile terminal, resulting in redundant application functions.

[0213] The interconnected device can also receive a trigger operation on the second application icon, and when the triggered target application belongs to the second application list, the application screen of the application in the second application list is displayed in the floating window, avoiding displaying the application interface of the application outside the second application list.

[0214] In the case where the triggered target application belongs to the second application list, the interconnected device can provide application startup failure prompt information, indicating that the application cannot be started, thereby improving the information feedback capability of the floating window.

[0215] In order to realize the above functions, the mobile terminal needs to interact with the interconnected device to execute instructions and provide the interconnected device with a screen according to the instructions. The following embodiment mainly describes the application display method from the mobile terminal side.

[0216] In some embodiments, the mobile terminal provides a picture to the interconnected device by sending picture data to the interconnected device, and the interconnected device displays the picture in a floating window according to the picture data provided by the mobile terminal.

[0217] See also Fig.16 , Fig.16 This is a flow chart of a method for displaying applications on a mobile terminal provided by an exemplary embodiment of the present application. The method comprises the following steps.

[0218] Step 1601, when a communication connection is established with an interconnected device, screen data is sent to the interconnected device, and the interconnected device is used to display the screen provided by the mobile terminal in a floating window in the application startup interface based on the screen data.

[0219] Optionally, the communication connection established between the interconnected device and the mobile terminal may be a WIFI connection, a Bluetooth connection, a wired connection, etc. The embodiment of the present application does not limit the communication connection method between the interconnected device and the mobile terminal.

[0220] In some embodiments, the screen data sent by the mobile terminal is used to support the interconnected device to realize screen display. When the interconnected device needs to display different screens, the mobile terminal provides different screen data for the interconnected device.

[0221] Optionally, the screen data provided by the mobile terminal to the interconnected device may include screen data for displaying a home screen and screen data for displaying an application screen of an application. The home screen and the application screen are displayed in a floating window of the interconnected device. The home screen is used to display the application icon of the application in the mobile terminal so as to trigger the display of the application screen later.

[0222] In some embodiments, the application launch interface is used to display the application icon so that the interconnected device can launch the application program when receiving a trigger operation on the application icon. The application launch interface of the interconnected device displays the application icon of the local application program of the interconnected device and the first application icon of the application program in the mobile terminal.

[0223] Step 1602, start the target application, the target application is the first application icon in the application start interface, or the application indicated by the second application icon in the screen displayed by the floating window, the first application icon and the second application icon are icons of applications in the mobile terminal.

[0224] In some embodiments, the first application icon is used to quickly start an application on a mobile terminal. In order to distinguish the first application icon from the application icon of the application on the interconnected device, the interconnected device may, when displaying the first application icon, display an application mark on the first application icon to indicate that the application originated from the mobile terminal. The application mark may be a specific pattern, such as a mobile terminal pattern. Optionally, the interconnected device may also change the display color of the application name of the application on the mobile terminal on the interconnected device. This application does not limit the method of distinguishing the application represented by the first application icon from the local application of the interconnected device.

[0225] In some embodiments, the second application icon is an icon of an application in the mobile terminal displayed in the floating window. Optionally, the second application icon in the floating window and the first application icon in the application launch interface may represent the same application or different applications. For example, the second application icon includes application icons of all applications in the mobile terminal, and the first application icon includes application icons of some applications that allow quick launch.

[0226] In some embodiments, the interconnected device sends a program start instruction to the mobile terminal in response to a triggering operation on a first application icon in an application start interface or a second application icon in a screen displayed in a floating window. Upon receiving the program start instruction, the mobile terminal starts a target application indicated by the program start instruction.

[0227] Step 1603: Send the screen data of the target application to the interconnected device, and the interconnected device is used to display the running screen of the target application in a floating window based on the screen data of the target application.

[0228] Optionally, the picture data sent by the mobile terminal may be audio and video stream data, including at least one of audio data and video data. When the audio and video stream data is audio stream data, the interconnected device plays the audio data corresponding to the audio stream data through a sound playback unit such as a speaker; when the audio and video stream data is video stream data, the interconnected device plays the video data corresponding to the video stream data in a floating window; when the audio and video stream data is audio stream data and video stream data, the sound playback unit of the interconnected device plays the audio data corresponding to the audio stream data, and plays the video data corresponding to the video stream data in a floating window at the same time.

[0229] In the embodiment of the present application, the mobile terminal can send screen data to the interconnected device when the interconnected device starts the application of the mobile terminal through the first application icon on the application start interface, or starts the application of the mobile terminal through the second application icon in the floating window, supports the interconnected device to start the application in different ways, and realizes the multi-entry start of the application in the mobile terminal on the interconnected device. In addition, the screen data provided by the mobile terminal is used to display the screen in the floating window, not in the new window, which is conducive to reducing the interference of the mobile terminal application screen on the interconnected device.

[0230] In some embodiments, the floating window displayed by the interconnected device has different floating window modes, and the screen data provided by the mobile terminal is different in different floating window modes. The floating window modes include mirror mode and interconnected mode.

[0231] It should be noted that when the mobile terminal provides screen data for the interconnected device, it needs to first determine the display screen carried by the virtual screen in the virtual screen of the mobile terminal, and then send the screen data corresponding to the display screen to the interconnected device so that the interconnected device can display the corresponding screen in the floating window.

[0232] In some embodiments, in different floating window modes, the mobile terminal uses different virtual screens. In the mirror mode, the mobile terminal uses the mirror virtual screen to carry the mirror image. Since launching the application in the mirror mode actually launches the application on the mobile terminal screen, the content of the mirror image is consistent with the content displayed on the mobile terminal screen. When the mobile terminal turns off the screen, the display of the mirror image is interrupted.

[0233] In the interconnected mode, the mobile terminal uses the background virtual screen to carry the interconnected screen. The background virtual screen is different from the mirrored virtual screen. The background virtual screen does not need to display the same screen on the mobile terminal screen synchronously, but determines the display content of the interconnected screen in the background of the mobile terminal, and then determines the screen data corresponding to the interconnected screen. In the interconnected mode, the mobile terminal can turn off the screen.

[0234] In some embodiments, when the floating window mode is different, the mobile terminal performs different steps of sending the screen data.

[0235] Optionally, when the floating window is in mirror mode, the mobile terminal sends the image data of the mirror image to the interconnected device. The mirror image is carried in the mirror virtual screen. The interconnected device receives the image data and displays the mirror image in the floating window in the mirror mode. The mirror image can be understood as a projection of the content of the mobile terminal screen.

[0236] Optionally, when the floating window is in the interconnection mode, the mobile terminal sends the screen data of the interconnection screen to the interconnection device, where the interconnection screen is the screen of the customized user interface in the interconnection mode, and the interconnection mode refers to the mode in which the interconnection device and the mobile terminal establish a communication connection. The interconnection screen is carried in the background virtual screen, the interconnection device receives the screen data, and displays the interconnection screen in the floating window in the interconnection mode.

[0237] The customized user interface includes a second application icon, and the user can customize the display content of the customized user interface in the customized user interface. For example, filter the second application icon displayed in the floating window, adjust the presentation form and arrangement position of the second application icon. It should be noted that the content adjustment in the customized user interface does not affect the screen image of the mobile terminal.

[0238] Optionally, the customized user interface can also display important information in the form of cards, such as schedule information, incoming call information, new message reminder information, music information, etc. The customized user interface can support page turning, display information cards on the main interface, and display second application icons of other applications on other interfaces. Users can choose to add or delete applications displayed in the customized user interface. Optionally, the second application icons of commonly used applications can also be displayed at the bottom of the customized user interface to enable quick launch of commonly used applications.

[0239] In some embodiments, after the interconnected device establishes a communication connection with the mobile terminal, the floating window may display the mirrored screen in the mirroring mode by default, or display the interconnected screen in the interconnected mode by default. The default floating window mode after the connection is established can be determined by configuration operations, and the floating window mode can also remain the floating window mode adopted by the historical communication connection.

[0240] Optionally, after the interconnected device establishes a communication connection with the mobile terminal, the floating window mode may be determined by the interconnected device and notified to the mobile terminal, or may be determined by the mobile terminal and notified to the interconnected device.

[0241] In some embodiments, when the floating window mode is determined by the interconnected device, when the mobile terminal and the interconnected device have established a communication connection, the interconnected device sends a mode activation instruction to the mobile terminal, and the mobile terminal receives the mode activation instruction sent by the interconnected device. The mode activation instruction is used to indicate the floating window mode of the floating window activation. Then, the mobile terminal generates screen data based on the floating window mode indicated by the mode activation instruction.

[0242] In a possible implementation, the mobile terminal receives a mode activation instruction indicating a default floating window mode, where the default floating window mode is configured inside the interconnected device.

[0243] In another possible implementation, the interconnected device records the historical floating window mode, and when the floating window mode remains unchanged, the mobile terminal receives a mode activation instruction indicating the historical floating window mode sent by the interconnected device. For example, the historical floating window mode is the interconnected mode, and the mode activation instruction instructs the floating window to enable the interconnected mode. After the floating window mode is switched from the interconnected mode to the mirror mode, when the communication connection between the interconnected device and the mobile terminal is disconnected, the historical floating window mode is changed to the mirror mode, and subsequently the interconnected device sends a mode activation instruction indicating the mirror mode to the mobile terminal.

[0244] Optionally, when the connected device is a car computer, the floating window mode can also be determined according to the number of passengers. Since the floating window is displayed synchronously with the mobile terminal in mirror mode, it is easy to leak user private information. The display content of the customized user interface in the interconnected mode can be customized by the user, which is conducive to protecting personal privacy. When the vehicle carries a small number of people, such as a single-person driving scenario, the connected device can adopt the mirroring mode to enjoy rich mobile terminal services. When the number of people on board is large, such as a passenger carrying scenario, the connected device can adopt the interconnected mode to protect user privacy.

[0245] In another possible implementation, when the interconnected device is a vehicle computer, the vehicle computer records the correspondence between the number of passengers and the floating window mode. When the number of passengers is one, the interconnected device sends a mode activation instruction indicating the mirror mode to the mobile terminal. When the number of passengers is at least two, the interconnected device sends a mode activation instruction indicating the interconnected mode to the mobile terminal.

[0246] In other embodiments, when the floating window mode is determined by the mobile terminal, the mobile terminal may establish a communication connection with the interconnected device and send a mode activation instruction to the interconnected device based on the mode setting operation when receiving the mode setting operation. The mode setting operation is used to set the floating window mode of the floating window at the interconnected device, and the interconnected device is used to receive the mode activation instruction sent by the mobile terminal, and then configure the floating window based on the floating window mode indicated by the mode activation instruction. Then, the mobile terminal generates screen data based on the floating window mode indicated by the mode setting operation.

[0247] Optionally, the mode setting operation may include a trigger operation on a mode setting control, a voice input operation, a shortcut gesture operation, or the like for setting the floating window mode. The embodiment of the present application does not limit the specific operation method of the mode setting operation.

[0248] Optionally, the mobile terminal may be configured with a default floating window mode, may record historical floating window modes, and may also record corresponding relationships between scenes and floating window modes.

[0249] In a possible implementation, the mobile terminal determines the current scene according to the device connection status, the current location, the current time, and the sensor data. When the current scene is a scene where the user is alone, the interconnected device receives a mode activation instruction indicating the mirror mode sent by the mobile terminal. When the current scene is a public scene, the interconnected device receives a mode activation instruction indicating the interconnected mode sent by the mobile terminal.

[0250] Exemplarily, when the mobile terminal establishes a communication connection with an electronic device under a different user account or an unfamiliar device, or when the current time, location, and sensor data indicate that the mobile terminal is in a public scene, such as a holiday travel scene, a commuting scene, etc., and when the light sensor detects that the current scene is bright, the mobile terminal determines that the current scene is a public scene, and sends a mode activation instruction indicating the interconnection mode to the interconnected device. When the mobile terminal establishes a communication connection with an electronic device under the same user account, or when the current time, location, and sensor data indicate that the mobile terminal is in a solitary scene, such as a home scene, a lunch break scene, etc., and when the light sensor detects that the current scene is dim, the mobile terminal determines that the current scene is a solitary scene, and sends a mode activation instruction indicating the mirror mode to the interconnected device.

[0251] Regarding the floating window configuration process, optionally, the mobile terminal first creates a virtual screen according to the floating window mode, then carries the display picture corresponding to the floating window mode on the virtual screen, then encodes the continuous display pictures to obtain video stream data, and finally sends the video stream data to the interconnected device so that the interconnected device can configure the floating window display picture.

[0252] In a possible implementation, when the mirror mode is started, the interconnected device sends a request to start the mirror mode floating window to the mobile terminal by calling the program interface. The mobile terminal calls the internal system interface to create a mirror virtual screen, and notifies the interconnected device that it is ready, and then the interconnected device creates a floating window. When the mobile terminal displays that the mirror virtual screen has content updates, the mobile terminal encodes the screen content of the mirror virtual screen, packages it in a specified format, and then sends it to the interconnected device. The interconnected device receives the video stream data and draws the picture in the floating window according to the decoded video stream data.

[0253] In another possible implementation, when the interconnection mode is started, the interconnected device sends a request to the mobile terminal to start the interconnection mode floating window by calling the program interface. The mobile terminal calls the internal system interface to create a background virtual screen and notifies the interconnected device that it is ready. Subsequently, the interconnected device creates a floating window, and the mobile terminal starts a customized user interface on the background virtual screen. When the background virtual screen has content updates, the mobile terminal encodes the screen content of the background virtual screen, packages it in a specified format, and then sends it to the interconnected device. The interconnected device receives the video stream data and draws the picture in the floating window according to the decoded video stream data. Among them, the display content of the background virtual screen will not be displayed on the mobile terminal screen.

[0254] In some embodiments, the floating window mode can be flexibly switched between the mirror mode and the interconnected mode, and the mode switching is achieved through a switching operation. Optionally, the floating window mode switching operation can be received and implemented by the mobile terminal, or can also be received and implemented by the interconnected device.

[0255] Wherein, when the floating window mode switching operation is received and implemented by the interconnected device, the interconnected device switches the floating window mode of the floating window in response to the triggering operation of the mode switching control in the floating window, and then sends a mode switching instruction to the mobile terminal. The mobile terminal receives the mode switching instruction sent by the interconnected device. Wherein, the mode switching instruction is used to indicate the switching of the floating window mode of the floating window. Then, the mobile terminal generates screen data based on the switched floating window mode indicated by the mode switching instruction, and then sends the screen data to the interconnected device, so as to provide the interconnected device with a screen that conforms to the switched floating window mode.

[0256] In some embodiments, when the mobile terminal receives a mode switching instruction sent by an interconnected device, or receives a floating window mode switching operation, it first destroys the virtual screen used to carry the picture before the mode switching, and then creates a virtual screen that matches the floating window mode after the switching. After the virtual screen is successfully created, the screen data is generated according to the picture carried by the virtual screen, and the screen data is sent to the interconnected device.

[0257] In some embodiments, the mode switching instruction includes a mode switching event, and the mode switching event is used to instruct switching of the floating window mode of the floating window.

[0258] In a possible implementation, the interconnected device sends a mode switching event to the mobile terminal in response to a trigger operation on a mode switching control in the floating window. The mobile terminal first closes the current virtual screen and then creates a virtual screen that matches the floating window mode after switching. Wherein, when the mobile terminal creates a background virtual screen, it starts a customized user interface on the background virtual screen. Subsequently, the mobile terminal feeds back a mode switching success message to the interconnected device, draws a picture on the newly created virtual screen, generates picture data, and sends it to the interconnected device.

[0259] In addition, when the floating window mode switching operation is received and implemented by the mobile terminal, the mobile terminal sends a mode switching instruction to the interconnected device when receiving the mode switching operation. The mode switching operation is used to switch the floating window mode of the floating window at the interconnected device, and the interconnected device is used to configure the floating window based on the switched floating window mode indicated by the mode switching instruction. Then, the mobile terminal generates screen data based on the switched floating window mode indicated by the mode switching operation, and then sends the screen data to the interconnected device, so as to provide the interconnected device with a screen that conforms to the switched floating window mode.

[0260] In a possible implementation, when the mobile terminal receives a mode switching operation, it sends a mode switching event to the interconnected device, so that the interconnected device configures the floating window according to the floating window mode after switching indicated by the mode switching instruction, and the mobile terminal closes the current virtual screen and then creates a virtual screen that matches the floating window mode after switching. Wherein, when the mobile terminal creates a background virtual screen, it starts a customized user interface on the background virtual screen. Subsequently, the mobile terminal and the interconnected device exchange a mode switching success message, and the mobile terminal draws a picture on the newly created virtual screen, generates picture data, and sends it to the interconnected device.

[0261] Optionally, the mode switching operation may include a trigger operation on a control, a voice input operation, a gesture operation, etc., which is not limited in this embodiment.

[0262] In some embodiments, the screen data generation process is different during the switching of different floating window modes.

[0263] In a possible implementation, when the mobile terminal receives a mode switching instruction sent by the interconnected device in the mirroring mode, or receives a switching operation of the floating window mode, and determines to switch to the interconnected mode, the mobile terminal first destroys the mirroring virtual screen, creates a background virtual screen, and then generates screen data based on the interconnected screen carried by the background virtual screen, and sends it to the interconnected device.

[0264] In another possible implementation, when the mobile terminal receives a mode switching instruction sent by the interconnected device in the interconnected mode, or receives a switching operation of the floating window mode, and determines to switch to the mirror mode, the mobile terminal first destroys the background virtual screen, creates a mirrored virtual screen, and then generates picture data based on the mirrored picture carried by the mirrored virtual screen, and sends it to the interconnected device.

[0265] In the embodiment of the present application, the display method of the floating window screen in different floating window modes is different, and the screen data provided by the mobile terminal is also different. Among them, in the interconnected mode, screen data for displaying a customized user interface can be provided, which is conducive to ensuring user privacy; in the mirroring mode, the floating window provides screen data for displaying the mirrored screen, which is conducive to the mobile terminal providing rich services. The mirrored screen conforms to the user's operating habits of the mobile terminal and can improve the convenience of operation.

[0266] Among them, when a communication connection is established between the interconnected device and the mobile terminal, the floating window mode can be determined by the interconnected device or by the mobile terminal, the mode switching can be initiated by the interconnected device or by the mobile terminal, and the floating window mode can be synchronized between the interconnected device and the mobile terminal through command interaction, which is conducive to improving the flexibility of setting the floating window mode.

[0267] The following embodiments take the interconnected device as a vehicle computer and the mobile terminal as a mobile phone as an example. When the vehicle computer sends a mode activation instruction to the mobile phone, the floating window startup process is described, and when the vehicle computer receives a mode switching operation, the floating window mode switch process is described.

[0268] It should be noted that the mode start instruction can also be sent from the mobile phone to the vehicle computer, and the mode switching operation can also be received by the mobile phone, and then the mode switching event is notified to the vehicle computer. Since the execution logic is similar, the embodiments of this application will not be repeated.

[0269] The car machine is equipped with Carlink HMI and car machine SDK, the mobile phone is equipped with mobile phone SDK, interconnection management program and mobile phone system, and a third-party application is installed on the mobile phone. The car machine and the mobile phone use the Carlink protocol to achieve data exchange. Optionally, different communication protocols can be used between the interconnected device and the mobile terminal according to actual needs, and the mobile phone system on the mobile phone can be Android system or other systems.

[0270] See also Fig.17 , Fig.17 This is a timing diagram of the floating window startup process in the mirror mode provided by an exemplary embodiment of the present application. The figure shows the Carlink HMI 1701 and the car SDK 1702 of the car machine, the mobile phone SDK 1703, the interconnection management program 1704 and the mobile phone system 1705 of the mobile phone.

[0271] After the car computer and the mobile phone establish a communication connection, Carlink HMI1701 calls the car computer SDK1702 interface to request to start the floating window in mirror mode; the car computer SDK1702 sends an enable mode event indicating the activation of the mirror mode to the mobile phone SDK1703 through the Carlink protocol; the mobile phone SDK1703 then calls back to notify the interconnection management program 1704 of the enable mode event, that is, forwards the enable mode event; after receiving the enable mode event, the interconnection management program 1704 calls the mobile phone system 1705 interface to create a mirror virtual screen.

[0272] Subsequently, when the mirrored virtual screen is successfully created, the interconnection management program 1704 calls the mobile phone SDK1703 interface to notify the car computer SDK1702 of the mode change, that is, notifies the car computer SDK1702 of the mode change message through the Carlink protocol; the car computer SDK1702 callbacks the mode change message to Carlink HMI1701 to confirm that the mobile phone is ready; CarlinkHMI1701 then applies for a floating window based on the current mode status information, and subsequently calls the SDK interface to update the screen projection parameters, and then updates the surface container.

[0273] After receiving the mode change message, the vehicle SDK 1702 returns an ACK (Acknowledge character) to the interconnection management program 1704 through the mobile phone SDK 1703; and the interconnection management program 1704 starts streaming.

[0274] When the virtual screen content is updated, the interconnection management program 1704 pushes the encoded audio and video stream to the car SDK 1702 through the Carlink protocol; the car SDK 1702 decodes the audio and video stream, renders the output to the surface container, applies rotation, and plays the sound.

[0275] The application rotation refers to adjusting the floating window to full screen or horizontal screen to display the application screen when the application rotation is detected. The audio and video stream is encoded by the interconnection management program 1704 using an encoder, and the encoded audio and video stream is packaged in a specified format and sent to the vehicle SDK 1702, such as the RTP (Real-Time Transport Protocol) message format.

[0276] It should be noted that the difference between the mirroring mode and the interconnection mode is that the mobile terminal creates different virtual screens and carries different images on the virtual screens, while the data interaction method between the interconnected device and the mobile terminal in the mirroring mode and the interconnection mode is roughly the same.

[0277] In some embodiments, the car computer's Carlink HMI1701 first notifies the car computer SDK1702 to enable the mode event, and then the car computer SDK1702 forwards the notification to the mobile phone SDK1703, and then the mobile phone SDK1703 calls back to notify the interconnection management program 1704, and the interconnection management program 1704 calls the system interface to create a virtual screen, and then sends a mode change message to the car computer. The car computer SDK1702 responds with a confirmation message to the interconnection management program 1704 so that the interconnection management program 1704 can push the audio and video streams subsequently.

[0278] Specifically, the floating window startup process in the interconnected mode is as follows. Fig.18 , Fig.18 This is a timing diagram of the floating window startup process in the interconnection mode provided by an exemplary embodiment of the present application. The figure shows the Carlink HMI 1801 and the car SDK 1802 of the car machine, the mobile SDK 1803, the interconnection management program 1804 and the mobile phone system 1805 of the mobile phone.

[0279] After the car computer and the mobile phone establish a communication connection, Carlink HMI1801 calls the car computer SDK1802 interface to request to start the floating window in the interconnection mode; the car computer SDK1802 sends an enable mode event indicating the activation of the interconnection mode to the mobile phone SDK1803 through the Carlink protocol; the mobile phone SDK1803 then calls back to notify the interconnection manager 1804 of the enable mode event, that is, forwards the enable mode event; after receiving the enable mode event, the interconnection manager 1804 calls the mobile phone system 1805 interface to create a background virtual screen.

[0280] It should be noted that the difference between the mirror mode and the interconnection mode also includes that when the background virtual screen is successfully created, the mobile phone system 1805 will start the customized user interface on the current virtual screen.

[0281] When the background virtual screen is successfully created, the interconnection management program 1804 calls the mobile phone SDK1803 interface to notify the car computer SDK1802 of the mode change, that is, notifies the car computer SDK1802 of the mode change message through the Carlink protocol; the car computer SDK1802 callbacks to notify Carlink HMI1801 of the mode change message, thereby confirming that the mobile phone is ready; Carlink HMI1801 then applies for a floating window based on the current mode status information, and subsequently calls the SDK interface to update the screen projection parameters, and then updates the surface container.

[0282] After receiving the mode change message, the vehicle SDK 1802 returns ACK to the interconnection management program 1804 through the mobile phone SDK 1803; and the interconnection management program 1804 starts streaming.

[0283] When the virtual screen content is updated, the interconnection management program 1804 pushes the encoded audio and video stream to the car SDK 1802 through the Carlink protocol; the car SDK 1802 decodes the audio and video stream, renders the output to the surface container, applies rotation, and plays the sound.

[0284] The application rotation means adjusting the floating window to full screen or horizontal screen to display the application screen when the application rotation is detected. The audio and video stream is encoded by the interconnection management program 1804 using an encoder, and the encoded audio and video stream is packaged in a specified format and sent to the vehicle SDK 1802, such as RTP message format.

[0285] In some embodiments, when the vehicle receives a mode switching operation, the floating window mode can be flexibly switched according to the mode switching operation. Since the two-way switching process between the mirror mode and the interconnection mode is similar, this application uses the switching from the mirror mode to the interconnection mode as an example to illustrate the mode switching process, and the specific process is described as follows.

[0286] See also Fig.19 , Fig.19 1 is a timing diagram of a mode switching process provided by an exemplary embodiment of the present application. The figure shows Carlink HMI 1901 and car SDK 1902 of the car machine, mobile SDK 1903, interconnection management program 1904 and mobile phone system 1905 of the mobile phone.

[0287] When the user clicks the mode switching button, Carlink HMI1901 calls the SDK interface to request switching to the interconnection mode and displays the mode switching animation; the car SDK1902 encapsulates the request through the Carlink protocol and sends it to the mobile SDK1903 to notify the mobile SDK1903 of the mode switching event; the mobile SDK1903 callbacks the notification (forwards) of the mode switching event to the interconnection management program 1904; the interconnection management program 1904 destroys the mirrored virtual screen, releases related resources, and then calls the mobile system 1905 interface to create a background virtual screen.

[0288] It should be noted that, when switching to the interconnection mode, the interconnection management program 1904 needs to call the mobile phone system 1905 interface to start the customized user interface on the current virtual screen, while when switching to the mirror mode, this step does not need to be performed.

[0289] When the background virtual screen is successfully created, the interconnection management program 1904 calls the mobile phone SDK1903 to notify the vehicle SDK1902 that the floating window mode has been successfully changed, wherein the mobile phone SDK1903 encapsulates the mode change message through the Carlink protocol and sends it to the vehicle SDK1902; the vehicle SDK1902 callbacks to notify Carlink HMI1901 of the mode change message; CarlinkHMI1901 applies for a floating window based on the current mode status information, and subsequently calls the SDK interface to update the projection parameters, and then updates the surface container; and Carlink HMI1901 will cancel the switching animation and update the floating window mode prompt.

[0290] When the virtual screen content is updated, the interconnection management program 1904 pushes the encoded audio and video stream to the car SDK 1902 through the Carlink protocol; the car SDK 1902 decodes the audio and video stream, renders and outputs it to the surface container, applies rotation, and plays sound.

[0291] The application rotation means adjusting the floating window to full screen or horizontal screen to display the application screen when the application rotation is detected. The audio and video stream is encoded by the interconnection management program 1904 using an encoder, and the encoded audio and video stream is packaged in a specified format and sent to the vehicle SDK 1902, such as RTP message format.

[0292] In some embodiments, the interconnected device can display a home return control in a floating window. The home return control is different from the return control. The return control is used to perform a single return operation, such as returning to the historical page before the jump after a page jump, while the home return control is used to return to the main interface.

[0293] Optionally, the mobile terminal may first receive a homepage return instruction sent by the interconnected device, then close the target application based on the homepage return instruction, and send the screen data of the homepage screen to the interconnected device. The homepage screens in different floating window modes are different. In the mirroring mode, the main page is the desktop homepage of the mobile terminal, and in the interconnected mode, the main page is the homepage of the customized user interface. The interconnected device is used to display the homepage screen in the floating window based on the screen data of the homepage screen.

[0294] In a possible implementation, the interconnected device sends a homepage return event to the mobile terminal in response to a trigger operation on the homepage return control, and the homepage return event is included in a homepage return instruction. The mobile terminal calls the system interface, updates the application screen in the virtual screen to the main page of the application, and then sends a successful return to the homepage notification to the interconnected device and sends the screen data of the homepage screen.

[0295] In a possible implementation scenario, the mobile terminal first provides the screen data of its desktop homepage to the interconnected device in the mirror mode, and the mobile terminal displays the desktop homepage screen at the same time. When the interconnected device receives a trigger operation on the first application icon in the application startup interface, or receives a trigger operation on the second application icon on the desktop homepage in the floating window, the operation instruction is fed back to the mobile terminal, and the mobile terminal stops providing the screen data of the desktop homepage, and then provides the screen data of the application interface of the currently started application, which is displayed both in the floating window and on the mobile terminal. Subsequently, the mobile terminal switches the floating window mode to the interconnected mode. When the mobile terminal is off the screen, the mobile terminal still provides the screen data of the application screen. The mobile terminal subsequently receives the homepage return instruction sent by the interconnected device, and provides the screen data of the customized user interface homepage to the interconnected device, and no longer provides the screen data of the desktop homepage.

[0296] In the embodiment of the present application, since the main pages are different in different floating window modes, the mobile terminal can provide the screen data of the home page corresponding to the current floating window mode upon receiving the home page return instruction, so that the floating window has the ability to return to the home page, thereby improving the functional richness of the floating window.

[0297] In some embodiments, in order to prevent the floating window from blocking the display screen of the interconnected device, the floating window provides a closing control. The interconnected device also provides a floating window float to redisplay the floating window. The mobile terminal determines whether to send the screen data according to the floating window opening and closing instruction fed back by the interconnected device.

[0298] In some embodiments, the interconnected device sends a floating window closing instruction to the mobile terminal in response to a trigger operation on a closing control in the floating window, and stops displaying the floating window. The mobile terminal receives the floating window closing instruction sent by the interconnected device. The floating window closing instruction is sent when a trigger operation on a closing control in the floating window is received, and the interconnected device displays a floating window icon when the floating window is stopped. Then, based on the floating window closing instruction, the mobile terminal stops sending screen data to the interconnected device.

[0299] Optionally, the floating window float may display the connection status between the mobile terminal and the Internet device, for example, the floating window float displays the terminal name and connection status of the mobile terminal that is communicatively connected to the Internet device.

[0300] Optionally, the floating window closing instruction may include a stop application event to instruct the mobile terminal to exit the application program.

[0301] In a possible implementation, the interconnected device sends a stop application event to the mobile terminal in response to a trigger operation of closing the control in the floating window, and the stop application event is included in the floating window closing instruction. The mobile terminal calls the system interface to close the application in the virtual screen, and then sends a successful closing notification to the interconnected device.

[0302] In other embodiments, when the floating window is closed, the interconnected device sends a floating window opening instruction to the mobile terminal in response to a triggering operation on the floating window float, and redisplays the floating window. The mobile terminal device receives the floating window opening instruction sent by the interconnected device, and the floating window opening instruction is sent when the triggering operation on the floating window float is received. Subsequently, the mobile terminal resends the screen data to the interconnected device based on the floating window opening instruction.

[0303] In some embodiments, the floating window mode of the redisplayed floating window remains consistent with the floating window mode before the floating window is closed.

[0304] Optionally, the floating window opening instruction may include an application starting event, instructing the mobile terminal to restart the application program.

[0305] In a possible implementation, the interconnected device sends an application startup event to the mobile terminal in response to a trigger operation on the floating window float, and the application startup event is included in the floating window startup instruction. The mobile terminal calls the system interface, draws the application screen of the application on the virtual screen, and then sends a successful startup notification to the interconnected device.

[0306] Optionally, when the mobile terminal receives a floating window closing instruction, the mobile terminal may close the current application when stopping providing the application screen, and then display the main page in the current floating window mode when receiving a floating window opening instruction, for example, the desktop homepage of the mobile terminal in the mirroring mode, and the customized user interface homepage in the interconnected mode.

[0307] Optionally, when the mobile terminal receives a floating window closing instruction, the mobile terminal may stop providing the application screen and maintain the running status of the application. Subsequently, when the mobile terminal receives a floating window opening instruction, the mobile terminal may re-provide the application data of the application screen displayed before the floating window is closed, so that the floating window can restore the application screen of the application before the floating window is closed, without the need to restart the application.

[0308] In the embodiment of the present application, the mobile terminal can determine to stop or re-provide screen data according to the floating window closing instruction sent by the interconnected device or the floating window opening, which is conducive to supporting the interconnected device to open and close the floating window and improve the coordination between the interconnected device and the mobile terminal.

[0309] The following embodiment takes the interconnected device as a car computer and the mobile terminal as a mobile phone as an example to illustrate the floating window closing process.

[0310] The car machine is equipped with Carlink HMI and car machine SDK, the mobile phone is equipped with mobile phone SDK, interconnection management program and mobile phone system, and a third-party application is installed on the mobile phone. The car machine and the mobile phone use the Carlink protocol to achieve data exchange. Optionally, different communication protocols can be used between the interconnected device and the mobile terminal according to actual needs, and the mobile phone system on the mobile phone can be Android system or other systems.

[0311] See also Fig. 20 , Fig. 20 The figure shows the Carlink HMI 2001 and the car SDK 2002 of the car machine, the mobile SDK 2003, the interconnection management program 2004 and the mobile phone system 2005 of the mobile phone, and the third-party application 2006 is installed on the mobile phone.

[0312] When the user clicks the close button of the current projection window (floating window), Carlink HMI2001 notifies the car SDK2002 that the user needs to stop a certain application; the car SDK2002 sends a stop application event to the mobile SDK2003 through the Carlink protocol; the mobile SDK2003 calls back to notify the interconnection management program 2004 of the new stop application event; the interconnection management program 2004 calls the system interface to close the application running on the virtual screen; the mobile system 2005 exits the third-party application 2006. The third-party application 2006 is closed on the current virtual screen.

[0313] It should be noted that in addition to transmitting stop application events through the Carlink protocol, the car computer and the mobile phone can also transmit application start events, application pause events, and application resume events through the Carlink protocol. Among them, the application start event is transmitted when the car computer receives an application start operation, the application pause event is transmitted when the car computer receives a pause operation, and the application resume event is transmitted when the car computer receives a resume operation. Optionally, the resume operation can be a trigger operation on the floating window buoy, which is used to restore the display of the floating window and restore the display of the application screen in the floating window. Optionally, the car computer (i.e., the interconnected device) can display a close control, a pause control, a resume control, and a start control for the user to implement the above operations. Exemplarily, the close control can be a floating window close button, the pause control can be a screen pause button, and the start control can be an application icon.

[0314] The mobile phone system 2005 notifies the interconnection management program 2004 that the third-party application 2006 has been successfully stopped; the interconnection management program 2004 calls the mobile phone SDK2003 interface to notify the vehicle SDK2002 of the application status change, wherein the mobile phone SDK2003 notifies the vehicle SDK2002 of the application status change message through the Carlink protocol; the vehicle SDK2002 callbacks to notify Carlink HMI2001 of the application status change; Carlink HMI2001 hides the floating window and displays the floating window icon according to the current application status information, and subsequently calls the SDK interface to stop screen projection; the vehicle SDK2002 stops screen projection.

[0315] In some embodiments, the screen display direction of the mobile terminal includes a horizontal screen direction and a vertical screen direction. In order to realize that the floating window displays the screen in the horizontal screen direction or the vertical screen direction, the mobile terminal can instruct the interconnected device to display the floating window in different screen directions by sending a notification.

[0316] In some possible implementations, when there is a screen direction switching event, the mobile terminal sends a screen direction switching notification to the interconnected device, wherein the interconnected device is configured to configure a floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification.

[0317] The screen direction switching notification is sent by the mobile terminal to the interconnected device when it is determined that there is a screen direction switching event, and is used to indicate the screen direction.

[0318] Among them, the screen direction switching event is used to indicate that the display direction of the picture content on the mobile terminal screen has changed. In the event of a screen switching event, the interconnected device configures a floating window that matches the screen direction.

[0319] In some possible implementation scenarios, when the full-screen control in the application interface of the floating window in mirror mode is triggered, the interconnected device notifies the mobile terminal of the screen direction switching event, and the mobile terminal injects the screen direction switching event into the mirror virtual screen (into the background virtual screen in interconnected mode) so that the application receives the screen direction switching event. The application then initiates a horizontal screen switching request to the mobile terminal system. When the mobile terminal system detects the switching request, it sends a screen direction switching notification to the interconnected device, such as notifying the HMI of the interconnected device, and the interconnected device creates a new horizontal screen floating window, receives the data stream of the screen data, and decodes and renders it.

[0320] Optionally, when the application screen in the floating window is triggered, the floating window can display an application control bar, which includes a return control for triggering the application to exit the full-screen display of the horizontal floating window and restore the vertical floating window display. The system return control or gesture operation command of the connected device can also be used to implement the above exit operation.

[0321] When the restoration of the vertical screen floating window display is triggered, the mobile terminal system detects the vertical screen switching event and notifies the connected device of the event. The connected device creates a floating window according to the screen size of the vertical screen mobile terminal, receives the data stream of the screen data, and decodes and renders it so that the floating window displays the application screen.

[0322] The screen direction switching event may include at least one of the following:

[0323] 1. The screen orientation changes.

[0324] In a possible application scenario, when the screen orientation of the mobile terminal changes, the mobile terminal can automatically switch the display orientation of the application screen and send a screen switching notification to the connected device. When the connected device receives the screen switching notification, it configures a floating window that matches the screen orientation of the mobile terminal.

[0325] For example, during the video playback process of the mobile terminal, the screen orientation of the mobile terminal changes from portrait to landscape, so that the video is played in full screen on the mobile terminal screen. The interconnected device receives the screen orientation switching notification sent by the mobile terminal, and then configures a floating window to display the landscape playback screen of the video application according to the screen orientation indicated by the notification.

[0326] 2. Receive a trigger operation for a screen direction switch control in a target application.

[0327] Optionally, the triggering operation of the screen direction switching control may include a click operation, a voice input operation, or a visual control operation triggered by the human eye. The embodiment of the present application does not limit the triggering operation.

[0328] Optionally, the screen direction switching control may be a full-screen control within an application, such as a full-screen video playback control in a video playback application.

[0329] Optionally, the screen orientation switching control may also be a landscape mode control within the application. For example, a browser or social software has a landscape display mode and a portrait display mode. When the mobile terminal receives a trigger operation on the landscape mode control, the browser or social software enters the landscape display mode and displays a landscape screen.

[0330] In the embodiment of the present application, any control that can be used to change the display direction of an application on a mobile terminal screen can be used as a screen direction switching control within a target application.

[0331] 3. A reverse control instruction sent by the interconnected device is received, and the reverse control instruction is used to trigger a screen direction switching control in the target application.

[0332] In some embodiments, the interconnected device displays an application screen in a floating window and receives a trigger operation on a screen direction switching control in the application screen, and then sends a reverse control instruction to the mobile terminal according to the trigger operation, instructing the mobile terminal to provide the screen after the screen direction is switched, and receives a screen direction switching notification sent by the mobile terminal.

[0333] In some embodiments, the reverse control instruction is used to forward the operation event to the mobile terminal when the interconnected device receives the user operation. When the operation event indicates triggering the screen direction switching control in the target application, the mobile terminal determines that there is a screen direction switching event.

[0334] Optionally, the reverse control instruction sent by the interconnected device to the mobile terminal may include the touch coordinates of the touch point on the screen of the interconnected device and the touch operation type. Exemplarily, when the user touches the floating window, the interconnected device sends a touch event to the mobile terminal, and the touch event includes the touch position, so that the mobile device determines whether there is a screen direction switching event.

[0335] Optionally, the touch operation type may include a click operation, a slide operation, a long press operation, etc. In a possible implementation, the mobile terminal determines the control operated by the touch operation according to the touch coordinates fed back by the interconnected device, then runs the application to respond to the touch operation, and then sends the screen data to the interconnected device according to the response screen of the application on the virtual screen.

[0336] Optionally, when the display screen of the interconnected device does not have a touch function, the reverse control instruction may also include the operation coordinates and the operation type, such as the click coordinates of a click operation and the continuous track of the drag coordinates of a drag operation.

[0337] Optionally, the screen direction switching control within the target application may include a full-screen control, a landscape mode control, or the like within the application that can be used to change the display direction of the application on the mobile terminal screen, which is not limited in this embodiment of the present application.

[0338] In some embodiments, when the screen direction indicated by the screen direction switching notification is the landscape direction, the mobile terminal receives a floating window status notification sent by the interconnected device. The floating window status notification is used to indicate the floating window status of the floating window configured by the interconnected device, and the floating window status includes a landscape state and a full screen state. Subsequently, the mobile terminal configures a virtual screen based on the floating window status indicated by the floating window status notification. The virtual screen is used to carry the screen provided by the mobile terminal, and the size of the virtual screen is different in the landscape state and the full screen state.

[0339] Optionally, the screen direction switching notification may be used to instruct the connected device to switch the floating window from a portrait state to a landscape state, or may be used to instruct the connected device to switch the floating window from a portrait state to a full screen state.

[0340] In some embodiments, after the interconnected device configures a floating window state matching the screen direction according to the screen direction switching notification sent by the mobile terminal, the floating window state notification is sent to the mobile terminal to notify the mobile terminal that the floating window state configured by the interconnected device is a horizontal screen state or a full screen state.

[0341] In some embodiments, the screen size of the virtual screen needs to match the size of the floating window so that the image carried by the virtual screen can be displayed in the floating window. In the horizontal screen state, the floating window size is determined based on the horizontal screen floating window size, and in the full screen state, the floating window size is determined based on the screen size of the connected device.

[0342] In a possible implementation, the mobile terminal sends a screen orientation switching notification representing the landscape orientation to the interconnected device, the interconnected device configures the floating window according to the landscape floating window size, and then sends a floating window status notification representing the landscape state. Subsequently, the mobile terminal configures a virtual screen with a size of the landscape floating window size based on the floating window state indicated by the floating window status notification.

[0343] In another possible implementation, the mobile terminal sends a screen orientation switching notification representing a landscape orientation to the interconnected device, the interconnected device configures a floating window according to the screen size of the interconnected device, and then sends a floating window status notification representing a full screen state. Subsequently, the mobile terminal configures a virtual screen with a size equal to the screen size of the interconnected device based on the floating window state indicated by the floating window status notification.

[0344] In the embodiment of the present application, the mobile terminal can send a screen direction switching notification to the interconnected device when the screen direction is switched, so that the interconnected device can adjust the floating window screen to improve the adaptability of the floating window and the application screen.

[0345] Among them, the mobile terminal can notify the interconnected device to configure a floating window that matches the screen direction when the three screen directions are switched, so that the floating window can match the screen direction in various situations, improve the matching degree between the floating window and the screen direction, and thus improve the display effect of the floating window.

[0346] When the screen orientation is landscape, the mobile terminal can be configured with a landscape virtual screen to provide the connected device with screen data that conforms to the screen orientation, so that the connected device can display a landscape floating window, thereby preventing the floating window from occupying too much display space and affecting the screen display of the connected device. The mobile terminal can also be configured with a full-screen virtual screen so that the floating window can display the application screen in full screen on the connected device, enriching the display method of the floating window.

[0347] In some embodiments, the floating window can also provide a full-screen control, so that the interconnected device displays the application screen through a floating window in a full-screen state. The floating window size of the full-screen floating window is consistent with the screen size of the interconnected device, such as the same size or the same size ratio.

[0348] Optionally, the mobile terminal may receive a full-screen instruction sent by the interconnected device. The full-screen instruction is sent when a trigger operation on the full-screen control in the floating window is received. Subsequently, the mobile terminal sends the screen data of the full-screen image to the interconnected device based on the full-screen instruction.

[0349] Optionally, the full-screen image data may be image data of an application screen when the application is adapted to an interconnected device, or image data of an application screen displayed in parallel windows, or image data of a vertical screen image displayed in the center, or image data of an application screen displayed in a stretched state. Fig.13 As shown, the embodiments of the present application are not described in detail.

[0350] In some embodiments, the floating window state includes a horizontal screen state, a vertical screen state and a full screen state. Among them, the floating window size in the horizontal screen state and the vertical screen state is determined based on the screen size of the mobile terminal, and the floating window size in the full screen state is determined based on the screen size of the interconnected device. The size of the mirrored virtual screen needs to be determined based on the screen size of the mobile terminal, while the background virtual screen can be determined based on the screen size of the mobile terminal or the screen size of the interconnected device. Since the size of the mirrored virtual screen cannot be determined based on the screen size of the interconnected device, switching the full-screen floating window in the mirroring mode requires moving the picture from the mirrored virtual screen to the background virtual screen.

[0351] In some possible implementation scenarios, in mirror mode, when the first application icon or the second application icon is triggered, the mobile terminal starts the application and displays the application screen on the screen; when the full-screen control in the floating window is triggered, the interconnected device sends a request to the mobile terminal to display the full-screen floating window; the mobile terminal moves the application from the mirrored virtual screen to the background virtual screen with the same size as the screen of the interconnected device.

[0352] Optionally, the background virtual screen can adopt full-screen display, parallel windows, compatible mode (including centering, stretching or adopting existing adaptation mode), etc.

[0353] When the stack is moved to the background virtual screen, the mobile terminal no longer displays the current application and sends a message to the connected device to notify the connected device that the mode switch is successful. The display content of the background virtual screen, that is, the screen data, is subsequently encoded and pushed to the connected device. After receiving the mode switch success message, the connected device switches the display container and uses the full-screen surface to display the screen data pushed by the mobile terminal.

[0354] Optionally, when the full-screen control is triggered a second time, the interconnected device restores the display of the original floating window. Specifically, the interconnected device sends a restoration request to the mobile terminal, and the mobile terminal moves the application from the background virtual screen back to the mirrored virtual screen, so that the mirrored virtual screen restores the display of the application screen of the application. The mobile terminal sends a mode switching success message to the interconnected device, and subsequently pushes the mirrored screen of the mirrored virtual screen to the interconnected device. After receiving the mode switching success message, the interconnected device switches the display container, so that the floating window surface displays the screen data content pushed by the mobile terminal.

[0355] In some other possible implementation scenarios, in the interconnected mode, when the first application icon or the second application icon is triggered, the mobile terminal starts the application and displays the application screen on the screen; when the full-screen control in the floating window is triggered, the interconnected device sends a request to the mobile terminal to display the full-screen floating window; the mobile terminal modifies the background virtual screen size to make it equal to the screen size of the interconnected device, and then triggers the application to re-layout and display on the background virtual screen. Optionally, the display mode can be full-screen display, parallel windows, compatible mode (including centering the screen, stretching, or using an existing adaptation mode), etc.

[0356] When the full-screen control is triggered for the second time, the interconnected device restores the original floating window. Specifically, the interconnected device sends a restoration request to the mobile terminal; the mobile terminal restores the background virtual screen size to the mobile terminal screen size, and then pushes the mirrored image of the mirrored virtual screen to the interconnected device. After the interconnected device receives the mode switching success message, it switches the display container so that the floating window surface displays the image data content pushed by the mobile terminal.

[0357] In an embodiment of the present application, the mobile terminal can send full-screen picture data upon receiving a full-screen instruction, so that the interconnected device can play the application screen in full screen without the need for the application to provide a full-screen control, thereby enriching the display function of the floating window.

[0358] In some embodiments, the interconnected device can filter the applications in the mobile terminal and display the first application icons corresponding to the filtered applications in the application launch interface. The mobile terminal can provide application information according to the filtering situation of the interconnected device so that the interconnected device can display it.

[0359] Among them, the process of the mobile terminal providing application information, such as Fig.21 As shown, the following steps may be included:

[0360] Step 2101: When a communication connection is established with an interconnected device, a first application list is sent to the interconnected device, where the first application list includes application programs in the mobile terminal.

[0361] Optionally, the first application list may use one of an application ID, an application name, and an application package name to represent the application program.

[0362] In a possible implementation, when the interconnected device establishes a communication connection with the mobile terminal, the interconnected device first sends a request to obtain the first application list to the mobile terminal, and the mobile terminal sends the first application list to the interconnected device when receiving the request.

[0363] Step 2102: Receive an application information acquisition request sent by the interconnected device, where the application information acquisition request is used to acquire application information of application programs in a second application list, where the second application list includes application programs screened by the interconnected device from the first application list.

[0364] In some embodiments, the interconnected device determines a second application list based on the first application list, where the second application list is a list of applications in the first application list that are allowed to display the first application icon on the application launch interface of the interconnected device.

[0365] Optionally, to avoid repeated display of application icons, the interconnected device may select a mobile terminal application that does not overlap with the local application according to the overlap between the local application and the application on the mobile terminal, and display the corresponding first application icon.

[0366] In some embodiments, the second application list may also be a list of application programs in the first application list that are allowed to display application screens in the floating window of the interconnected device.

[0367] Optionally, in order to protect user privacy, an application whitelist may be provided inside the interconnected device, and the whitelist is used to record the applications that are allowed to be started by the interconnected device. The whitelist may be customized by the user. The interconnected device adds the applications that are in the first application list and exist in the application whitelist to the second application list.

[0368] Optionally, in order to maintain the device security of the interconnected device and the mobile terminal, the interconnected device may also set an application blacklist, which is used to prohibit the application from launching malicious programs through interface jumps. The interconnected device removes the applications in the blacklist from the first application list to obtain a second application list.

[0369] In some embodiments, the application information of the application program in the second application list is the application information required to display the first application icon on the application launch interface of the interconnected device. Optionally, the application information may include an application name, an application package name, an application ID, an application icon, and the like.

[0370] Step 2103: Send application information to the interconnected device, and the interconnected device is used to display the first application icon in the application startup interface based on the application information.

[0371] Optionally, the interconnected device may further display the application name on the application startup interface, and may also take measures such as changing the name color and adding a special pattern to the icon to distinguish the first application icon from the local application icon.

[0372] In some embodiments, the floating window mode of the floating window includes an Internet mode, wherein the floating window in the Internet mode displays an Internet screen, which is a screen of a customized user interface in the Internet mode.

[0373] In some embodiments, the interconnected device filters the application programs provided by the mobile terminal, and the mobile terminal updates the customized user interface according to the filtered applications to prevent the application programs that the interconnected device does not allow to be displayed on the screen from being displayed in the customized user interface.

[0374] Optionally, the mobile terminal may update the application icons in the customized user interface based on the second application list, wherein the updated customized user interface does not include application icons of application programs outside the second application list.

[0375] In a possible implementation, the customized user interface first displays the second application icons of all applications in the mobile terminal that can be displayed on the interconnected device according to the second application list. When the interconnected device updates the second application list, the mobile terminal sends application information of the applications belonging to the second application list to the interconnected device, so that the interconnected device displays the updated customized user interface.

[0376] Exemplarily, application icons or card information of application A, application B, and application C are displayed in the customized user interface, and the second application list determined by the interconnected device no longer includes application A, application B, and application C, but includes application A and application B. The mobile terminal determines to provide the application information of application A and application B to the interconnected device, and the interconnected device thereby displays application icons or card information of application A and application B in the customized user interface.

[0377] In a possible scenario, the interconnected device may jump between applications so that the screen jumps to an application screen of an application outside the second application list.

[0378] In another possible scenario, the interconnected device may receive a triggering operation on the second application icon in the mirroring mode, prompting the mobile terminal to start an application outside the second application list.

[0379] In some embodiments, in order to solve the problems arising in the above scenarios and prevent applications that do not belong to the second application list from displaying application screens in the interconnected device, the mobile terminal records the second application list when receiving application information acquisition information sent by the interconnected device. When starting the application, it can determine whether the application can be started based on the second application list.

[0380] In some embodiments, the mobile terminal may start the target application in response to an application start event, if the target application indicated by the application start event belongs to the second application list.

[0381] In some embodiments, the application launch event refers to the launch of an application program, including the interconnected device responding to a triggering operation on a second application icon in a screen displayed by the floating window, and notifying the mobile terminal of the application launch event through a reverse control instruction.

[0382] In a possible implementation, when the interconnected device receives an interactive operation of the user on the content of the screen displayed in the floating window, such as a PC receiving a click operation of the user and a PAD receiving a touch operation of the user, the interconnected device sends a reverse control instruction containing the interactive event to the mobile terminal, and the reverse control instruction is used to trigger the start of the target application. When the mobile terminal determines that the interactive operation of the user indicated by the interactive event is a triggering operation on the second application icon in the screen displayed in the floating window, and the mobile terminal determines that the target application indicated by the triggering operation belongs to the second application list, the system interface is called to start the target application to the virtual screen, the application screen is drawn on the virtual screen, and provided to the interconnected device, and then the interconnected device displays the application screen in the floating window.

[0383] The application startup event may also be that the interconnected device responds to a triggering operation on an application icon in the application startup interface and notifies the mobile terminal of the existence of the application startup event.

[0384] In a possible implementation, when the interconnected device receives a trigger operation of the user on the application icon in the application launch interface, it determines that there is an application switching event and sends the application launch event to the mobile terminal. Then, when the target application indicated by the application launch event belongs to the second application list, the mobile terminal calls the system interface to launch the target application to the virtual screen, draws the application screen on the virtual screen, and provides it to the interconnected device.

[0385] In other embodiments, the mobile terminal may, in response to an application launch event, prohibit launching the target application if the target application indicated by the application launch event does not belong to the second application list; and then send an application launch failure notification to the interconnected device. The interconnected device is used to display application launch failure prompt information based on the application launch failure notification.

[0386] In a possible implementation, when the interconnected device receives an interactive operation of the user on the content of the screen displayed in the floating window, it sends a reverse control instruction containing the interactive event to the mobile terminal, and the reverse control instruction is used to trigger the start of the target application. When the mobile terminal determines that the interactive operation of the user indicated by the interactive event is a triggering operation on the second application icon in the screen displayed in the floating window, and the mobile terminal determines that the target application indicated by the triggering operation does not belong to the second application list, the mobile terminal prohibits the start of the target application and notifies the interconnected device of the startup failure, and then the interconnected device displays a prompt message of the application startup failure in the floating window.

[0387] In another possible implementation, when the interconnected device receives a trigger operation of the user on the application icon in the application launch interface, it determines that there is an application switching event and sends the application launch event to the mobile terminal. Then, when the target application indicated by the application launch event does not belong to the second application list, the mobile terminal notifies the interconnected device of the launch failure, and then the interconnected device displays the application launch failure prompt information in the floating window.

[0388] In the embodiment of the present application, the mobile terminal can cooperate with the interconnected device to screen applications and determine the application to display the first application icon, thereby avoiding repeated display of application icons for the same application existing in the interconnected device and the mobile terminal, resulting in redundant application functions.

[0389] The mobile terminal can also update the customized user interface according to the second application list to prevent the mobile terminal from starting an application that is not allowed to be displayed in the floating window, thereby ensuring the security of user personal information.

[0390] The mobile terminal can start the applications that are allowed to be started according to the second application list, and avoid starting the applications that are not allowed to be displayed in the floating window. It can also prohibit the start of non-permitted applications according to the second application list, and feedback the application start failure notification so that the connected device can display the failure prompt, thereby improving the information feedback capability of the floating window.

[0391] The following embodiments take the interconnected device as a car machine and the mobile terminal as a mobile phone as an example to illustrate the acquisition process of the first application list and the second application list, the application startup process, and the reverse control process. Among them, the reverse control process can be used to realize application startup in a floating window, such as by triggering the application icon in the desktop homepage of the mobile terminal in mirror mode, by triggering the card or application icon in the customized user interface in interconnected mode, and can also be used to implement reverse control in the application program to update the application screen.

[0392] The car machine is equipped with Carlink HMI and car machine SDK, the mobile phone is equipped with mobile phone SDK, interconnection management program and mobile phone system, and a third-party application is installed on the mobile phone. The car machine and the mobile phone use the Carlink protocol to achieve data exchange. Optionally, different communication protocols can be used between the interconnected device and the mobile terminal according to actual needs, and the mobile phone system on the mobile phone can be Android system or other systems.

[0393] In some embodiments, the mobile phone sends a first application list to the vehicle computer. After receiving the first application list, the vehicle computer requests the mobile phone for application information of application programs in a second application list. The second application list includes application programs screened by the vehicle computer from the first application list.

[0394] The following first describes in detail the process of the vehicle computer obtaining the first application list. Fig. 22 , Fig. 22 This is a timing diagram of a first application list acquisition process provided by an exemplary embodiment of the present application. The figure shows CarlinkHMI2201 and car SDK2202 of the car machine, and the mobile phone SDK2203 and interconnection management program 2204 of the mobile phone.

[0395] After the car machine and the mobile phone establish a communication connection, Carlink HMI2201 will send a request to the mobile phone to obtain the application list information. Specifically, the car machine's Carlink HMI2201 sends the request to obtain the application list information to the car machine SDK2202, and the car machine SDK2202 sends the request to obtain the application list information to the mobile phone SDK2203 through the Carlink protocol. After receiving the request, the mobile phone SDK2203 forwards the request to the interconnection management program 2204.

[0396] After receiving the request, the interconnection management program 2204 will return the application list, and then return it to the Carlink HMI 2201 via the mobile SDK 2203 and the vehicle SDK 2202. After receiving the application list, the Carlink HMI 2201 will delete unnecessary applications and keep the target application list information, that is, the ID list.

[0397] Optionally, in addition to the application ID, the application list may also use the application name or application package name to represent the application program.

[0398] In some embodiments, after obtaining the first application list, the vehicle computer determines the second application list and requests the mobile phone for application information of the application programs in the second application list. Fig.23, is a timing diagram of an application information acquisition process provided by an exemplary embodiment of the present application. The figure shows Carlink HMI 2301 and car SDK 2302 of the car machine, and mobile SDK 2303 and interconnection management program 2304 of the mobile phone.

[0399] After obtaining the second application list, Carlink HMI2301 sends the second application list information to the interconnection management program 2304 via the vehicle SDK2302 and the mobile phone SDK2303.

[0400] Specifically, the Carlink HMI2301 of the car computer filters the list and determines the application list that needs to be integrated and displayed (the second application list), wherein the integrated display refers to the integrated display of the application icon of the application on the mobile phone and the application icon of the local application on the car computer. Then, Carlink HMI2301 requests the car computer SDK2302 to obtain the application detailed information of the specified ID set (the application ID recorded in the second application list), such as application package name, application ID, application name, and application icon; the car computer SDK2302 forwards the application detailed information acquisition message to the mobile phone SDK2303 through the Carlink protocol; the mobile phone SDK2303 sends the request for obtaining the application detailed information of the specified ID set to the interconnection management program 2304; the interconnection management program 2304 records the on-board application list selected by the car computer, that is, the second application list, so that the mobile phone can subsequently determine whether the application is allowed to be on-board.

[0401] Optionally, the vehicle computer may filter out local applications with the same name in the first application, and record mobile applications different from local applications in the second application list.

[0402] After receiving the above-mentioned acquisition request, the interconnection management program 2304 returns the application detailed information of the specified ID set, calls the mobile phone SDK2303 interface, and returns the application list details to the car SDK2302 through the Carlink protocol; the car SDK2302 returns the application detailed information of the specified ID set to the Carlink HMI2301, and then displays the application list information on the application startup interface based on the application ID, application name, application package name and icon information contained in the application detailed information.

[0403] In some embodiments, the vehicle computer displays the application list information on the application startup interface, that is, the vehicle computer displays the first application icon of the mobile phone and the application icon of the local application mixedly on the application startup interface. Among them, the first application icon is used to realize the quick startup of the mobile phone application on the vehicle computer.

[0404] The following is an explanation of the process of quickly launching an application on the vehicle side. Fig.24 , Fig.24The figure shows the Carlink HMI 2401 and the car SDK 2402 of the car computer, the mobile SDK 2403, the interconnection management program 2404 and the mobile phone system 2405 of the mobile phone, and the third-party application 2406 is installed on the mobile phone.

[0405] The application startup process is Fig. 20 The floating window closing process shown is similar. The difference is that during the application startup process, the car computer sends an application startup event to the mobile phone through the Carlink protocol, the third-party application 2406 draws the application screen on the virtual screen to provide application content to the mobile phone system 2405, and the interconnection management program 2404 pushes audio and video streams to the car computer SDK 2402 for the car computer to display the screen and play the sound.

[0406] Specifically, when the user clicks an application icon (first application icon) on the current car screen, Carlink HMI2401 notifies the car SDK2402 that the user needs to start a certain application; the car SDK2402 sends an application start event to the mobile SDK2403 through the Carlink protocol; the mobile SDK2403 calls back to notify the interconnection manager 2404 of the new application start event; the interconnection manager 2404 calls the system interface to start the specified application to the virtual screen; the mobile system 2405 starts the third-party application 2406. The third-party application 2406 draws the application screen on the current virtual screen, and then submits the application content on the virtual screen to the mobile system 2405.

[0407] Subsequently, the mobile phone system 2405 notifies the interconnection management program 2404 that the third-party application 2406 has been successfully started; the interconnection management program 2404 calls the mobile phone SDK2403 interface to notify the vehicle SDK2402 of the application status change, wherein the mobile phone SDK2403 notifies the vehicle SDK2402 of the application status change message through the Carlink protocol; the vehicle SDK2402 callback notifies CarlinkHMI2401 of the application status change; Carlink HMI2401 applies for a floating window based on the current application status information, and subsequently calls the SDK interface to update the projection parameters, and then updates the surface container.

[0408] After receiving the application status change message, the vehicle SDK 2402 returns an ACK to the interconnection management program 2404 through the mobile phone SDK 2403; and the interconnection management program 2404 starts streaming.

[0409] When there is new content on the virtual screen, the interconnection management program 2404 pushes the encoded audio and video stream to the car SDK 2402 through the Carlink protocol; the car SDK 2402 decodes the audio and video stream, renders and outputs it to the surface container, applies rotation, and plays the sound.

[0410] The application rotation means adjusting the floating window to full screen or horizontal screen to display the application screen when the application rotation is detected. The audio and video stream is encoded by the interconnection management program 2404 using an encoder, and the encoded audio and video stream is packaged in a specified format and sent to the vehicle SDK 2402, such as an RTP message format.

[0411] In some embodiments, in addition to launching the mobile phone application through the first application icon on the application launch interface, the vehicle computer can also display a second application icon in a floating window, and display the application screen when receiving a trigger operation of the second application icon by the user. The vehicle computer can also update the application screen when receiving a touch operation.

[0412] The vehicle computer functions in these embodiments are realized by the vehicle computer reversely controlling the mobile terminal. The reverse control process is described in detail below. Fig.25 , Fig.25 It is a timing diagram of the reverse control process of the interconnected device. The figure shows CarlinkHMI2501 and car SDK2502 of the car computer, mobile SDK2503, interconnection management program 2504 and mobile phone system 2505 of the mobile phone, and a third-party application 2506 is installed on the mobile phone.

[0413] When the user touches and clicks on the application screen in the current projection window (i.e., floating window), CarlinkHMI2501 calls the car SDK2502 interface to notify the mobile phone SDK2503 of the user touch event. Specifically, CarlinkHMI2501 notifies the car SDK2502 of the user touch event, and the car SDK2502 sends the touch event to the mobile phone SDK2503 through the Carlink protocol; the mobile phone SDK2503 calls back the new touch event to the interconnection management program 2504, and then injects it into the mobile phone system 2505, and the mobile phone system 2505 distributes the touch event to the third-party application 2506, so that the third-party application 2506 can draw a new interface on the virtual screen according to the touch position.

[0414] When the virtual screen has content updates, the third-party application 2506 submits the application content; the mobile phone system 2505 notifies the interconnection management program 2504 that the virtual screen has new data, and submits the audio and video stream to the encoder for encoding, and notifies the interconnection management program 2504 of the encoding result; the interconnection management program 2504 packages the encoded audio and video stream in a specified format, such as RTP format, and then pushes it to the car SDK 2502 through the Carlink protocol, which decodes the audio and video stream and renders the output to the surface display.

[0415] See also Fig.26 , Fig.26 1 is a structural diagram of an application display device provided by an exemplary embodiment of the present application. The device includes the following modules.

[0416] The sending module 2601 is used to send the screen data to the interconnected device when a communication connection is established with the interconnected device, and the interconnected device is used to display the screen provided by the mobile terminal in a floating window in the application startup interface based on the screen data;

[0417] The starting module 2602 is used to start a target application, where the target application is the first application icon in the application starting interface, or the application indicated by the second application icon in the screen displayed by the floating window, where the first application icon and the second application icon are icons of applications in the mobile terminal;

[0418] The sending module 2601 is further used to send the screen data of the target application to the interconnected device, and the interconnected device is used to display the running screen of the target application in the floating window based on the screen data of the target application.

[0419] Optionally, the floating window mode of the floating window includes a mirror mode and an interconnected mode;

[0420] The sending module 2601 is further used for:

[0421] When the floating window is in the mirroring mode, sending the screen data of the mirrored screen to the interconnected device;

[0422] or,

[0423] When the floating window is in the interconnection mode, the screen data of the interconnection screen is sent to the interconnection device, where the interconnection screen is a screen of a customized user interface in the interconnection mode, and the interconnection mode refers to a mode in which the interconnection device is in a communication connection with the mobile terminal.

[0424] Optionally, the device further includes a data generating module, configured to:

[0425] In a case where a communication connection is established with the interconnected device, receiving a mode activation instruction sent by the interconnected device, the mode activation instruction is used to indicate the floating window mode in which the floating window is activated; and generating the screen data based on the floating window mode indicated by the mode activation instruction;

[0426] or,

[0427] When a communication connection is established with the interconnected device and a mode setting operation is received, a mode enabling instruction is sent to the interconnected device based on the mode setting operation, the mode setting operation is used to set the floating window mode of the floating window at the interconnected device, and the interconnected device is used to configure the floating window based on the floating window mode indicated by the mode enabling instruction; and the screen data is generated based on the floating window mode indicated by the mode setting operation.

[0428] Optionally, the data generation module is further used to:

[0429] receiving a mode switching instruction sent by the interconnected device, wherein the mode switching instruction is used to instruct switching of the floating window mode of the floating window; and generating the screen data based on the switched floating window mode indicated by the mode switching instruction;

[0430] or,

[0431] In the case of receiving a mode switching operation, sending a mode switching instruction to the interconnected device, wherein the mode switching operation is used to switch the floating window mode of the floating window at the interconnected device, and the interconnected device is used to configure the floating window based on the switched floating window mode indicated by the mode switching instruction; and generate the screen data based on the switched floating window mode indicated by the mode switching operation.

[0432] Optionally, the device further comprises a return module, configured to:

[0433] Receiving a homepage return instruction sent by the interconnected device;

[0434] The target application is closed based on the home page return instruction, and the screen data of the home page screen is sent to the interconnected device. The home page screens in different floating window modes are different. The interconnected device is used to display the home page screen in the floating window based on the screen data of the home page screen.

[0435] Optionally, the device further comprises an opening and closing module, which is used to:

[0436] receiving a floating window closing instruction sent by the interconnected device, wherein the floating window closing instruction is sent when a triggering operation of closing a control in the floating window is received, and the interconnected device displays a floating window float when the floating window is stopped;

[0437] Based on the floating window closing instruction, stop sending the screen data to the interconnected device;

[0438] receiving a floating window opening instruction sent by the interconnected device, wherein the floating window opening instruction is sent when a triggering operation on the floating window float is received;

[0439] The screen data is resent to the interconnected device based on the floating window opening instruction.

[0440] Optionally, the direction switching module is used to:

[0441] In the event of a screen direction switching event, a screen direction switching notification is sent to the interconnected device, and the interconnected device is used to configure the floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification.

[0442] Optionally, the screen direction switching event includes at least one of the following:

[0443] The screen orientation changes;

[0444] Receiving a triggering operation on a screen direction switching control in the target application;

[0445] A reverse control instruction sent by the interconnected device is received, and the reverse control instruction is used to trigger a screen direction switching control in the target application.

[0446] Optionally, the device further includes a screen configuration module, configured to:

[0447] When the screen direction indicated by the screen direction switching notification is a landscape direction, receiving a floating window status notification sent by the interconnected device, wherein the floating window status notification is used to indicate a floating window status of the floating window configured by the interconnected device, and the floating window status includes a landscape state and a full screen state;

[0448] Based on the floating window state indicated by the floating window state notification, a virtual screen is configured, where the virtual screen is used to carry the screen provided by the mobile terminal, and the size of the virtual screen is different in the horizontal screen state and the full screen state.

[0449] Optionally, the device further includes a data transmission module, configured to:

[0450] receiving a full-screen instruction sent by the interconnected device, wherein the full-screen instruction is sent when a triggering operation on the full-screen control in the floating window is received;

[0451] The picture data of the full-screen picture is sent to the interconnected device based on the full-screen instruction.

[0452] Optionally, the sending module 2601 is further used to:

[0453] When a communication connection is established with the interconnected device, sending a first application list to the interconnected device, wherein the first application list includes application programs in the mobile terminal;

[0454] receiving an application information acquisition request sent by the interconnected device, wherein the application information acquisition request is used to acquire application information of application programs in a second application list, wherein the second application list includes application programs screened by the interconnected device from the first application list;

[0455] The application information is sent to the interconnected device, and the interconnected device is used to display the first application icon in the application startup interface based on the application information.

[0456] Optionally, the floating window mode of the floating window includes an Internet mode, and the floating window in the Internet mode displays an Internet screen, and the Internet screen is a screen of a customized user interface in the Internet mode;

[0457] The device also includes an updating module, which is used to:

[0458] The application icons in the customized user interface are updated based on the second application list, wherein the updated customized user interface does not include application icons of application programs outside the second application list.

[0459] Optionally, the startup module 2602 is further used to:

[0460] In response to an application start event, if the target application indicated by the application start event belongs to the second application list, start the target application.

[0461] Optionally, the device further includes a startup prohibition module, configured to:

[0462] In response to the application start event, if the target application indicated by the application start event does not belong to the second application list, prohibiting the start of the target application;

[0463] An application startup failure notification is sent to the interconnected device, and the interconnected device is used to display application startup failure prompt information based on the application startup failure notification.

[0464] In the embodiment of the present application, the mobile terminal can send screen data to the interconnected device when the interconnected device starts the application of the mobile terminal through the first application icon on the application start interface, or starts the application of the mobile terminal through the second application icon in the floating window, supports the interconnected device to start the application in different ways, and realizes the multi-entry start of the application in the mobile terminal on the interconnected device. In addition, the screen data provided by the mobile terminal is used to display the screen in the floating window, not in the new window, which is conducive to reducing the interference of the mobile terminal application screen on the interconnected device.

[0465] See also Fig. 27 , Fig. 27 1 is a structural diagram of an application display device provided by an exemplary embodiment of the present application. The device includes the following modules.

[0466] The display module 2701 is used to display a first application icon and a floating window in the application startup interface when a communication connection is established with the mobile terminal, wherein the floating window is used to display a screen provided by the mobile terminal;

[0467] The display module 2701 is further configured to display an application screen in the floating window in response to a triggering operation on the first application icon in the application launch interface or the second application icon in the screen displayed in the floating window, wherein the application screen is a running screen of the target application indicated by the triggering operation;

[0468] The first application icon and the second application icon are icons of application programs in the mobile terminal.

[0469] Optionally, the floating window mode of the floating window includes a mirror mode and an interconnected mode;

[0470] The display module 2701 is also used for:

[0471] Displaying the floating window in the mirror mode in the application startup interface, wherein the floating window in the mirror mode displays a mirror image provided by the mobile terminal;

[0472] or,

[0473] The floating window in the interconnection mode is displayed in the application startup interface, wherein the floating window in the interconnection mode displays an interconnection screen provided by the mobile terminal, the interconnection screen is a screen of a customized user interface in the interconnection mode, and the interconnection mode refers to a mode in which the interconnection device and the mobile terminal establish a communication connection.

[0474] Optionally, the device further includes an instruction transmission module, configured to:

[0475] In a case where a communication connection is established with the mobile terminal, sending a mode activation instruction to the mobile terminal, the mode activation instruction is used to indicate the floating window mode activated by the floating window, and the mobile terminal is used to provide the interconnected device with a picture that conforms to the floating window mode indicated by the mode activation instruction;

[0476] or,

[0477] When a communication connection is established with the mobile terminal, a mode activation instruction sent by the mobile terminal is received, wherein the mode activation instruction is used to indicate the floating window mode for activating the floating window; and the floating window is configured based on the floating window mode indicated by the mode activation instruction.

[0478] Optionally, the device further includes a mode switching module, configured to:

[0479] In response to a triggering operation on a mode switching control in the floating window, switching the floating window mode of the floating window; based on the switched floating window mode, sending a mode switching instruction to the mobile terminal, the mode switching instruction being used to instruct switching the floating window mode of the floating window, and the mobile terminal being used to provide the interconnected device with a screen that conforms to the switched floating window mode based on the mode switching instruction;

[0480] or,

[0481] A mode switching instruction is received from the mobile terminal, where the mode switching instruction is used to instruct switching of the floating window mode of the floating window; and the floating window is configured based on the switched floating window mode indicated by the mode switching instruction.

[0482] Optionally, the device further comprises a return module, configured to:

[0483] In response to a triggering operation on a homepage return control in the floating window, a homepage return instruction is sent to the mobile terminal, the mobile terminal is used to close the target application based on the homepage return instruction, and provide a homepage screen to the interconnected device, wherein the homepage screen provided by the mobile terminal in different floating window modes is different;

[0484] The home page screen is displayed in the floating window.

[0485] Optionally, the display module 2701 is further used for:

[0486] In response to a triggering operation of closing a control in the floating window, stopping displaying the floating window and displaying a floating window icon;

[0487] In response to a triggering operation on the floating window float, the floating window is redisplayed.

[0488] Optionally, the device further comprises an opening and closing module, which is used to:

[0489] In response to a triggering operation on the close control in the floating window, sending a floating window close instruction to the mobile terminal, and the mobile terminal is used to stop providing pictures to the interconnected device based on the floating window close instruction;

[0490] In response to a triggering operation on the floating window float, a floating window opening instruction is sent to the mobile terminal, and the mobile terminal is used to re-provide a picture to the interconnected device based on the floating window opening instruction.

[0491] Optionally, the device further includes a floating window configuration module, configured to:

[0492] When a screen direction switching notification sent by the mobile terminal is received, the floating window matching the screen direction is configured based on the screen direction indicated by the screen direction switching notification.

[0493] Optionally, the screen direction switching event that triggers the screen direction switching notification includes at least one of the following:

[0494] The screen direction of the mobile terminal changes;

[0495] The mobile terminal receives a triggering operation on a screen direction switching control in the target application;

[0496] The mobile terminal receives a reverse control instruction sent by the interconnected device, and the reverse control instruction is used to trigger a screen direction switching control in the target application.

[0497] Optionally, the floating window configuration module is further used to:

[0498] When the screen direction indicated by the screen direction switching notification is a landscape direction, configuring the floating window in the landscape state based on a size of the landscape floating window;

[0499] or,

[0500] When the screen direction indicated by the screen direction switching notification is a landscape direction, the floating window is configured in a full-screen state based on a screen size of the interconnected device.

[0501] Optionally, the floating window configuration module is further used to:

[0502] In response to a triggering operation on the full-screen control in the floating window, a full-screen instruction is sent to the mobile terminal, and the mobile terminal is used to provide a full-screen image to the interconnected device based on the full-screen instruction;

[0503] The floating window is configured in full screen state.

[0504] Optionally, the startup module is further used to:

[0505] Receiving a first application list sent by the mobile terminal, wherein the first application list includes application programs in the mobile terminal;

[0506] Determine a second application list based on the first application list, where the second application list includes application programs screened from the first application list;

[0507] Sending an application information acquisition request to the mobile terminal based on the second application list, wherein the application information acquisition request is used to acquire application information of application programs in the second application list;

[0508] Based on the application information sent by the mobile terminal, the first application icon is displayed in the application startup interface.

[0509] Optionally, the display module 2701 is further used for:

[0510] In response to a triggering operation on the second application icon in the screen displayed in the floating window, and in a case where the target application indicated by the triggering operation belongs to the second application list, an application screen is displayed in the floating window.

[0511] Optionally, the display module 2701 is further used for:

[0512] In response to a triggering operation on the second application icon in the screen displayed by the floating window, and when the target application indicated by the triggering operation does not belong to the second application list, an application startup failure prompt message is displayed.

[0513] In the embodiment of the present application, the interconnected device can provide a first application icon for launching the mobile terminal application on the application launch interface, and can also provide a second application icon for launching the mobile terminal application in the floating window, so that the mobile terminal application can be launched on the interconnected device in a variety of ways. The application screen is displayed in the floating window instead of in a new window, which is conducive to reducing the interference of the mobile terminal application screen on the interconnected device.

[0514] See also Fig.28 , Fig.28 The electronic device provided by an exemplary embodiment of the present application is shown in a structural block diagram. The electronic device includes a processor 2801 and a memory 2802 .

[0515] Optionally, the processor 2801 uses various interfaces and lines to connect various parts of the entire computer device, and executes various functions of the computer device and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 2802, and calling data stored in the memory 2802. Optionally, the processor 2801 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-ProgrammableGate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 2801 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphic Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU) and a baseband chip. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the touch display; the NPU is used to implement artificial intelligence (Artificial Intelligence, AI) functions; and the baseband chip is used to process wireless communications. It is understandable that the above-mentioned baseband chip may not be integrated into the processor 2801, but may be implemented by a separate chip.

[0516] The memory 2802 may be a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 2802 includes a non-transitory computer-readable storage medium. The memory 2802 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 2802 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc.; the data storage area may store data created according to the use of the computer device (such as audio data, a phone book), etc.

[0517] In addition, those skilled in the art will appreciate that the structure of the computer device shown in the above figures does not constitute a limitation on the computer device, and the computer device may include more or fewer components than shown in the figure, or a combination of certain components, or a different arrangement of components.

[0518] An embodiment of the present application further provides a computer-readable storage medium, wherein at least one computer instruction is stored in the computer-readable storage medium, and the computer instruction is loaded and executed by a processor to implement the application display method as described in the above embodiment.

[0519] Optionally, the computer readable storage medium may include: ROM, RAM, solid state drives (SSD) or optical disks, etc. Among them, RAM may include resistance random access memory (ReRAM) and dynamic random access memory (DRAM).

[0520] An embodiment of the present application also provides a computer program product, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; a processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the application display method described in the above embodiment.

[0521] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. An application display method, It is characterized in that The method is used in a mobile terminal, and the method comprises: When a communication connection is established with an interconnected device, sending screen data to the interconnected device, the interconnected device is used to display the screen provided by the mobile terminal in a floating window in an application startup interface based on the screen data; Launching a target application, wherein the target application is a first application icon in the application launch interface, or an application indicated by a second application icon in the screen displayed by the floating window, wherein the first application icon and the second application icon are icons of applications in the mobile terminal; The screen data of the target application is sent to the interconnected device, and the interconnected device is used to display the running screen of the target application in the floating window based on the screen data of the target application.

2. The method according to claim 1, It is characterized in that The floating window modes of the floating window include a mirror mode and an interconnected mode; The sending of the picture data to the interconnected device includes: When the floating window is in the mirroring mode, sending the screen data of the mirrored screen to the interconnected device; or, When the floating window is in the interconnection mode, the screen data of the interconnection screen is sent to the interconnection device, where the interconnection screen is a screen of a customized user interface in the interconnection mode, and the interconnection mode refers to a mode in which the interconnection device is in a communication connection with the mobile terminal.

3. The method according to claim 2, It is characterized in that The method comprises: In a case where a communication connection is established with the interconnected device, receiving a mode activation instruction sent by the interconnected device, the mode activation instruction is used to indicate the floating window mode in which the floating window is activated; and generating the screen data based on the floating window mode indicated by the mode activation instruction; or, When a communication connection is established with the interconnected device and a mode setting operation is received, a mode enabling instruction is sent to the interconnected device based on the mode setting operation, the mode setting operation is used to set the floating window mode of the floating window at the interconnected device, and the interconnected device is used to configure the floating window based on the floating window mode indicated by the mode enabling instruction; and the screen data is generated based on the floating window mode indicated by the mode setting operation.

4. The method according to claim 2, It is characterized in that The method further comprises: receiving a mode switching instruction sent by the interconnected device, wherein the mode switching instruction is used to instruct switching of the floating window mode of the floating window; and generating the screen data based on the switched floating window mode indicated by the mode switching instruction; or, In the case of receiving a mode switching operation, sending a mode switching instruction to the interconnected device, wherein the mode switching operation is used to switch the floating window mode of the floating window at the interconnected device, and the interconnected device is used to configure the floating window based on the switched floating window mode indicated by the mode switching instruction; and generate the screen data based on the switched floating window mode indicated by the mode switching operation.

5. The method according to claim 2, It is characterized in that The method further comprises: Receiving a homepage return instruction sent by the interconnected device; The target application is closed based on the home page return instruction, and the screen data of the home page screen is sent to the interconnected device. The home page screens in different floating window modes are different. The interconnected device is used to display the home page screen in the floating window based on the screen data of the home page screen.

6. The method according to any one of claims 1 to 5, It is characterized in that The method further comprises: receiving a floating window closing instruction sent by the interconnected device, wherein the floating window closing instruction is sent when a triggering operation of closing a control in the floating window is received, and the interconnected device displays a floating window float when the floating window is stopped; Based on the floating window closing instruction, stop sending the screen data to the interconnected device; receiving a floating window opening instruction sent by the interconnected device, wherein the floating window opening instruction is sent when a triggering operation on the floating window float is received; The screen data is resent to the interconnected device based on the floating window opening instruction.

7. The method according to any one of claims 1 to 5, It is characterized in that The method further comprises: In the event of a screen direction switching event, a screen direction switching notification is sent to the interconnected device, and the interconnected device is used to configure the floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification.

8. The method according to claim 7, It is characterized in that The screen direction switching event includes at least one of the following: The screen orientation changes; Receiving a triggering operation on a screen direction switching control in the target application; A reverse control instruction sent by the interconnected device is received, and the reverse control instruction is used to trigger a screen direction switching control in the target application.

9. The method according to claim 7, It is characterized in that The method further comprises: When the screen direction indicated by the screen direction switching notification is a landscape direction, receiving a floating window status notification sent by the interconnected device, wherein the floating window status notification is used to indicate a floating window status of the floating window configured by the interconnected device, and the floating window status includes a landscape state and a full screen state; Based on the floating window state indicated by the floating window state notification, a virtual screen is configured, where the virtual screen is used to carry the screen provided by the mobile terminal, and the size of the virtual screen is different in the horizontal screen state and the full screen state.

10. The method according to any one of claims 1 to 5, It is characterized in that The method further comprises: receiving a full-screen instruction sent by the interconnected device, wherein the full-screen instruction is sent when a triggering operation on the full-screen control in the floating window is received; The picture data of the full-screen picture is sent to the interconnected device based on the full-screen instruction.

11. The method according to any one of claims 1 to 5, It is characterized in that The method further comprises: When a communication connection is established with the interconnected device, sending a first application list to the interconnected device, wherein the first application list includes application programs in the mobile terminal; receiving an application information acquisition request sent by the interconnected device, wherein the application information acquisition request is used to acquire application information of application programs in a second application list, wherein the second application list includes application programs screened by the interconnected device from the first application list; The application information is sent to the interconnected device, and the interconnected device is used to display the first application icon in the application startup interface based on the application information.

12. The method according to claim 11, It is characterized in that The floating window mode of the floating window includes an interconnection mode, and the floating window in the interconnection mode displays an interconnection screen, which is a screen of a customized user interface in the interconnection mode; The method further comprises: The application icons in the customized user interface are updated based on the second application list, wherein the updated customized user interface does not include application icons of application programs outside the second application list.

13. The method according to claim 11, It is characterized in that The launching of the target application comprises: In response to an application start event, if the target application indicated by the application start event belongs to the second application list, start the target application.

14. The method according to claim 13, It is characterized in that The method further comprises: In response to the application start event, if the target application indicated by the application start event does not belong to the second application list, prohibiting the start of the target application; An application startup failure notification is sent to the interconnected device, and the interconnected device is used to display application startup failure prompt information based on the application startup failure notification.

15. An application display method, It is characterized in that The method is used for interconnecting devices, and the method comprises: When a communication connection is established with the mobile terminal, displaying a first application icon and a floating window in an application startup interface, wherein the floating window is used to display a screen provided by the mobile terminal; In response to a triggering operation on the first application icon in the application launch interface or the second application icon in the screen displayed in the floating window, displaying an application screen in the floating window, the application screen being a running screen of the target application indicated by the triggering operation; The first application icon and the second application icon are icons of application programs in the mobile terminal.

16. The method according to claim 15, It is characterized in that The floating window modes of the floating window include a mirror mode and an interconnected mode; The displaying of a floating window in the application startup interface includes: Displaying the floating window in the mirror mode in the application startup interface, wherein the floating window in the mirror mode displays a mirror image provided by the mobile terminal; or, The floating window in the interconnection mode is displayed in the application startup interface, wherein the floating window in the interconnection mode displays an interconnection screen provided by the mobile terminal, the interconnection screen is a screen of a customized user interface in the interconnection mode, and the interconnection mode refers to a mode in which the interconnection device and the mobile terminal establish a communication connection.

17. The method according to claim 16, It is characterized in that The method comprises: In a case where a communication connection is established with the mobile terminal, sending a mode activation instruction to the mobile terminal, the mode activation instruction is used to indicate the floating window mode activated by the floating window, and the mobile terminal is used to provide the interconnected device with a picture that conforms to the floating window mode indicated by the mode activation instruction; or, When a communication connection is established with the mobile terminal, a mode activation instruction sent by the mobile terminal is received, wherein the mode activation instruction is used to indicate the floating window mode for activating the floating window; and the floating window is configured based on the floating window mode indicated by the mode activation instruction.

18. The method according to claim 16, It is characterized in that The method further comprises: In response to a triggering operation on a mode switching control in the floating window, switching the floating window mode of the floating window; based on the switched floating window mode, sending a mode switching instruction to the mobile terminal, the mode switching instruction being used to instruct switching the floating window mode of the floating window, and the mobile terminal being used to provide the interconnected device with a screen that conforms to the switched floating window mode based on the mode switching instruction; or, A mode switching instruction is received from the mobile terminal, where the mode switching instruction is used to instruct switching of the floating window mode of the floating window; and the floating window is configured based on the switched floating window mode indicated by the mode switching instruction.

19. The method according to claim 16, It is characterized in that The method further comprises: In response to a triggering operation on a homepage return control in the floating window, a homepage return instruction is sent to the mobile terminal, the mobile terminal is used to close the target application based on the homepage return instruction, and provide a homepage screen to the interconnected device, wherein the homepage screen provided by the mobile terminal in different floating window modes is different; The home page screen is displayed in the floating window.

20. The method according to any one of claims 15 to 19, It is characterized in that The method further comprises: In response to a triggering operation of closing a control in the floating window, stopping displaying the floating window and displaying a floating window icon; In response to a triggering operation on the floating window float, the floating window is redisplayed.

21. The method according to claim 20, It is characterized in that The method further comprises: In response to a triggering operation on the close control in the floating window, sending a floating window close instruction to the mobile terminal, and the mobile terminal is used to stop providing pictures to the interconnected device based on the floating window close instruction; In response to a triggering operation on the floating window float, a floating window opening instruction is sent to the mobile terminal, and the mobile terminal is used to re-provide a picture to the interconnected device based on the floating window opening instruction.

22. The method according to any one of claims 15 to 19, It is characterized in that The method further comprises: When a screen direction switching notification sent by the mobile terminal is received, the floating window matching the screen direction is configured based on the screen direction indicated by the screen direction switching notification.

23. The method according to claim 22, It is characterized in that The screen direction switching event that triggers the screen direction switching notification includes at least one of the following: The screen direction of the mobile terminal changes; The mobile terminal receives a triggering operation on a screen direction switching control in the target application; The mobile terminal receives a reverse control instruction sent by the interconnected device, and the reverse control instruction is used to trigger a screen direction switching control in the target application.

24. The method according to claim 22, It is characterized in that The configuring the floating window matching the screen direction based on the screen direction indicated by the screen direction switching notification includes: When the screen direction indicated by the screen direction switching notification is a landscape direction, configuring the floating window in the landscape state based on a size of the landscape floating window; or, When the screen direction indicated by the screen direction switching notification is a landscape direction, the floating window is configured in a full-screen state based on a screen size of the interconnected device.

25. The method according to any one of claims 15 to 19, It is characterized in that The method further comprises: In response to a triggering operation on the full-screen control in the floating window, a full-screen instruction is sent to the mobile terminal, and the mobile terminal is used to provide a full-screen image to the interconnected device based on the full-screen instruction; The floating window is configured in full screen state.

26. The method according to any one of claims 15 to 19, It is characterized in that The displaying of the first application icon in the application startup interface includes: Receiving a first application list sent by the mobile terminal, wherein the first application list includes application programs in the mobile terminal; Determine a second application list based on the first application list, where the second application list includes application programs screened from the first application list; Sending an application information acquisition request to the mobile terminal based on the second application list, wherein the application information acquisition request is used to acquire application information of application programs in the second application list; Based on the application information sent by the mobile terminal, the first application icon is displayed in the application startup interface.

27. The method according to claim 26, It is characterized in that The step of displaying an application screen in the floating window in response to a triggering operation on a second application icon in the screen displayed in the floating window comprises: In response to a triggering operation on the second application icon in the screen displayed in the floating window, and in a case where the target application indicated by the triggering operation belongs to the second application list, an application screen is displayed in the floating window.

28. The method according to claim 27, It is characterized in that The method further comprises: In response to a triggering operation on the second application icon in the screen displayed by the floating window, and when the target application indicated by the triggering operation does not belong to the second application list, an application startup failure prompt message is displayed.

29. An application display device, It is characterized in that The device comprises: A sending module, used for sending screen data to the interconnected device when a communication connection is established with the interconnected device, and the interconnected device is used for displaying the screen provided by the mobile terminal in a floating window in the application startup interface based on the screen data; a launch module, used to launch a target application, the target application being the first application icon in the application launch interface, or the application indicated by the second application icon in the screen displayed by the floating window, the first application icon and the second application icon being icons of applications in the mobile terminal; The sending module is further used to send the screen data of the target application to the interconnected device, and the interconnected device is used to display the running screen of the target application in the floating window based on the screen data of the target application.

30. An application display device, It is characterized in that The device comprises: A display module, configured to display a first application icon and a floating window in an application startup interface when a communication connection is established with a mobile terminal, wherein the floating window is configured to display a screen provided by the mobile terminal; The display module is further configured to display an application screen in the floating window in response to a triggering operation on the first application icon in the application launch interface or the second application icon in the screen displayed in the floating window, wherein the application screen is a running screen of the target application indicated by the triggering operation; The first application icon and the second application icon are icons of application programs in the mobile terminal.

31. An electronic device, It is characterized in that The electronic device includes a processor and a memory; the memory stores at least one computer instruction, and the at least one computer instruction is used to be executed by the processor to implement the application display method as described in any one of claims 1 to 14, or to implement the application display method as described in any one of claims 15 to 28.

32. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores at least one computer instruction, and the computer instruction is loaded and executed by the processor to implement the application display method as described in any one of claims 1 to 14, or to implement the application display method as described in any one of claims 15 to 28.

33. A computer program product, It is characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium; a processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the application display method as described in any one of claims 1 to 14, or implements the application display method as described in any one of claims 15 to 28.

Citation Information

Cited By

  • Application display methods and apparatuses, and electronic device, medium and program product

    WO2026036841A1