A display method, system, device, and storage medium

By adopting a parallel view mode on the vehicle's infotainment system, the problem of poor display quality when maximizing the virtual screen of the vehicle's infotainment system has been solved, and multiple interfaces of the same application can be displayed simultaneously, thus improving the user experience.

CN120343315BActive Publication Date: 2026-03-20HONOR DEVICE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410046009.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-01-10
Publication Date
2026-03-20
Estimated Expiration
2044-01-10

AI Technical Summary

Technical Problem

In existing technologies, when the vehicle's infotainment system is operating in virtual screen mode with the screen maximized, the application interface is not adapted to irregularly shaped screens or landscape mode, resulting in poor display effects, insufficient operation experience and information acquisition, disordered interface positions, inappropriate control sizes, and a decline in user experience.

Method used

The Parallel View mode is adopted, which displays two application interfaces of the same application on the vehicle's display screen at the same time. The system determines whether the target application has enabled the Parallel View function through a pre-configured whitelist and controls the vehicle's display to use the application's split-screen mode, thus avoiding problems such as incorrect display position and inappropriate control size.

Benefits of technology

It improves the aesthetics and consistency of the vehicle's display and operating logic, increases the amount of information displayed, and enhances the user experience on the vehicle's infotainment system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120343315B_ABST
    Figure CN120343315B_ABST
Patent Text Reader

Abstract

The application provides a display method, system, device and storage medium. The method is applied to a first electronic device, the first electronic device is connected with a second electronic device, the second electronic device has a display screen, and the method comprises the following steps: the first electronic device acquires a first operation request message sent by the second electronic device in a preset mode, the first operation request message is sent by the second electronic device in response to a first operation on a first interface; the first electronic device determines the screen size of a virtual screen corresponding to a target application in response to the first operation request message; the first electronic device starts a parallel view mode, and generates a second interface of the virtual screen based on the screen size in the parallel view mode; and the first electronic device outputs first control data, the first control data is used for controlling the second electronic device to display the second interface on the display screen.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, and in particular, to a display method, a system, a device and a storage medium. BACKGROUND

[0002] With the development of the Internet of Vehicles industry, vehicle-machine interconnection is becoming a low-cost and efficient Internet of Vehicles solution, among which the scheme of playing favorite music through a car audio is the most widely used. After a terminal device is connected to a car machine, in order to facilitate a user to operate each application on the terminal device through the car machine, a super desktop can be used to realize desktop application sharing. In the scenario of the super desktop, the car machine can display an application list of the terminal device and use the corresponding application.

[0003] However, in the existing scheme, the car machine can only open the application in the terminal device in a small window or full-screen mode through a virtual screen. In the case that the application is opened in a small window mode on the virtual screen of the car machine, if the user clicks a maximize operation control in the interface, the application full-screen display mode will be directly started. At this time, since the interface of some applications is not adapted to the special-shaped screen or the horizontal screen mode of the car machine, the display effect on the car machine after starting the application full-screen mode will be poor, which causes poor operation experience, poor display interface visual effect and less available application information of the user in the process of using the application, and may also cause problems such as disordered interface display position, unsuitable application control size and the like, thereby reducing the user experience. SUMMARY

[0004] Some embodiments of the present application provide a display method, which is described below from multiple aspects. The embodiments and advantages of the multiple aspects can be mutually referred to.

[0005] In a first aspect, the embodiments of the present application provide a display method applied to a first electronic device, the first electronic device being in communication connection with a second electronic device, the second electronic device having a display screen, and the method comprising:

[0006] The first electronic device acquires a first operation request message sent by the second electronic device in a preset mode, the first operation request message being sent by the second electronic device in response to a first operation on a first interface; wherein the first interface comprises a first display window, the first display window being used to display a first application interface of a target application, and the first operation comprising an operation of maximizing the first interface;

[0007] The first electronic device determines a screen size of a virtual screen corresponding to the target application in response to the first operation request message;

[0008] The first electronic device starts the parallel view mode, and generates a second interface of the virtual screen based on the screen size in the parallel view mode; wherein the second interface includes a second display window and a third display window displayed in split screen, and the second display window and the third display window are respectively used to display a first application interface and a second application interface of the target application.

[0009] The first electronic device outputs first control data, and the first control data is used to control the second electronic device to display the second interface on the display screen.

[0010] According to the embodiments of the present application, when the user performs the operation of maximizing the small window interface to enter full screen, the phone can control the car machine to pull up the full screen layout of the parallel view mode based on the operation, so that the car machine displays two application interfaces of the same application in the form of split screen display, and the two application interfaces can be different application interfaces. In this way, the car machine display screen can simultaneously display two application interfaces of the same application, such as simultaneously displaying the home page interface and the music playing interface of the music playing application. This display mode can display more information content on the large screen of the car machine, and the display interface is more beautiful, the operation logic is more in line with the daily use of the user, and the use experience of the user on the car machine is improved.

[0011] In some embodiments, the first electronic device starts the parallel view mode, and generates a second interface of the virtual screen based on the screen size of the virtual screen in the parallel view mode, including:

[0012] The first electronic device determines whether the target application opens the parallel view function;

[0013] If the target application opens the parallel view function, the first electronic device starts the parallel view mode, and generates a second interface of the virtual screen based on the screen size of the virtual screen in the parallel view mode.

[0014] In some embodiments, the first electronic device determines whether the target application opens the parallel view function, including:

[0015] The first electronic device judges whether the target application is recorded in a pre-configured whitelist;

[0016] If yes, it is determined that the target application opens the parallel view function;

[0017] If no, it is determined that the target application does not open the parallel view function.

[0018] According to the embodiment of the present application, since there is no user-operable switch control in the super desktop scene, the mobile phone can determine whether the target application opens the parallel view function according to the pre-configured whitelist, and only control the vehicle machine to pull up the full-screen layout of the parallel view mode for the application that opens the parallel view function. Moreover, the applications in the whitelist can be modified according to actual needs, and the applications with higher adaptation degree for the vehicle machine display screen are added to the whitelist, which can ensure the correctness and aesthetics of the interface displayed in the parallel view mode, avoid problems such as interface display position disorder and application control size being inappropriate, and further ensure the user experience.

[0019] In some embodiments, if the target application opens the parallel view function, the first electronic device starts the parallel view mode, and generates a second interface of the virtual screen in the parallel view mode based on the screen size of the virtual screen, including:

[0020] If the target application opens the parallel view function, the first electronic device determines whether the first application interface is a non-home page interface of the target application;

[0021] If the first application interface is a non-home page interface of the target application, the first electronic device starts the parallel view mode, and generates a second interface of the virtual screen in the parallel view mode based on the screen size of the virtual screen; and the first application interface displayed in the second interface is different from the second application interface.

[0022] In some embodiments, the method further includes:

[0023] If the first application interface is a home page interface of the target application, the first electronic device starts the parallel view mode, and generates a third interface of the virtual screen in the parallel view mode based on the screen size of the virtual screen; wherein the third interface includes a fourth display window, the size of the fourth display window is larger than the size of the first display window, and the fourth display window is used to display the first application interface with an enlarged size;

[0024] The first electronic device outputs second control data, and the second control data is used to control the second electronic device to display the third interface on the display screen.

[0025] According to the embodiment of the present application, when the vehicle machine displays the home page interface of the target application in the small window mode, if the user performs the operation of maximizing the small window interface to enter the full screen, the mobile phone can control the vehicle machine to pull up the full-screen layout of the parallel view mode based on the operation, so that the vehicle machine only displays the home page interface with an enlarged size in part of the display screen, which can increase the display area of the display screen for displaying the application interface, reduce the invalid operation area such as black screen or white screen, and make the vehicle machine display more information content without excessively stretching the application interface, thereby improving the display effect of the application on the vehicle machine.

[0026] In some embodiments, the method further includes:

[0027] The first electronic device generates a fourth interface of the virtual screen based on a screen size of the virtual screen in the parallel view mode in response to a second operation based on the first application interface; wherein the second operation includes an operation for browsing content in the first application interface; the fourth interface includes a fifth display window and a sixth display window displayed in split screen, and the fifth display window and the sixth display window are respectively used to display the first application interface of the target application and the third application interface, and the third application interface is a result interface corresponding to the second operation;

[0028] The first electronic device outputs third control data, and the third control data is used to control the second electronic device to display the fourth interface on the display screen.

[0029] In some embodiments, the second operation includes an operation of searching content in the first application interface.

[0030] In some embodiments, the second operation includes an operation of checking displayed content in the first application interface.

[0031] According to the embodiments of the present application, when the car machine displays the home page interface of the target application after expansion of the size, if the user performs an operation of searching content or an operation of checking displayed content on the home page interface, the mobile phone can control the car machine to display two application interfaces of the same application in the form of split screen display within the application, and the two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be displayed on the car machine display screen at the same time, such as the home page interface and the music search interface of the music playing application. This display mode can display more information content on the large screen of the car machine, and the display interface is more beautiful, and the operation logic is more in line with the daily use of the user, thereby improving the user experience on the car machine.

[0032] In some embodiments, the method further includes:

[0033] The first electronic device obtains a third operation request message sent by the second electronic device in a preset mode, and the third operation request message is sent by the second electronic device in response to a third operation on the second interface or the fourth interface; wherein the third operation includes an operation of zooming out the second interface or the fourth interface;

[0034] The first electronic device adjusts the screen size of the virtual screen corresponding to the target application in response to the third operation request message;

[0035] The first electronic device exits the parallel view mode, and generates a fifth interface of the virtual screen based on the adjusted screen size; wherein the fifth interface includes a seventh display window, and the seventh display window is used to display the first application interface or the third application interface of the target application;

[0036] The first electronic device outputs fourth control data, which is used to control the second electronic device to display the fifth interface on the screen.

[0037] According to the embodiments of this application, when the vehicle infotainment system displays two application interfaces of a target application in parallel view mode, if the user performs a minimize operation to exit full-screen mode on the parallel view interface, the mobile phone can control the vehicle infotainment system to exit the full-screen layout of parallel view mode based on this operation, so that the vehicle infotainment system displays one interface of the target application in a small window mode. This method of exiting full-screen mode is simple and convenient to operate, the operation logic conforms to the user's daily use, and it can quickly exit full-screen display, further improving the user experience on the vehicle infotainment system.

[0038] In some implementations, the method further includes:

[0039] After the first electronic device establishes a communication connection with the second electronic device, it obtains an application launch message for the target application sent by the second electronic device in a preset mode. The application launch message is sent by the second electronic device in response to the launch operation for the target application.

[0040] The first electronic device responds to the application launch message and creates a virtual screen corresponding to the target application;

[0041] The first electronic device generates the first interface of the virtual screen based on the screen size of the virtual screen;

[0042] The first electronic device outputs fifth control data, which is used to control the second electronic device to display the first interface on the screen.

[0043] According to the embodiments of this application, after a communication connection is established between the mobile phone and the vehicle's infotainment system, the mobile phone can project its screen onto the vehicle's infotainment system via a virtual screen, thereby enabling the vehicle's infotainment system to function as a super desktop and sharing desktop applications between the mobile phone and the vehicle's infotainment system. Users can operate various applications installed on their mobile phones through the vehicle's infotainment system's display screen, making it more convenient for users to operate while driving and improving the user experience.

[0044] In a second aspect, embodiments of this application provide a display method applied to a system including a first electronic device and a second electronic device, wherein the first electronic device and the second electronic device are communicatively connected, and the second electronic device has a display screen; the method includes:

[0045] The second electronic device starts a preset mode and displays a first interface in the preset mode. The first interface includes a first display window, which is used to display the first application interface of the target application.

[0046] The second electronic device sends a first operation request message to the first electronic device in response to the first operation on the first interface; wherein the first operation comprises an operation of maximizing the first interface;

[0047] The first electronic device obtains the first operation request message sent by the second electronic device;

[0048] The first electronic device determines the screen size of the virtual screen corresponding to the target application in response to the first operation request message;

[0049] The first electronic device starts the parallel view mode, and generates a second interface of the virtual screen based on the screen size of the virtual screen in the parallel view mode; wherein the second interface comprises a second display window and a third display window displayed in a split screen mode, and the second display window and the third display window are respectively used to display the first application interface and the second application interface of the target application;

[0050] The first electronic device outputs first control data, and the first control data is used to control the second electronic device to display the second interface on the display screen.

[0051] The beneficial effects achieved by the second aspect can refer to the beneficial effects of any of the embodiments of the first aspect of the present application, which will not be repeated here.

[0052] In a third aspect, the embodiments of the present application provide a display system, comprising a first electronic device and a second electronic device, the first electronic device is in communication connection with the second electronic device, and the second electronic device has a display screen;

[0053] The second electronic device is configured to start a preset mode, display a first interface in the preset mode, the first interface comprises a first display window, and the first display window is used to display a first application interface of a target application; in response to a first operation on the first interface, send a first operation request message to the first electronic device; wherein the first operation comprises an operation of maximizing the first interface;

[0054] The first electronic device is configured to obtain the first operation request message sent by the second electronic device; in response to the first operation request message, determine the screen size of the virtual screen corresponding to the target application; start the parallel view mode, and generate a second interface of the virtual screen based on the screen size of the virtual screen in the parallel view mode; wherein the second interface comprises a second display window and a third display window displayed in a split screen mode, and the second display window and the third display window are respectively used to display the first application interface and the second application interface of the target application; and output first control data, and the first control data is used to control the second electronic device to display the second interface on the display screen.

[0055] The beneficial effects achieved by the third aspect can refer to the beneficial effects of any of the embodiments of the first aspect of the present application, which will not be repeated here.

[0056] Fourthly, embodiments of this application provide an electronic device, including: a memory for storing instructions executable by one or more processors of the electronic device; and a processor, which, when executing the instructions in the memory, causes the electronic device to perform the steps executed by a first electronic device in any embodiment of the first aspect of this application, or to perform the steps executed by a second electronic device in any embodiment of the first aspect of this application. The beneficial effects achievable in this fourth aspect can be referred to the beneficial effects of any embodiment of the first aspect of this application, and will not be repeated here.

[0057] Fifthly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the steps executed by a first electronic device in any embodiment of the first aspect of this application, or to perform the steps executed by a second electronic device in any embodiment of the first aspect of this application. The beneficial effects achievable through this fifth aspect can be found in the beneficial effects of any embodiment of the first aspect of this application, and will not be repeated here. Attached Figure Description

[0058] Figure 1 a A schematic diagram illustrating an application scenario provided by an embodiment of this application is shown;

[0059] Figure 1 b A schematic diagram of a parallel horizon mode provided in one embodiment of this application is shown;

[0060] Figure 2 The diagram illustrates the process of maximizing the entry into full-screen display as provided in some embodiments;

[0061] Figure 3a This invention provides a schematic diagram of the structure of an electronic device according to an embodiment of the present application.

[0062] Figure 3b A software structure block diagram of an electronic device according to an embodiment of this application is shown;

[0063] Figure 3c It shows Figure 3b Software structure diagram of each module in the application framework layer;

[0064] Figure 4 A flowchart of a display method provided in one embodiment of this application is shown;

[0065] Figure 5 A flowchart illustrating the creation and release of a virtual container according to an embodiment of this application is shown;

[0066] Figure 6aA diagram illustrating a small window mode starting an application is shown;

[0067] Figure 6b A diagram illustrating a small window mode switching to a parallel view mode is shown;

[0068] Figure 6c A diagram illustrating a small window mode switching to a normal full screen mode is shown;

[0069] Figure 7 A flowchart illustrating a process of creating and deleting a virtual screen is shown;

[0070] Figure 8 A flowchart illustrating a display method is shown;

[0071] Figure 9a A diagram illustrating a small window mode switching to a parallel view mode is shown;

[0072] Figure 9b A diagram illustrating a process of a user searching for music is shown;

[0073] Figure 10 A flowchart illustrating a display method is shown;

[0074] Figure 11 A flowchart illustrating a display method is shown;

[0075] Figure 12 A flowchart illustrating a display method is shown;

[0076] Figure 13 A diagram illustrating a structure of a system on chip (SOC) is shown. DETAILED DESCRIPTION

[0077] The illustrative embodiments of the present application include, but are not limited to, a display method, a system, a device, and a storage medium. The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present application.

[0078] The display method provided in this application can be applied to in-application split-screen display in a heterogeneous projection scenario. This scenario may include a first electronic device and a second electronic device establishing a connection. The first electronic device can use heterogeneous projection technology to project its screen to the second electronic device, thereby enabling the second electronic device to perform in-application split-screen display. For ease of explanation, this application uses a parallel view mode to represent the in-application split-screen function.

[0079] Specifically, heterogeneous projection means that the first electronic device and the second electronic device can display projection content asynchronously, or in other words, the display content of the first electronic device and the second electronic device can be different. For example, a terminal device (taking the first electronic device as an example in this application) can create a virtual screen and project the application interface of a music playback application onto the vehicle's infotainment system (taking the second electronic device as an example in this application), while the physical screen of the terminal device can display the main interface or the application interface of another application. That is, while the terminal device is displaying the main interface or the application interface of another application, the vehicle's infotainment system displays the application interface of the music playback application; that is, the terminal device and the vehicle's infotainment system display projection content asynchronously. Heterogeneous projection technology allows the terminal device to project the first application interface of a first application onto the vehicle's infotainment system display, while the terminal device displays the second application interface of a second application, facilitating user operation. The specific implementation principle of heterogeneous projection will not be elaborated in the embodiments of this application.

[0080] In one specific embodiment, the display method provided in this application can be applied to the use of applications on the terminal device via the vehicle-mounted system in a super desktop scenario after the vehicle-mounted system is connected to the terminal device, so that the applications can be displayed on the vehicle-mounted system in a parallel view mode.

[0081] Figure 1 a A schematic diagram illustrating a possible application scenario provided by one embodiment of this application is shown. For example... Figure 1 a As shown, the vehicle-mounted system 100 and the terminal device 200 ( Figure 1 a (Taking a mobile phone as an example of a terminal device) Specifically, the vehicle infotainment system 100 can open the Super Desktop (as an example of a preset mode) and automatically discover the connectable terminal device 200. Users can then connect by clicking on the connectable terminal device 200. The Super Desktop is a mode used to achieve desktop application sharing. After the vehicle infotainment system 100 opens the Super Desktop and successfully connects to the terminal device 200, the vehicle infotainment system 100 can display various applications installed on the terminal device 200 in the Super Desktop, enabling the sharing of desktop applications between the terminal device 200 and the vehicle infotainment system 100. Users can use various applications on the terminal device 200 through the vehicle infotainment system 100, and the vehicle infotainment system 100 can display the first and second application interfaces in a parallel view mode.

[0082] Figure 1 bA schematic diagram of the parallel visual field mode of the car machine 100 is shown. The parallel visual field mode of the car machine 100 in the present application, that is, two application interfaces of the same application are displayed in the first display window 110 and the second display window 120 of the car machine 100 respectively. For example, taking a music playing application as an example, the application interface in the music playing application can include a home page, a music playing interface, a music search interface, and the like. As shown in Figure 1 b the car machine can display the home page interface in the music playing application, for example, a "recommended music interface", in the first display window 110, and display the "music playing interface" of the music clicked by the user in the "recommended music interface" in the second display window 120. In addition, the second display window 120 can also display other interfaces in the music playing application, for example, a music search interface, a music list interface, or the same interface as the interface in the first display window 110, which is not limited herein.

[0083] It should be noted that Figure 1 a the application scenario of the super desktop shown is only an example, and the embodiments of the present application are not limited thereto.

[0084] In some embodiments, when the user uses an application through the super desktop of the car machine, the car machine can open the application in a small window or full screen mode on the virtual screen, which cannot achieve the parallel visual field mode when opening some applications on devices such as folding screen mobile phones or tablet computers. For example, with reference to the schematic diagram of the parallel visual field mode of the car machine 100 shown in FIG. 2, the car machine can open the music playing application in a small window mode in the first display window 110, and the music playing interface in the music playing application can include a maximize operation control 111. In the small window mode, the first display window 110 is only displayed in a part of the super desktop, and the remaining area still displays the application icons of various applications of the terminal device. Figure 2 Figure 2 A schematic diagram of the maximum full screen display process provided by some embodiments is shown. As shown in Figure 2 after the user starts the music playing application through the super desktop 210, the car machine can display the music playing interface of the music playing application in a small window mode in the first display window 220, and the music playing interface can include a maximize operation control 221. In the small window mode, the first display window 220 is only displayed in a part of the super desktop, and the remaining area still displays the application icons of various applications of the terminal device.

[0085] At this time, if the user wants to maximize the display interface, the maximize operation control 221 in the music playing interface can be clicked, for example, the user directly clicks the maximize operation control 221 by the finger. As shown in Figure 2 ​As shown, after the car machine receives the user's click operation on the maximum operation control 221, in response to the click operation, the music playing interface of the music playing application can be displayed in a full screen mode in the second display window 230. In the full screen mode, the second display window 230 fills the entire area of the super desktop, but the display position and size of the content part in the music playing interface do not change, or the content part in the music playing interface is stretched to fill the entire area of the super desktop. At this time, due to the fact that the interface of some applications is not adapted to the special-shaped screen or the horizontal screen mode of the car machine, after the application enters the full screen mode, only a small part of the display screen is used to display the application, and most of the area is a black screen or a white screen, etc. Invalid operation area, which makes the display effect on the car machine poor, causes poor operation experience, poor application display interface visual effect, and less available application information during the user's use of the application, and can also cause interface display position disorder, application control size is not suitable, etc. Make the user's use experience decline.

[0086] To solve the above problems, the display method provided by the embodiments of the present application is used to display the application in parallel view mode on the car machine to improve the user's use experience.

[0087] According to an embodiment of the present application, when the car machine (as an example of a second electronic device) displays the application interface in a small window mode in a super desktop mode (as an example of a preset mode), if the user performs a maximum operation to enter the full screen on the small window interface, the mobile phone can control the car machine to pull up the full screen layout of the parallel view mode, so that the car machine displays two application interfaces of the same application in the form of application internal split screen, and the two application interfaces can be different application interfaces. In this way, the car machine display screen can simultaneously display two application interfaces of the same application, such as simultaneously displaying the home page interface and the music playing interface of the music playing application. This display method can display more information content on the large screen of the car machine, and the display interface is more beautiful, the operation logic is more in line with the user's daily use, and the user's use experience on the car machine is improved.

[0088] According to an embodiment of the present application, since there is no user-operable switch control in the super desktop scene, the mobile phone can determine whether the target application opens the parallel view function according to the pre-configured whitelist, and only control the car machine to pull up the full screen layout of the parallel view mode for the application that opens the parallel view function. Moreover, the applications in the whitelist can be modified according to actual needs, and the applications with higher adaptation degree to the car machine display screen are added to the whitelist, which can ensure the correctness and beauty of the interface displayed in the parallel view mode, avoid the problems of interface display position disorder, application control size is not suitable, etc., so as to further ensure the user's use experience.

[0089] According to an embodiment of the present application, when the car machine displays the home page interface of the target application in the small window mode, if the user performs the operation of maximizing the small window interface to enter the full screen, the mobile phone can control the car machine to pull up the full screen layout of the parallel horizon mode, so that the car machine displays the home page interface in an enlarged size only in part of the display screen, the display area of the display screen for displaying the application interface is increased, the invalid operation area such as black screen or white screen is reduced, the car machine can display more information content, and the application interface is not excessively stretched, and the display effect of the application on the car machine is improved.

[0090] According to an embodiment of the present application, when the car machine displays the home page interface of the target application in the small window mode, if the user performs the operation of maximizing the small window interface to enter the full screen, the mobile phone can control the car machine to pull up the full screen layout of the parallel horizon mode, so that the car machine displays the home page interface in an enlarged size only in part of the display screen, the display area of the display screen for displaying the application interface is increased, the invalid operation area such as black screen or white screen is reduced, the car machine can display more information content, and the application interface is not excessively stretched, and the display effect of the application on the car machine is improved.

[0091] In the above embodiment, the first electronic device and the second electronic device can be a single screen, a folding screen, a curved screen, etc. The folding screen can be a structure with two screens in a physical sense, or a structure with one screen in a physical sense, which is not limited herein. In other embodiments of the present application, the first electronic device and the second electronic device in the embodiments of the present application can also be electronic devices with more than three screens, which is not limited herein. For an electronic device with one screen in a physical sense, it can include a main screen and a sub screen, wherein the main screen can be a first display window of the electronic device, and the sub screen can be a second display window of the electronic device.

[0092] In the above embodiment, the display mode of the second electronic device is split screen display in the vertical screen state of the second electronic device, and in other embodiments of the present application, it can also be split screen display in the horizontal screen state, i.e. split screen display up and down. Exemplarily, in the split screen display of the second electronic device in the vertical screen state, the first display window is on the left side of the display screen, and the second display window is on the right side of the display screen. In the split screen display of the second electronic device in the horizontal screen state, the first display window is above the display screen, and the second display window is below the display screen.

[0093] The embodiments of the present application do not limit the form of the first electronic device and the second electronic device. The first electronic device can be a mobile phone, a tablet, a notebook computer, or the like, which supports a parallel field of view function. The second electronic device can be a smart screen, a vehicle-mounted device (for example, a car machine or a vehicle-mounted navigator), or the like, which has a display screen. Here, the above is not limiting.

[0094] The method of the embodiments of the present application will be described below in combination with the specific structure of the electronic device. Figure 3a The electronic device 300 shown is exemplary of a device as the first electronic device.

[0095] Figure 3a A structure schematic diagram of the electronic device 300 provided by an embodiment of the present application is shown. The electronic device 300 can include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a loudspeaker 370A, a receiver 370B, a microphone 370C, a headset interface 370D, a sensor module 380, a key 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, and the like. The sensor module 380 can include a pressure sensor 380A, a gyroscope sensor 380B, a barometric pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, and the like.

[0096] The processor 310 can include one or more processing units. For example, the processor 310 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU), and the like. Different processing units can be independent devices or integrated into one or more processors. For example, the processor 310 can be used to execute each step of the display method performed by the first electronic device in the embodiments of the present application.

[0097] The processor 310 can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching and executing instructions.

[0098] The processor 310 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory can store instructions or data that have just been used or are used repeatedly by the processor 310. If the processor 310 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 310, thereby improving the efficiency of the system.

[0099] In some embodiments, the processor 310 can obtain a maximization operation request message sent by the car machine in the super desktop mode, and control the car machine to pull up a full-screen layout of the parallel view mode based on the maximization request message, so that the car machine displays two application interfaces of the same application in the form of application intra-split screen display, and the two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be displayed on the car machine display screen at the same time, such as the home page interface and the music playing interface of the music playing application. This display mode can display more information content on the large screen of the car machine, and the display interface is more beautiful, the operation logic is more in line with the daily use of users, and the use experience of users on the car machine is improved.

[0100] In some embodiments, the processor 310 can include one or more interfaces. The interface can include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, and a Subscriber Identity Module (SIM) interface.

[0101] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a limitation on the structure of the electronic device 300. In some other embodiments of the present application, the electronic device 300 can also use different interface connection methods or a combination of multiple interface connection methods in the above embodiments.

[0102] The wireless communication function of the electronic device 300 can be implemented through the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor, and the baseband processor, etc.

[0103] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0104] The mobile communication module 350 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the electronic device 300. The mobile communication module 350 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 350 can also amplify the signals modulated by the modem processor, and convert the signals into electromagnetic waves to be radiated through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 350 can be arranged in the processor 310. In some embodiments, at least part of the functional modules of the mobile communication module 350 and at least part of the modules of the processor 310 can be arranged in the same device.

[0105] The modem processor can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 370A, the microphone 370B, etc.), or displays an image or a video through the display screen 394. In some embodiments, the modem processor can be an independent device. In some other embodiments, the modem processor can be independent of the processor 310, and arranged in the same device as the mobile communication module 350 or other functional modules.

[0106] The wireless communication module 360 can provide a solution for wireless communication, including Wireless Local Area Networks (WLAN) (e.g., Wireless Fidelity (WiFi) network), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR) technology, etc., which are applied to the electronic device 300. The wireless communication module 360 can be one or more devices that integrate at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 310. The wireless communication module 360 can also receive signals to be transmitted from the processor 310, frequency-modulate them, amplify them, and radiate them as electromagnetic waves via the antenna 2.

[0107] In some embodiments, the antenna 1 and the mobile communication module 350 of the electronic device 300 are coupled, and the antenna 2 and the wireless communication module 360 are coupled, so that the electronic device 300 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).

[0108] In some embodiments, the electronic device 300 can establish a connection with a device that is a second electronic device through the antenna 2, and transmit a received message to the processor 310 through the wireless communication module 360.

[0109] The electronic device 300 implements a display function through a GPU, a display screen 394, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 310 can include one or more GPUs, which execute program instructions to generate or change display information.

[0110] The display screen 394 is configured to display images, videos, and the like. The display screen 394 includes a display panel. The display panel can be a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), an Active-Matrix Organic Light Emitting Diode (AMOLED), a Flex Light-Emitting Diode (FLED), a Miniled, a Micro Led, a Micro-oLed, a Quantum Dot Light Emitting Diodes (QLED), or the like. In some embodiments, the electronic device 300 can include one or N display screens 394, where N is a positive integer greater than 1.

[0111] The electronic device 300 can implement a photographing function through an ISP, the camera 393, a video codec, a GPU, the display screen 394, and an application processor, and the like.

[0112] The internal memory 321 can be configured to store computer-executable program codes including instructions. The internal memory 321 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required for at least one function (e.g., a sound play function, an image play function, and the like), and the like. The data storage area can store data (e.g., audio data, a phonebook, and the like) created during the use of the electronic device 300, and the like. In addition, the internal memory 321 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one of a magnetic disk storage device, a flash memory device, a Universal Flash Storage (UFS), and the like. The processor 310 performs various function applications and data processing of the electronic device 300 by executing instructions stored in the internal memory 321 and / or instructions stored in a memory disposed in the processor.

[0113] In some embodiments, the internal memory 321 can store instructions of a display method, and the processor 310 can acquire the maximization operation request message sent by the car machine in the super desktop mode by running the display method instructions, and control the car machine to pull up the full-screen layout of the parallel view mode based on the maximization request message, so that the car machine displays two application interfaces of the same application in the form of application internal split screen display, and the two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be displayed on the car machine display screen at the same time, such as displaying the home page interface and the music playing interface of the music playing application at the same time. This display method can display more information content on the large screen of the car machine, and the display interface is more beautiful, the operation logic is more in line with the daily use of users, and the use experience of users on the car machine is improved.

[0114] The electronic device 300 can realize audio functions through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the earphone interface 370D, and the application processor, etc. For example, music playing, recording, etc.

[0115] The audio module 370 is used to convert digital audio information into analog audio signals, and is also used to convert analog audio input into digital audio signals. The audio module 370 can also be used to encode and decode audio signals. In some embodiments, the audio module 370 can be arranged in the processor 310, or part of the functions of the audio module 370 can be arranged in the processor 310.

[0116] The microphone 370C, also known as a "microphone", "sounder", is used to convert sound signals into electrical signals. When making a call or sending voice information, the user can speak into the microphone 370C by placing the mouth close to the microphone 370C, and input the sound signal into the microphone 370C. The electronic device 300 can be provided with at least one microphone 370C. In other embodiments, the electronic device 300 can be provided with two microphones 370C, in addition to collecting sound signals, it can also realize the noise reduction function. In other embodiments, the electronic device 300 can also be provided with three, four or more microphones 370C, which can realize the functions of collecting sound signals, noise reduction, and identifying sound sources, and realize the function of directional recording, etc.

[0117] The pressure sensor 380A is configured to sense a pressure signal and convert the pressure signal to an electrical signal. In some embodiments, the pressure sensor 380A can be disposed on the display screen 394. The pressure sensor 380A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. A capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 380A, the capacitance between the electrodes changes. The electronic device 300 determines the intensity of the force based on the change in capacitance. When a touch operation is applied to the display screen 394, the electronic device 300 detects the intensity of the touch operation based on the pressure sensor 380A. The electronic device 300 can also calculate the location of the touch based on the detection signal of the pressure sensor 380A. In some embodiments, touch operations applied to the same touch location but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0118] The gyroscope sensor 380B can be configured to determine the motion attitude of the electronic device 300. In some embodiments, the angular velocity of the electronic device 300 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 380B. The gyroscope sensor 380B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 380B detects the angle of shaking of the electronic device 300, calculates the distance that the lens module needs to compensate based on the angle, and lets the lens offset the shaking of the electronic device 300 by moving in the opposite direction, thereby achieving anti-shake. The gyroscope sensor 380B can also be used for navigation and motion sensing game scenarios.

[0119] The touch sensor 380K, also referred to as a "touch device". The touch sensor 380K can be disposed on the display screen 394, and the touch sensor 380K and the display screen 394 together form a touch screen, also referred to as a "touch panel". The touch sensor 380K is configured to detect a touch operation applied thereto or in the vicinity thereof. The touch sensor 380K can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 394. In other embodiments, the touch sensor 380K can also be disposed on the surface of the electronic device 300, which is different from the location of the display screen 394.

[0120] The software system of the electronic device 300 can employ a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. Embodiments of the present application exemplarily illustrate the software structure of the electronic device 300 by taking an Android system with a layered architecture as an example. The type of the operating system of the electronic device is not limited in the present application. For example, the Android system, the Linux system, the Windows system, the iOS system, the Harmony Operating System (Harmony OS), and the like.

[0121] Figure 3b is a software structure block diagram of the electronic device 300 provided by an embodiment of the present application. As shown in Figure 3b , the layered architecture divides the software into several layers, each of which has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer (APP), the application framework layer (APP Framework), the Android runtime (Android Runtime) and the system library (Libraries), and the kernel layer (Kernel).

[0122] The application layer can include a series of application packages.

[0123] As shown in Figure 3b , the application packages can include a gallery, a map, navigation, music, video, games, chat, shopping, smart travel, and the like. Smart travel can be used to connect a car machine to realize the function of a smart cockpit (super desktop). It mainly determines whether the application in the super desktop supports display in the form of a parallel view through the configuration file, and is responsible for the logic of maximizing the application display to a parallel view when the application in the super desktop is maximized. Of course, the application layer can also include other applications in addition to the applications shown in Figure 3b , such as a camera, a calendar, a call, WLAN, Bluetooth, a short message, and the like, which will not be described one by one in the embodiments of the present application.

[0124] The application framework layer provides the application programming interface (API) and programming framework for the application programs of the application layer. The application framework layer includes some pre-defined functions.

[0125] As shown in Figure 3bAs shown, the application framework layer may include a vehicle-mounted central platform, a parallel view service (MagicWindowService) module, an application service (EasyGo service) module, a multi-window framework module, a system service (System Server) module, a package manager service (PMS) module, etc. Of course, the application framework layer may also include other modules, such as an activity manager service (AMS) module, a window manager service (WMS) module, a camera service (CameraService) module, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., which will not be described in detail in this embodiment.

[0126] The vehicle infotainment platform is a customized service for software systems, running within system services. Its main function is to provide the basic framework for realizing connectivity, screen projection, audio streaming, and device virtualization functions in vehicle-to-vehicle communication.

[0127] Please refer to the attached instruction manual. Figure 3c , Figure 3c The diagram illustrates the software structure of each module within the application framework layer. Figure 3c As shown, the vehicle infotainment platform may include: a connection service module, a screen projection service module, an audio streaming module, and a device virtualization module. The connection service module enables communication between the electronic device 300 and the vehicle infotainment system; the screen projection service module enables the electronic device 300 to project its screen onto the vehicle infotainment system; and the audio streaming module enables the transmission of audio data between the electronic device 300 and the vehicle infotainment system.

[0128] The Parallel Vision service module is a customized service for the software system, namely the Parallel Vision service layer. Running within system services, its primary function is to encapsulate a series of strategy interfaces by combining multiple data modules within the service. These interfaces are then embedded into the stubbing process within the native application framework layer, handling the launch, management, and display of Activities. This executes the strategies of the Parallel Vision management service, providing the foundational framework for various applications to implement Parallel Vision functionality. The Parallel Vision service layer can handle the application's display logic on the virtual screen, including application display mode switching, window size and position calculations, and window visibility.

[0129] In this context, stubbing refers to the process of writing or generating stub code to replace associated or unimplemented code. One purpose of stubbing is to configure the behavior of policy-related code in the Parallel Vision Management service during testing, ensuring it meets testing requirements.

[0130] like Figure 3cAs shown, the MagicWindowService module can include a MagicWindowService interface layer, a window policy module, a split screen manager, a drag-and-drop management module, a full screen switching module, and the like. The MagicWindowService interface layer is configured to provide various interfaces of the MagicWindowService. The window policy module is responsible for window display mode and state changes. The window policy module can include a navigation mode (A1An), a shopping mode (AnAn), an EasyGo custom mode, and a single window mode.

[0131] Specifically, the MagicWindowService interface layer can include a MagicWindowManagerEx module, a MagicWindowManagerService module, and a MagicWindowManager module. The MagicWindowManagerEx module is configured to handle the delivery of operation request messages for the MagicWindow UI, including a maximization operation request message, a reduction operation request message, and a content browsing operation request message. The MagicWindowManagerService module is configured to process the messages delivered by the MagicWindowManagerEx module and manage window display mode and state changes. The MagicWindowManager module is configured to implement the logic of a virtual screen and the display logic of the MagicWindow.

[0132] The EasyGo service module is configured to scan easy.json type files in an application to implement application configuration updates. For example, the EasyGo service module can be configured to scan the easy.json file in the application to determine whether the application needs to be updated. If the application needs to be updated, the EasyGo service module can be configured to download the application from a server and install the application on the device. Figure 3c As shown, the EasyGo service module can include an application scanning module, a data parsing module, a data pushing module, an application broadcast module, a basic protocol module, and a database module.

[0133] The System Server module is configured to implement the function of pulling up a service. The PMS module is mainly responsible for application management of the Android system. The PMS module provides installation, uninstallation, optimization, and query services for various Android package (APK) files and can be configured to implement application installation / update / uninstallation functions.

[0134] The multi-window framework module is a base for Android multi-window technology and is configured to manage display windows. As shown, the multi-window framework module can include a task stack management module, a stack boundary control module, a window drag-and-drop module, a window rotation module, a focus switching module, a window size adjustment (Resize) module, a multi-resume display module, a rounded corner display module, and a camera (Camera) correction module. Figure 3c

[0135] ​The AMS module is the most core service in Android, and is mainly responsible for the startup, switching, scheduling of the four components in the system, and the management and scheduling of applications. The WMS module is used to manage window programs, and the WMS module can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and intercept the screen. The CameraService module can be used to implement the function of camera management.

[0136] The content provider is used to store and obtain data, and make the data accessible to applications. The data can include videos, images, audio, dialed and received calls, browsing history and bookmarks, phonebook, etc.

[0137] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0138] The telephony manager is used to provide the communication function of the electronic device 100. For example, the management of the call state (including call connection, call hangup, etc.).

[0139] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0140] The notification manager enables applications to display notification information in the status bar, which can be used to convey messages of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of the download, message reminders, etc. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, such as a notification of an application running in the background, or a notification in the form of a dialog window appearing on the screen. For example, prompting text information in the status bar, issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.

[0141] The Android Runtime includes the core library and the virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system.

[0142] The core library contains two parts: one part is the function function called by the java language, and the other part is the core library of Android.

[0143] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to manage the life cycle of objects, stack management, thread management, security and exception management, and garbage collection, etc.

[0144] The system library can include a plurality of functional modules. For example, a surface manager, media libraries, a three-dimensional (3D) graphics processing library (e.g., OpenGL ES), a two-dimensional (2D) graphics engine (e.g., SGL), etc.

[0145] The surface manager is used to manage the display subsystem and provides fusion of 2D and 3D layers for a plurality of applications.

[0146] The media libraries support a plurality of commonly used audio, video format playback and recording, and static image files, etc. The media libraries can support a plurality of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0147] The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, composition and layer processing, etc.

[0148] The two-dimensional graphics engine is a drawing engine for two-dimensional drawing.

[0149] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0150] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0151] The specific flow of the display method provided by the embodiments of the present application is described in detail below.

[0152] The display method provided by the embodiments of the present application can be applied to a system including a first electronic device and a second electronic device, and the first electronic device and the second electronic device are communicatively connected. The first electronic device and the second electronic device can be electronic devices with a hardware structure as shown in Figure 3a and a software structure as shown in Figure 3b , Figure 3c or more or fewer components than illustrated, or combine certain components, or split certain components, or different component arrangements, and the like.

[0153] The following takes the first electronic device as a mobile phone, the second electronic device as a car machine, and a scenario of maximizing a display interface as an example to describe the display method provided by the embodiments of the present application in detail. A plurality of applications are installed in the mobile phone, some or all of which support a parallel horizon mode (i.e., support an application-in-screen function), and the car machine has a display screen.

[0154] Reference is made to the accompanying drawings Figure 4 , Figure 4 A flowchart of the display method provided by one of the embodiments of the present application is shown, which can include steps S401-S407.

[0155] S401: The mobile phone (as an example of the first electronic device) establishes a communication connection with the car machine (as an example of the second electronic device).

[0156] In the embodiments of the present application, the mobile phone and the car machine can establish a communication connection through a short-range wireless communication mode such as Bluetooth or WiFi. Specifically, the car machine can send a connection request to the mobile phone through Bluetooth or WiFi, and the mobile phone can establish a Bluetooth connection or a WiFi connection with the car machine in response to the connection request. The specific process of establishing a Bluetooth connection or a WiFi connection is not described herein again.

[0157] It should be noted that the above implementation of connecting through Bluetooth or WiFi is only an example, and in some embodiments, other wireless communication modes can also be used to establish a communication connection, or a wired communication mode can also be used to establish a communication connection, which is not limited in the embodiments of the present application.

[0158] In the embodiments of the present application, when the mobile phone and the car machine establish a communication connection, it can be determined whether the mobile phone supports a parallel horizon function first, and in the case that the mobile phone supports the parallel horizon function, a virtual container (MagicVirtualContainer) can be created based on a pre-configured application configuration file, and some parameters required for starting a subsequent application in a parallel horizon are initialized in the constructor of the virtual container.

[0159] Specifically, reference is made to the accompanying drawings Figure 5 , Figure 5 A flowchart of creating and releasing a virtual container provided by one of the embodiments of the present application is shown. As shown in FIG. 4, the method can include steps S401-S407. Figure 5As shown, when the mobile phone and the vehicle machine establish a communication connection in step S501, the intelligent travel module in the mobile phone application layer can determine whether the current mobile phone supports the parallel view function. Specifically, the intelligent travel module can read the pre-stored configuration item about whether the mobile phone supports the parallel view function, and determine whether the current mobile phone supports the parallel view function according to the data of the read configuration item. For example, it is assumed that the configuration item 1 indicates that the mobile phone supports the parallel view function, and it is assumed that the configuration item 0 indicates that the mobile phone does not support the parallel view function. Then, when the intelligent travel module reads the configuration item 1, it can be determined that the mobile phone supports the parallel view function; when the intelligent travel module reads the configuration item 0, it can be determined that the mobile phone does not support the parallel view function.

[0160] Specifically, if the parallel view function is supported, the intelligent travel module can call the parallel view service layer through the notifyMagicWindow() interface in step S502 to notify the parallel view service layer that the current connection state is connected. After receiving the interface call, the parallel view message management module in the parallel view service layer can send the current connection state to the parallel view management service module in step S503 by calling the handleMsgConnState() interface to process the current connection state sent by the intelligent travel module. In step S504, the parallel view management service module can save the record of the current connection state. The notifyMagicWindow() interface has a corresponding return value, and the type of the return value is boolean. The return value true represents that the parallel view service layer informs the intelligent travel module that the connection state is received successfully, and the return value false represents failure.

[0161] Since there is no user-operable switch control in the super desktop scene, in the embodiment of the application, whether the application opens the parallel view function can be controlled by the application white list. When the return value of the notifyMagicWindow() interface is true, the intelligent travel module can send the application configuration file of opening the parallel view function to the parallel view service layer by calling the sendConfigFiles() interface in step S505. The parallel view service layer can perform corresponding initialization operation according to the received application configuration file. The application configuration file is a pre-configured application white list, and each application in the white list opens the parallel view function. Each application not in the white list is regarded as not supporting the parallel view function. The application configuration file can be modified according to actual needs, for example, the application can be pulled into and out of the white list according to the degree of adaptation of the application to the vehicle machine display screen.

[0162] Specifically, after receiving the interface call, the Parallel Vision message management module can, in step S506, call the handleConfigFiles() interface to send the application configuration file to the Parallel Vision management service module for processing the application configuration file sent by the smart mobility module. For example, in step S507, the Parallel Vision management service module can send an initialization request to the Parallel Vision management module so that the Parallel Vision management module can create a corresponding virtual container (MagicVirtualContainer) based on the application configuration file. In the constructor of the virtual container, some parameters required for subsequent application startup with Parallel Vision will be initialized accordingly.

[0163] In one possible embodiment, such as Figure 5 As shown, when it is determined in step S508 that the communication connection between the mobile phone and the vehicle system is disconnected, the smart mobility module located in the mobile application layer can call the parallel vision service layer through the notifyMagicWindow() interface in step S509 to notify the parallel vision service layer that the current connection status is disconnected. After receiving the interface call, the parallel vision message management module in the parallel vision service layer can send the current connection status to the parallel vision management service module by calling the handleMsgConnState() interface in step S510 to process the current connection status sent by the smart mobility module. In step S511, the parallel vision management service module can send a release request to the parallel vision management module to make the parallel vision management module release the corresponding virtual container.

[0164] The process of creating and releasing virtual containers has been described in detail above. Now, let's return to step S402 to continue explaining the display method provided in the embodiments of this application.

[0165] S402: The vehicle system starts the super desktop mode (as an example of the preset mode). In the super desktop mode, the music application window interface is displayed (as an example of the first interface). The music application window interface includes a small window display window (as an example of the first display window). The small window display window is used to display the music playback interface of the "Music" application (as an example of the target application) (as an example of the first application interface).

[0166] In the embodiments of the present application, the interface size of the music application small window interface can be smaller than the size of the car machine display screen, that is, the first interface is small window display. The music application small window interface can include a small window display window, and the size of the small window display window can be the same as the size of the music application small window interface, that is, the small window display window fills the entire area of the music application small window interface. The size of the small window display window can also be smaller than the size of the music application small window interface, that is, the small window display window only occupies part of the area of the music application small window interface. The small window display window can be used to display the music playing interface of the "music" application.

[0167] In the embodiments of the present application, the first application interface can be a non-home page interface of the target application, for example, a detail interface corresponding to the home page of the target application. Alternatively, the first application interface can also be a home page interface of the target application. The target application can be any application installed in the mobile phone that supports the parallel view function, for example, a video playing application (such as "Tik Tok"), a news information application (such as "Today's Headlines"), and a music playing application (such as "Music") and the like third-party application.

[0168] It should be noted that in the embodiments of the present application, the "music" application is taken as an example of the target application, and the playing interface of a specific music, for example, the interface displaying the record cover or the lyrics, and the operation button, is taken as an example of the first application interface, but the present application is not limited thereto. In some embodiments, the first application interface can also be a music search interface, or can be a home page interface of the "music" application, and the like.

[0169] In the embodiments of the present application, after the car machine and the mobile phone establish a communication connection, the "Settings>Super Terminal>Super Desktop" can be entered on the mobile phone to turn on the switch of the super desktop. The mobile phone is close to the car machine, and the "All Applications>Super Desktop" is entered on the car machine. The super desktop automatically discovers the connectable mobile phone, and the connectable mobile phone is clicked to connect. After the connection is successful, the car machine starts the super desktop, and when the user clicks the "music" application icon in the super desktop, the car machine can open the "music" application in the small window mode and display the home page interface of the "music" application through the virtual screen. When the user performs the operation of browsing the information in the home page interface, for example, clicking to play a certain music, the car machine can display the corresponding music playing interface.

[0170] In actual application, after the car machine and the mobile phone establish a communication connection, the mobile phone can use the heterogeneous screen projection technology to realize screen projection to the car machine, so that the "music" application can be started on the virtual screen of the car machine in the small window mode. Specifically, the car machine can obtain the starting operation of the "music" application of the user in the super desktop mode, and send an application starting message of the "music" application to the mobile phone in response to the starting operation. The mobile phone obtains the application starting message sent by the car machine, and in response to the application starting message, can create a virtual screen corresponding to the "music" application, and generate a music application small window interface of the "music" application homepage interface of the virtual screen based on the screen size of the virtual screen. The mobile phone can output the control data (as an example of the fifth control data) of the music application small window interface to the car machine, which can be used to control the car machine to display the homepage interface of the "music" application on the display screen.

[0171] Specifically, the car machine can also obtain the operation of the user playing a certain music, and send a music playing operation message of the "music" application to the mobile phone in response to the operation. The mobile phone obtains the music playing operation message sent by the car machine, and in response to the music playing operation message, can generate a music application small window interface of the "music" application music playing interface of the virtual screen based on the screen size of the virtual screen of the "music" application. The mobile phone can output the control data (as an example of the fifth control data) of the music application small window interface to the car machine, which can be used to control the car machine to display the music playing interface of the "music" application on the display screen.

[0172] Exemplarily, Figure 6a A schematic diagram of starting an application in a small window mode provided by an embodiment of the present application is shown. As shown in Figure 6a The super desktop 600 of the car machine can display the application icons of each application installed in the mobile phone. When the user clicks the "music" application icon 601 in the super desktop 600, the car machine can open the "music" application and display the homepage interface 610 of the "music" application in response to the click operation of the user on the application icon 601. The homepage interface 610 can include a play control 602 for playing music, and when the user clicks the play control 602, the car machine can display the music playing interface 620 of the "music" application in response to the click operation of the user on the play control 602.

[0173] In one possible embodiment, after the car machine starts the super desktop, when the user clicks the "music" application icon in the super desktop, the car machine can also directly open the "music" application in the small window mode and display the music playing interface of the "music" application through the virtual screen. The music playing interface can be, for example, the playing interface of the music being played when the user last closed the "music" application, and the like, which is not limited in the embodiment of the present application.

[0174] Specifically, in Super Desktop mode, the vehicle's infotainment system can receive the user's launch operation for the "Music" application and, in response, send an application launch message for the "Music" application to the mobile phone. The mobile phone receives the application launch message from the vehicle's infotainment system and, in response, can create a virtual screen corresponding to the "Music" application. Based on the screen size of the virtual screen, it directly generates a small window interface for displaying the music playback interface of the "Music" application on the virtual screen. The mobile phone can output control data for this music application window interface to the vehicle's infotainment system (as an example of the fifth control data). This control data can be used to control the vehicle's infotainment system to display the music playback interface of the "Music" application on the screen.

[0175] In this embodiment of the application, when the mobile phone receives the application launch message for the "Music" application sent by the vehicle system in the super desktop mode, it can first create a virtual screen corresponding to the "Music" application, and then realize the projection of the virtual screen to the vehicle system, so that the display screen of the vehicle system can display the content on the virtual screen, while the display screen of the mobile phone does not display the content on the virtual screen.

[0176] Specifically, refer to the appendix of the instruction manual. Figure 7 , Figure 7 A flowchart illustrating the creation and deletion of a virtual screen according to an embodiment of this application is shown. Figure 7 As shown, when creating the virtual screen corresponding to the "Music" application, in step S701, the smart travel module located in the mobile application layer can call the Parallel Vision service layer through the updateAppMagicWinStatusIn MultiDevice(intreason,int targetDisplayId,int targetWidth,int targetHeight) interface to notify the Parallel Vision service layer of the identifier (DisplayId) and screen size information of the virtual screen corresponding to the "Music" application. Here, reason indicates the operation that the "Music" application needs to perform next (e.g., entering or exiting full-screen mode), targetDisplayId indicates which virtual screen the "Music" application needs to launch on, and targetWidth and targetHeight represent the specific screen size of the virtual screen (including width and height parameters).

[0177] After the parallel view message management module in the parallel view service layer receives the interface call, the virtual screen information (including the identifier and screen size information of the virtual screen) in the calling parameters of the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface can be sent to the parallel view management service module in step S702. The virtual container (MagicVirtualContainer) created by the parallel view management module can be initialized according to the virtual screen information, and generate the home page interface or the music playing interface of the "music" application displayed on the virtual screen based on the screen size of the virtual screen. It should be noted that the screen size of the virtual screen supported in the embodiments of the present application satisfies that the height is greater than the width in the single window mode of the parallel view mode.

[0178] Specifically, in step S703, the virtual container can obtain the identifier (attachDisplayId) of the virtual screen. In step S704, the virtual container can update the metrics (updateDisplayMetrics) of the virtual screen according to the screen size information of the virtual screen. In step S705, the virtual container can register an event listener (registerEventListener) to listen to the creation of the virtual screen event, and in step S706, generate the interface of the home page interface of the "music" application or the interface of the music playing interface of the "music" application displayed on the virtual screen by calling the interface generation function createMwUi(targetDisplayId, container).

[0179] In one possible embodiment, when the user closes the "music" application, the car machine can send an application closing message to the mobile phone in response to the user's closing operation of the "music" application. After the mobile phone receives the application closing message sent by the car machine, the "music" application can be closed and the virtual screen corresponding to the "music" application can be deleted. As shown in FIG. 8, when the user closes the "music" application, the car machine can send an application closing message to the mobile phone in step S801. After the mobile phone receives the application closing message sent by the car machine, the "music" application can be closed and the virtual screen corresponding to the "music" application can be deleted in step S802. Figure 7As shown, in deleting the virtual screen corresponding to the "music" application, in step S707, the intelligent travel module located in the mobile application layer can call the interface updateAppMagicWinStatusIn MultiDevice(int reason, int targetDisplayId) to the parallel visual service layer to notify the parallel visual service layer of the identifier of the virtual screen corresponding to the "music" application. After receiving the interface call, the parallel visual message management module in the parallel visual service layer can issue the identifier of the virtual screen in the calling parameters of the interface updateAppMagicWinStatusIn MultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) to the parallel visual management service module in step S708. The virtual container created by the parallel visual management module can delete the corresponding virtual screen according to the identifier of the virtual screen.

[0180] Specifically, in step S709, the virtual container can adjust the camera in the mobile phone to a state without the influence of the parallel visual by calling the function updateCameraRotation(-1). In step S710, the virtual container can delete the virtual screen corresponding to the "music" application by calling the function setVirtualDisplayId(INVALID_DISPLAY).

[0181] The above details the process of creating and deleting a virtual screen. The following returns to step S403 to continue to describe the display method provided in the application embodiment.

[0182] S403: The car machine acquires a maximization operation (as an example of a first operation) on the music application small window interface, and sends a maximization operation request message (as an example of a first operation request message) to the mobile phone in response to the maximization operation.

[0183] In the application embodiment, when the user performs a maximization operation on the music application small window interface, the car machine can generate a maximization operation request message in response to the maximization operation and send it to the mobile phone. The maximization operation can be used to maximize the music application small window interface and make it enter a full-screen state. The maximization operation on the music application small window interface can be a sliding, clicking or dragging operation of the user's finger on the music application small window interface, or a sliding, clicking or dragging operation of the user's finger on the maximization operation control in the music application small window interface. The finger can be a single finger or multiple fingers, which is not limited here.

[0184] Specifically, the car machine can be integrated with a car machine out terminal module. When the car machine is connected to the mobile phone and is in the super desktop mode, the user starts the "music" application and clicks the maximize operation control, the car machine out terminal module can send a maximize operation request message to the smart travel module in the mobile phone to inform the user's operation, and then pull up the application full screen through the smart travel module.

[0185] S404: The mobile phone obtains the maximize operation request message sent by the car machine.

[0186] In the embodiment of the application, the mobile phone and the car machine can realize data interaction through a pre-established communication connection. For example, the car machine can send a maximize operation request message to the mobile phone through a Bluetooth connection or a WiFi connection. Specifically, the car machine can send a maximize operation request message to the smart travel module in the mobile phone through a Bluetooth connection or a WiFi connection, and the smart travel module can receive the maximize operation request message sent by the car machine.

[0187] S405: The mobile phone determines the screen size of the virtual screen corresponding to the "music" application in response to the maximize operation request message.

[0188] In the embodiment of the application, the car machine realizes parallel view display, which is different from the mobile phone supporting parallel view. The super desktop is a virtual screen scenario. When the super desktop starts an application, the mobile phone and the car machine are in a heterogeneous screen projection scenario. At this time, the mobile phone uses a heterogeneous screen projection technology to realize screen projection to the car machine, so as to display the music application window interface to the virtual screen of the car machine. Therefore, after the mobile phone obtains the maximize operation request message, the mobile phone can first determine the screen size of the car machine, and take the screen size of the car machine as the screen size of the virtual screen corresponding to the "music" application after maximization. The screen size of the car machine can be obtained from the car machine side, for example, the car machine can carry the screen size of the car machine in the maximize operation request message sent by the car machine. The screen size of the car machine can also be saved in a database in advance. After the mobile phone obtains the maximize operation request message, the mobile phone can directly obtain the screen size of the car machine from the database. The embodiment of the application does not make specific limitation on this.

[0189] In the embodiment of the application, after the smart travel module receives the maximize operation request message sent by the car machine, the smart travel module can first call the resizeDisplay() interface to call the screen projection service module. The screen projection service module can perform size adjustment (Resize) processing on the virtual screen corresponding to the "music" application according to the received screen size (including width and height parameters). After the size adjustment is successful, the window is displayed as full screen size.

[0190] S406: The mobile phone starts the parallel visual field mode, and generates a music application split-screen interface (as an example of the second interface) of the virtual screen based on the screen size of the virtual screen in the parallel visual field mode. The music application split-screen interface can include a left display window (as an example of the second display window) and a right display window (as an example of the third display window) displayed in split screen, and the left display window and the right display window are respectively used to display a music playing interface and a home page interface (as an example of the second application interface) of the "music" application.

[0191] In the embodiments of the present application, the interface size of the music application split-screen interface can be the same as the size of the display screen of the car machine, that is, the second interface is full-screen display. The sizes of the left display window and the right display window of the music application split-screen interface can be the same or different. The left display window and the right display window can be split up and down or split left and right. In the embodiments of the present application, the left and right split is taken as an example for description. The left display window and the right display window can occupy all or part of the area of the music application split-screen interface. The position and size of the left display window and the right display window are not specifically limited in the embodiments of the present application. Preferably, the height of the single window in the parallel visual field in the present application can be greater than the width, that is, the height of the left display window and the right display window is greater than the width.

[0192] It should be noted that the above embodiment of taking the home page interface as the second application interface is only an example. In some embodiments, the second application interface can also be other interfaces of the "music" application. The second application interface can be the same as or different from the first application interface, and the embodiments of the present application do not specifically limit this. For example, the second application interface can also be the same interface as the first application interface, that is, the music playing interface of the "music" application, or can also be a music search interface, etc.

[0193] In an embodiment of the present application, after the screen size of the virtual screen is adjusted by the screen projection service module, the intelligent travel module can call the parallel visual service layer through the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface to notify the parallel visual service layer of the identifier (DisplayId) of the virtual screen corresponding to the "music" application and the adjusted screen size information. After receiving the interface call, the parallel visual message management module in the parallel visual service layer can distribute the virtual screen information (including the identifier of the virtual screen and the adjusted screen size information) in the call parameters to the parallel visual management service module. The virtual container created by the parallel visual management module can start the parallel visual mode according to the virtual screen information, and generate the virtual screen while displaying the music application split screen interface of the music playing interface and the home page interface of the "music" application in the parallel visual mode based on the adjusted screen size of the virtual screen. Specifically, the virtual container can generate the music application split screen interface by calling the interface generation function createMwUi(targetDisplayId, container) when it listens to the display interface of the generated virtual screen.

[0194] In actual application, in the virtual screen scenario, the application framework layer of the mobile phone will newly create a separate task (Task) for this scenario. Among them, a layer of root task (RootTask) is used to identify the vehicle scene (the vehicle scene is a virtual screen scenario, which is different from the physical screen scenario of the mobile phone) for customized processing, including window display level, window visibility, window display mode and the like. A layer of Task of the application itself is used to implement the management of activities (activity).

[0195] Exemplarily, Figure 6b A schematic diagram of switching from the small window mode to the parallel visual mode is shown. As shown in Figure 6b The small window display window of the music application small window interface in the super desktop 600 displays the music playing interface 620 of the "music" application. The music application small window interface can also include a maximize operation control 603. When the user clicks the maximize operation control 603, the vehicle machine can generate and send a maximize operation request message to the mobile phone in response to the click operation of the user on the maximize operation control 603. The mobile phone can determine the screen size of the virtual screen corresponding to the "music" application and start the parallel visual mode in response to the maximize operation request message, and generate the music application split screen interface of the virtual screen based on the screen size of the virtual screen in the parallel visual mode. The left display window of the music application split screen interface displays the home page interface 610 of the "music" application, and the right display window displays the music playing interface 620 of the "music" application.

[0196] In a possible implementation, the phone starts the parallel view mode, and generating the music application split-screen interface of the virtual screen in the parallel view mode based on the screen size of the virtual screen can include: the phone determining whether the "music" application starts the parallel view function; if the "music" application starts the parallel view function, the phone starts the parallel view mode, and generates the music application split-screen interface of the virtual screen in the parallel view mode based on the screen size of the virtual screen.

[0197] In the embodiments of the present application, only part of the applications in the phone support the parallel view mode display, and only part of the applications can be well adapted to the car machine parallel view mode display. Therefore, before starting the parallel view mode, the phone can first determine whether the "music" application starts the parallel view function. In the case of starting, the step S405 of starting the parallel view mode and generating the music application split-screen interface of the virtual screen is executed; in the case of not starting, the music playing interface of the "music" application is displayed in the ordinary full-screen mode. In the ordinary full-screen mode, the display window of the music playing interface fills the entire area of the super desktop, but the display position and size of the content part in the music playing interface do not change, or the content part in the music playing interface is also stretched to fill the entire area of the super desktop.

[0198] Exemplarily, Figure 6c A schematic diagram of switching from the small window mode to the ordinary full-screen mode is shown, which is provided by an embodiment of the present application. As shown in Figure 6c As shown, after the user starts the "video" application in the super desktop 600, the application in the small window can be replaced, at this time, the small window display window of the video application small window interface (as another example of the first interface) in the super desktop 600 can display the video playing interface 630 of the "video" application, and the video application small window interface can also include the maximize operation control 604. When the user clicks the maximize operation control 604, the car machine can generate and send a maximize operation request message to the phone in response to the click operation of the user on the maximize operation control 604. The phone can determine the screen size of the virtual screen corresponding to the "video" application in response to the maximize operation request message. The phone can also determine that the "video" application does not start the parallel view function, and therefore the phone displays the video playing interface 630 of the "video" application in the ordinary full-screen mode. In the ordinary full-screen mode, the display window of the video playing interface 630 fills the entire area of the super desktop 600, but the display position and size of the video content in the video playing interface 630 do not change.

[0199] Specifically, the phone determining whether the "music" application opens the parallel view function can include: the phone judging whether the "music" application is recorded in the pre-configured whitelist; if yes, determining that the "music" application opens the parallel view function; if not, determining that the "music" application does not open the parallel view function.

[0200] In the embodiments of the present application, the application in the whitelist can be supported to display in the parallel view mode when performing the maximum operation to enter the application full screen by pre-configuring the whitelist. The whitelist can be modified according to actual needs, for example, the application can be pulled into and out of the whitelist according to the adaptation degree of the application to the car machine display screen. The detailed content of the whitelist is not described herein.

[0201] It should be noted that the music playing interface is taken as an example of the first application interface for description in the embodiments of the present application, but in actual application, the first application interface can also be other interfaces of the "music" application.

[0202] In one possible embodiment, since some applications cannot directly enter the parallel view mode and display two application interfaces from the home page interface when the user performs the maximum operation to enter the full screen. Therefore, for this type of application, the in-application split screen display is only performed when the first application interface is a non-home page interface of the application; and the split screen display is not performed when the first application interface is a home page interface of the application. The embodiments of the present application are described below by assuming that the "music" application is this type of application that cannot directly enter the parallel view mode and display two application interfaces from the home page interface.

[0203] Specifically, if the "music" application opens the parallel view function, the phone starts the parallel view mode and generates a music application split screen interface of the virtual screen based on the screen size of the virtual screen in the parallel view mode, which can include: if the "music" application opens the parallel view function, the phone determines whether the first application interface is a non-home page interface of the "music" application; if the first application interface is a non-home page interface of the "music" application, the phone starts the parallel view mode and generates a music application split screen interface of the virtual screen based on the screen size of the virtual screen in the parallel view mode. Moreover, the first application interface and the second application interface displayed in the music application split screen interface are different application interfaces. For example, the first application interface can be a non-home page interface of the "music" application, and the second application interface can be a home page interface of the "music" application. Specifically, the case that the first application interface is a home page interface of the "music" application will be described in detail later.

[0204] S407: The phone outputs the control data of the music application split screen interface (as an example of the first control data) to the car machine, and the control data of the music application split screen interface is used to control the car machine to display the music application split screen interface on the display screen.

[0205] In the embodiment of the present application, the mobile phone can use the heterogeneous screen projection technology to realize screen projection to the car machine. In the screen projection process, the control data of the music application split screen interface can be output to the car machine to project the music application split screen interface of the virtual screen to the display screen of the car machine for display. The detailed process of screen projection to the car machine is not described herein.

[0206] The case that the first application interface is the home page interface of the "music" application is described in detail below.

[0207] Reference is made to the accompanying drawings Figure 8 , Figure 8 A flowchart of a display method provided by another embodiment of the present application is shown, which can include steps S801-S807.

[0208] S801: The mobile phone (as an example of the first electronic device) establishes a communication connection with the car machine (as an example of the second electronic device).

[0209] S802: The car machine starts the super desktop mode (as an example of the preset mode), and displays the music application window interface (as an example of the first interface) in the super desktop mode. The music application window interface includes a window display window (as an example of the first display window), which is used to display the home page interface (as an example of the first application interface) of the "music" application (as an example of the target application).

[0210] In the embodiment of the present application, the window display window of the music application window interface can be used to display the home page interface of the "music" application, i.e., the first application interface is the home page interface of the target application.

[0211] In the embodiment of the present application, after the car machine is successfully connected with the mobile phone, the car machine starts the super desktop. When the user clicks the "music" application icon in the super desktop, the car machine can open the "music" application in the window mode and display the home page interface of the "music" application by the virtual screen.

[0212] In actual application, after the car machine and the mobile phone establish a communication connection, the mobile phone can use the heterogeneous screen projection technology to realize screen projection to the car machine, so that the "music" application can be started in a small window mode to the virtual screen of the car machine. Specifically, the car machine can obtain the start operation of the "music" application in the super desktop mode, and send an application start message of the "music" application to the mobile phone in response to the start operation. The mobile phone obtains the application start message sent by the car machine, and in response to the application start message, can create a virtual screen corresponding to the "music" application, and generate a music application small window interface of the "music" application based on the screen size of the virtual screen. The mobile phone can output the control data (as an example of the fifth control data) of the music application small window interface to the car machine, which can be used to control the car machine to display the home page interface of the "music" application on the display screen.

[0213] S803: The car machine obtains a maximization operation (as an example of the first operation) for the music application small window interface, and sends a maximization operation request message (as an example of the first operation request message) to the mobile phone in response to the maximization operation.

[0214] S804: The mobile phone obtains the maximization operation request message sent by the car machine.

[0215] S805: The mobile phone determines the screen size of the virtual screen corresponding to the "music" application in response to the maximization operation request message.

[0216] S806: The mobile phone starts the parallel view mode, and generates a music application large window interface (as an example of the third interface) of the virtual screen based on the screen size of the virtual screen in the parallel view mode. The music application large window interface can include a large window display window (as an example of the fourth display window), and the size of the large window display window is larger than that of the small window display window in the music application small window interface. The large window display window is used to display the home page interface of the "music" application with an enlarged size.

[0217] In the embodiment of the application, when the first application interface is the home page interface of the "music" application, starting the parallel view mode by the mobile phone will not perform split screen display, but only enlarge the display size of the home page interface.

[0218] Specifically, in the case that the first application interface is the homepage interface of the "music" application, after the phone starts the parallel visual field mode, the phone can generate the music application large window interface based on the screen size of the virtual screen in the parallel visual field mode. The interface size of the music application large window interface can be the same as the size of the display screen of the car machine, that is, the third interface is full screen display. The music application large window interface can include a large window display window, and the large window display window can be located in only a part of the music application large window interface, and is preferably located in the middle region of the music application large window interface. The application embodiments do not specifically limit the position and size of the large window display window in the music application large window interface. Preferably, the height of the single window in the parallel visual field in the application can be greater than the width, that is, the height of the large window display window is greater than the width. The area of the music application large window interface except the large window display window can be displayed as blank.

[0219] In one possible embodiment, before starting the parallel visual field mode, the phone can first determine whether the "music" application opens the parallel visual field function. In the case of determining to open the parallel visual field function, it can be determined whether the first application interface is the homepage interface of the "music" application. If the first application interface is the homepage interface of the "music" application, the phone starts the parallel visual field mode and generates the music application large window interface of the virtual screen based on the screen size of the virtual screen in the parallel visual field mode.

[0220] It should be noted that the specific generation method of the third interface is similar to the generation method of the second interface, and the specific content provided by the embodiments shown in Figures 4 to 7 will not be repeated here.

[0221] Exemplarily, Figure 9a Fig. 6 shows a schematic diagram of switching from the small window mode to the parallel visual field mode provided by another embodiment of the application. As shown in Figure 9a Fig. 6, the small window display window of the music application small window interface in the super desktop 900 displays the homepage interface 910 of the "music" application, and the music application small window interface can further include a maximize operation control 901. When the user clicks the maximize operation control 901, the car machine can generate and send a maximize operation request message to the phone in response to the clicking operation of the user on the maximize operation control 901. The phone can determine the screen size of the virtual screen corresponding to the "music" application and start the parallel visual field mode in response to the maximize operation request message, and generate the music application large window interface of the virtual screen based on the screen size of the virtual screen in the parallel visual field mode. The large window display window of the music application large window interface only occupies the middle part of the music application large window interface, and displays the homepage interface 910 of the "music" application in an enlarged size.

[0222] S807: The mobile phone outputs control data (as an example of the second control data) of the music application large window interface to the vehicle machine, and the control data of the music application large window interface is used to control the vehicle machine to display the music application large window interface on the display screen.

[0223] In one possible embodiment, the reference is made to the description of the accompanying drawings Figure 10 The method can further include steps S808-S810.

[0224] S808: The mobile phone acquires a music search operation (as an example of the second operation) based on the home page interface.

[0225] In the embodiments of the present application, the second operation can be an operation for browsing the content in the home page interface of the "music" application, for example, can be a search operation for searching the content in the home page interface of the "music" application, or can be a review operation for reviewing the display content in the home page interface of the "music" application, etc., and the type of the operation is not specifically limited in the embodiments of the present application. The embodiments of the present application take the second operation as the music search operation as an example for description, but the present application is not limited thereto, and in some embodiments, the second operation can also be a music playing operation, etc.

[0226] In the embodiments of the present application, when the user performs the music search operation for searching the content in the home page interface of the "music" application, for example, the user performs a click operation on the music search control in the home page interface of the "music" application, the vehicle machine can send the position information of the click operation to the mobile phone, and the mobile phone can determine the corresponding position information in the virtual screen corresponding to the "music" application according to the position information of the click operation, and then determine that the user performs the music search operation for searching the content in the home page interface of the "music" application. Wherein, the music search operation can be used to search the interested music in the home page interface of the "music" application.

[0227] It should be noted that the above-mentioned way of searching the content by performing the click operation on the music search control is only an example, and the present application does not specifically limit it, and in some possible embodiments, the music search operation for searching the content in the home page interface of the "music" application can also be the sliding, clicking or dragging operation of the user's finger on the home page interface of the "music" application, or can be the sliding or dragging operation of the user's finger on the music search control in the home page interface of the "music" application, and the finger can be a single finger or multiple fingers, which is not limited herein.

[0228] In one possible embodiment, the mobile phone can also acquire the voice of the user for searching the content in the home page interface of the "music" application, analyze the voice, and thus determine that the user performs the music search operation for searching the content in the home page interface of the "music" application.

[0229] S809: The phone generates a music application split-screen interface of the virtual screen (as an example of the fourth interface) based on the screen size of the virtual screen in the parallel visual field mode in response to the music search operation. The music application split-screen interface can include a left display window (as an example of the fifth display window) and a right display window (as an example of the sixth display window) displayed in split screen. The left display window and the right display window are respectively used to display a music search interface (as an example of the third application interface) and a home page interface of the "music" application.

[0230] It should be noted that the interface size of the music application split-screen interface can be the same as the size of the display screen of the car machine, that is, the fourth interface is full-screen display. The size of the left display window and the right display window of the music application split-screen interface can be the same or different. The left display window and the right display window can be split up and down or split left and right. In the embodiments of the present application, the left and right split is taken as an example for description. The left display window and the right display window can occupy all or part of the area of the music application split-screen interface. The position and size of the left display window and the right display window are not specifically limited in the embodiments of the present application. Preferably, the height of the single window in the parallel visual field in the present application can be greater than the width, that is, the height of the left display window and the right display window is greater than the width.

[0231] In the embodiments of the present application, the third application interface can be a result interface corresponding to the second operation. In the case where the second operation is a search operation of searching content in the home page interface of the "music" application, the third application interface can be a music search interface of the "music" application.

[0232] It should be noted that the above embodiment of taking the music search interface as the third application interface is only an example. In some embodiments, the third application interface can also be other interfaces of the "music" application according to different user operations, which is not specifically limited in the embodiments of the present application. For example, in the case where the second operation is a review operation of reviewing the displayed content in the home page interface of the "music" application, the third application interface can be a content detail interface of the "music" application. For example, when the user performs a review operation on a certain music ranking in the home page interface of the "music" application, the third application interface can be a list detail interface of the "music" application. In the case where the second operation is a play operation of playing music in the home page interface of the "music" application, the third application interface can be a music playing interface of the "music" application.

[0233] Specifically, after the phone obtains the music search operation based on the home page interface, since the display interface has been maximized, it is not necessary to adjust the screen size of the virtual screen, but the music application split-screen interface of the virtual screen can be directly generated based on the screen size of the virtual screen.

[0234] It should be noted that the specific generation method of the fourth interface is similar to the generation method of the second interface, and the specific content can be referred to Figures 4 to 7 The specific content provided by the embodiment shown in the embodiment is not described here.

[0235] Exemplarily, Figure 9b A schematic diagram of a user performing a music search operation process provided by an embodiment of the present application is shown. As shown in Figure 9b As shown, the large window display window of the music application large window interface in the super desktop displays the home page interface 910 of the "music" application after the size is enlarged. The music application large window interface can also include a music search control 902. When the user clicks the music search control 902, the car machine can send the position information of the user's click to the mobile phone, and the mobile phone can determine the corresponding position information in the virtual screen corresponding to the "music" application according to the position information, and then determine that the user performs the click operation on the music search control 902, that is, the mobile phone can obtain the music search operation performed by the user. The mobile phone can generate a music application split screen interface of the virtual screen based on the screen size of the virtual screen in the parallel visual field mode in response to the music search operation performed by the user. The left display window of the music application split screen interface displays the home page interface 910 of the "music" application, and the right display window displays the music search interface 920 of the "music" application.

[0236] S810: The mobile phone outputs the control data (as an example of the third control data) of the music application split screen interface to the car machine, and the control data of the music application split screen interface is used to control the car machine to display the music application split screen interface on the display screen.

[0237] It should be noted that the specific content in steps S801 to S807 and steps S808 to S810 in the embodiment of the present application can refer to the related content in steps S401 to S407 in the embodiment shown in Figure 4 The specific content in steps S401 to S407 in the embodiment shown in the embodiment of the present application is not described here.

[0238] The display method provided by the embodiment of the present application will be described in detail below taking the scenario of the reduced display interface as an example.

[0239] Reference is made to the drawings in the specification Figure 11 , Figure 11 A flowchart of a display method provided by another embodiment of the present application is shown, which can include steps S1101-S1107.

[0240] S1101: The mobile phone (as an example of the first electronic device) and the car machine (as an example of the second electronic device) establish a communication connection.

[0241] S1102: The car machine starts the super desktop mode (as an example of a preset mode), and displays a music application split-screen interface (as an example of a second interface or a fourth interface) in the super desktop mode.

[0242] S1103: The car machine acquires a zoom-out operation (as an example of a third operation) for the music application split-screen interface, and sends a zoom-out operation request message (as an example of a third operation request message) to the mobile phone in response to the zoom-out operation.

[0243] In the embodiments of the present application, when the user performs a zoom-out operation for the music application split-screen interface, the car machine can generate a zoom-out operation request message in response to the zoom-out operation and send it to the mobile phone. The zoom-out operation can be used to zoom out the music application split-screen interface and exit the full-screen state. The zoom-out operation for the music application split-screen interface can be a sliding, clicking, or dragging operation of the user's finger on the music application split-screen interface, or a sliding, clicking, or dragging operation of the user's finger on a zoom-out operation control in the music application split-screen interface. The finger can be a single finger or multiple fingers, which is not limited herein.

[0244] Specifically, when the car machine is connected to the mobile phone and is in the super desktop mode, the user clicks a zoom-out operation control in the interface displayed in the parallel view mode, the car machine out-end module in the car machine can send a zoom-out operation request message to the smart travel module in the mobile phone to inform the user's operation, and then exit the application full screen through the smart travel module.

[0245] S1104: The mobile phone acquires the zoom-out operation request message sent by the car machine.

[0246] S1105: The mobile phone adjusts the screen size of the virtual screen corresponding to the "music" application in response to the zoom-out operation request message.

[0247] In the embodiments of the present application, after the mobile phone acquires the zoom-out operation request message, it can first adjust the screen size of the virtual screen to a preset size as the screen size of the zoomed-out virtual screen corresponding to the "music" application. The preset size can be set according to actual needs, for example, it can be set to be the same as the initial screen size of the virtual screen when the "music" application is started, which is not limited in the embodiments of the present application.

[0248] In the embodiments of the present application, after the smart travel module receives the zoom-out operation request message sent by the car machine, it can first call the resizeDisplay() interface to call the screen projection service module. The screen projection service module can perform Resize processing on the virtual screen corresponding to the "music" application according to the received screen size (including width and height parameters). After the Resize is successful, the full-screen state is exited.

[0249] S1106: The mobile phone exits the parallel visual field mode, and generates a music application sub-window interface (as an example of the fifth interface) of the virtual screen based on the adjusted screen size of the virtual screen. The music application sub-window interface can include a sub-window display window (as an example of the seventh display window), which can be used to display a music playing interface (as an example of the first application interface) or a music search interface (as an example of the third application interface) of the "music" application.

[0250] In the embodiments of the present application, the interface size of the music application sub-window interface can be smaller than the size of the car machine display screen, that is, the fifth interface is a sub-window display. The size of the sub-window display window can be the same as the size of the music application sub-window interface, that is, the sub-window display window fills the entire area of the music application sub-window interface. The size of the sub-window display window can also be different from the size of the music application sub-window interface, that is, the sub-window display window can only be located in part of the music application sub-window interface. The embodiments of the present application do not specifically limit the position and size of the sub-window display window in the music application sub-window interface.

[0251] Specifically, in the case that the zoom-out operation request message is a zoom-out operation request message for the second interface, the sub-window display window of the music application sub-window interface can be used to display the music playing interface of the "music" application; in the case that the zoom-out operation request message is a zoom-out operation request message for the fourth interface, the sub-window display window of the music application sub-window interface can be used to display the music search interface of the "music" application.

[0252] Unlike the parallel visual field mode display of the mobile phone, when the mobile phone displays in the parallel visual field mode, there is no zoom-out full-screen button in the interface, and there is no scene of returning to a single interface from the parallel visual field. In the embodiments of the present application, the zoom-out full-screen button can be displayed in the display interface, and the user can perform the zoom-out full-screen operation on the display interface based on the zoom-out full-screen button.

[0253] Specifically, after the phone obtains the zoom-out operation request message, the smart travel module can call the parallel view service layer through the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface. Unlike the maximum operation, the corresponding operation (reason) REASON_EXIT_FULLSCREEN is added for the zoom-out full-screen scene, which is used to indicate the exit of the parallel view mode. When the parallel view service layer receives this parameter, it can determine whether the virtual screen corresponding to the "music" application is in the parallel view mode. If so, it will call the moveFocusTaskToQuitMagicInVirtual method function to obtain the task on the corresponding virtual screen and make it exit the parallel view mode.

[0254] Specifically, after the phone exits the parallel view mode, the music application small window interface of the virtual screen can be generated based on the adjusted screen size of the virtual screen. The detailed process of generating the music application small window interface will not be described here.

[0255] S1107: The phone outputs the control data of the music application small window interface (as an example of the fourth control data) to the car machine, and the control data of the music application small window interface is used to control the car machine to display the music application small window interface on the display screen.

[0256] It should be noted that the specific content of steps S1101 to S1107 in the embodiments of the present application can refer to the related content in steps S401 to S407 in the embodiments shown in Figure 4 , and the related content in steps S801 to S810 in the embodiments shown in Figures 8 to 10 , which will not be described here.

[0257] The display method provided by another embodiment of the present application will be described in detail below. Figure 12 The display method provided by another embodiment of the present application will be described in detail below.

[0258] The display method provided by the embodiments of the present application can be applied to a first electronic device, which is in communication connection with a second electronic device. The first electronic device can be an electronic device with a hardware structure as shown in Figure 3a and a software structure as shown in Figure 3b , Figure 3c , or an electronic device with more or fewer components than the figure, or combining certain components, or splitting certain components, or different component arrangement, and the like hardware structure and software structure.

[0259] The following takes the first electronic device as a mobile phone, the second electronic device as a car machine, and the scenario of maximizing the display interface as an example to describe the display method provided by the embodiments of the present application in detail. A plurality of applications are installed in the mobile phone, and part or all of the applications support the parallel horizon mode (i.e., support the in-application split-screen function) and the car machine has a display screen.

[0260] Reference Figure 12 As shown in the figure, Figure 12 A flowchart of the display method provided by another embodiment of the present application is shown, which can include steps S1201-S1204.

[0261] S1201: The mobile phone (as an example of the first electronic device) acquires the maximization operation request message (as an example of the first operation request message) sent by the car machine (as an example of the second electronic device) in the super desktop mode (as an example of the preset mode), which is sent by the car machine in response to the maximization operation (as an example of the first operation) on the music application small window interface (as an example of the first interface).

[0262] The music application small window interface includes a small window display window (as an example of the first display window), which can be used to display the music playing interface (as an example of the first application interface) of the "music" application (as an example of the target application).

[0263] In the embodiments of the present application, after the car machine starts the super desktop mode, when the user clicks the "music" application icon in the super desktop, the car machine can open the "music" application in the small window mode and display the home page interface of the "music" application through the virtual screen. When the user performs the operation of browsing the information in the home page interface, such as clicking to play a certain music, the car machine can display the corresponding music playing interface in the music application small window interface. Alternatively, when the user clicks the "music" application icon in the super desktop, the car machine can also open the "music" application in the small window mode through the virtual screen and directly display the music playing interface of the "music" application in the music application small window interface.

[0264] In the embodiments of the present application, after the car machine starts the super desktop mode, when the user performs the maximization operation on the music application small window interface, the car machine can generate the maximization operation request message in response to the maximization operation and send it to the mobile phone. The maximization operation can be used to maximize the music application small window interface to enter the full-screen state. Correspondingly, the mobile phone can receive the maximization operation request message sent by the car machine.

[0265] S1202: The mobile phone determines the screen size of the virtual screen corresponding to the "music" application in response to the maximization operation request message.

[0266] S1203: The phone starts the Parallel View mode and generates a music application split-screen interface (as an example of the second interface) based on the screen size of the virtual screen in the Parallel View mode. The music application split-screen interface can include a left display window (as an example of the second display window) and a right display window (as an example of the third display window) for split-screen display. The left display window and the right display window are used to display the music playback interface and the home screen of the "Music" application (as an example of the second application interface), respectively.

[0267] In this embodiment, the size of the music application split-screen interface can be the same as the size of the vehicle's display screen, meaning the second interface is full-screen. The sizes of the left and right display windows of the music application split-screen interface can be the same or different. The left and right display windows can be split vertically or horizontally; this embodiment describes a horizontal split-screen as an example. The left and right display windows can occupy all or part of the music application split-screen interface. This embodiment does not impose specific limitations on the position and size of the left and right display windows. Preferably, in this application, the height of a single window in the parallel view can be greater than its width, meaning the height of both the left and right display windows is greater than their width.

[0268] S1204: The mobile phone outputs control data for the music application split-screen interface (as an example of the first control data). The control data for the music application split-screen interface is used to control the vehicle system to display the music application split-screen interface on the screen.

[0269] It should be noted that the specific content of steps S1201 to S1204 in the embodiments of this application can be found by referring to Figure 4 The relevant content in steps S401 to S407 of the illustrated embodiment will not be repeated here.

[0270] Furthermore, in the above embodiments, only the portrait split-screen method has been described. The display method for the landscape split-screen method can be the same as that for the portrait split-screen method. For details, please refer to the display process for the portrait split-screen method, which will not be repeated here.

[0271] This application also provides a display system, which includes a first electronic device and a second electronic device, wherein the first electronic device is communicatively connected to the second electronic device, and the second electronic device has a display screen;

[0272] The second electronic device is used to activate a preset mode and display a first interface in the preset mode. The first interface includes a first display window, which is used to display the first application interface of the target application. In response to a first operation on the first interface, a first operation request message is sent to the first electronic device. The first operation includes maximizing the first interface.

[0273] The first electronic device is configured to obtain a first operation request message sent by the second electronic device; in response to the first operation request message, determine a screen size of a virtual screen corresponding to the target application; start a parallel view mode, and generate a second interface of the virtual screen based on the screen size of the virtual screen in the parallel view mode; the second interface includes a second display window and a third display window displayed in a split screen mode, and the second display window and the third display window are respectively configured to display a first application interface and a second application interface of the target application; and output first control data, the first control data being configured to control the second electronic device to display the second interface on the display screen.

[0274] The present application also provides an electronic device, comprising:

[0275] a memory configured to store instructions executed by one or more processors of the electronic device, and

[0276] When the processor executes the instructions in the memory, the electronic device can perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments. Figures 4 to 12 When the processor executes the instructions in the memory, the electronic device can perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments. Figures 4 to 12 When the processor executes the instructions in the memory, the electronic device can perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments.

[0277] The present application also provides a computer readable storage medium having instructions stored thereon, which, when executed by a processor, cause the processor to perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments. Figures 4 to 12 When the processor executes the instructions in the memory, the electronic device can perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments. Figures 4 to 12 When the processor executes the instructions in the memory, the electronic device can perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments.

[0278] The present application also provides a computer program product comprising instructions, which, when executed on an electronic device, cause the processor to perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments. Figures 4 to 12 When the processor executes the instructions in the memory, the electronic device can perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments. Figures 4 to 12 When the processor executes the instructions in the memory, the electronic device can perform each step of the display method performed by the first electronic device as shown in the above embodiments, or perform each step of the display method performed by the second electronic device as shown in the above embodiments.

[0279] Reference is now made to the drawings, in which Figure 13 FIG. 13 shows a block diagram of a SoC (System on Chip) 1300 according to an embodiment of the present application. In Figure 13 like components have like reference numbers. Additionally, dashed lined boxes are optional features of more advanced SoCs. In Figure 13In particular embodiments, SoC 1300 includes: an interconnect unit 1350 coupled to processor(s) 1310; system agent unit 1380; bus controller unit(s) 1390; integrated memory controller(s) unit(s) 1340; one or more co-processor(s) 1320 which can include integrated graphics logic, image processor, audio processor, and video processor; static random access memory (SRAM) unit 1330; direct memory access (DMA) unit 1360. In one embodiment, co-processor(s) 1320 include special-purpose processors, such as for example, network or communication processors, compression engines, GPGPU, high- throughput MIC processors, or embedded processors targeted for specific duties, depending on embodiment.

[0280] Static random access memory (SRAM) unit 1330 can include one or more tangible, non-transitory computer-readable storage medium for storing data and / or instructions. The computer-readable storage medium can store instructions, specifically, transient and permanent copies of the instructions. The instructions can include causing the SoC 1300 to perform the display method according to the above embodiments, specifically, refer to the method shown in the above embodiments, which will not be repeated here. Figures 4 to 12

[0281] Embodiments of the mechanisms disclosed herein can be implemented in hardware, software, firmware, or any combination thereof. Embodiments of the application can be implemented as computer programs or program code executing on programmable systems comprising at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0282] Program code can be applied to input instructions to perform the functions described herein and generate output information. The output information can be applied to one or more output devices, in known fashion. For purposes of this application, a processing system includes any system that has a processor, such as for example a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0283] The program code can be implemented in a high level procedural or object oriented programming language to communicate with a processing system. The program code can be implemented in assembly or machine language, if desired. In fact, the mechanisms described herein are not limited in scope to any particular programming language. In any case, the language can be a compiled or interpreted language.​

[0284] In some cases, the disclosed embodiments can be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried by or stored on a transitory or non-transitory machine-readable (e.g., computer-readable) medium, which can be read and executed by one or more processors. For example, the instructions can be distributed over the network or by other computer readable media. Thus, a machine-readable medium can include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including without limitation, a floppy disk, an optical disc (e.g., a CD or DVD), a magnetic disk, a read only memory (ROM), a random access memory (RAM), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), a magnetic or optical card, a flash memory, or a tangible, machine-readable storage used in the transmission of information over the Internet via electrical, optical, acoustical or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.). Accordingly, a machine-readable medium includes any type of medium for storing or transmitting information that is readable by a machine (e.g., a computer).

[0285] In the drawings, some of the structural or methodological features can be shown in particular arrangements and / or orders. However, it should be understood that such particular arrangements and / or orders can not be required. Instead, in some embodiments, the features can be arranged differently from that shown in the figures. Also, inclusion of a structural or methodological feature in a particular figure does not imply that the feature is required in all embodiments, and in some embodiments, the feature can not be included or can be combined with other features.

[0286] It should be noted that each unit / module mentioned in each device embodiment of the present application is a logical unit / module, and in physical, one logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented by a combination of multiple physical unit / modules, and the physical implementation of the logical unit / module is not the most important. The combination of the functions implemented by these logical units / modules is the key to solving the technical problems proposed in the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce the units / modules that are not closely related to solving the technical problems proposed in the present application, which does not mean that the above-mentioned device embodiments do not have other units / modules.

[0287] It should be noted that in the examples and descriptions of the present application, the relationship terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between the entities or operations. Moreover, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including one" does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0288] Although the present application has been illustrated and described with reference to certain preferred embodiments thereof, it should be understood by those skilled in the art that various changes in form and details can be made therein without departing from the spirit and scope of the present application.

Claims

1. A display method applied to a first electronic device, the first electronic device being communicatively connected to a second electronic device, the second electronic device having a display screen, characterized in that, The method includes: The first electronic device acquires a first operation request message sent by the second electronic device in a preset mode. The first operation request message is sent by the second electronic device in response to a first operation on the first interface. The first interface includes a first display window, which is used to display a first application interface of the target application. The first operation includes maximizing the first interface. The first electronic device responds to the first operation request message and determines the screen size of the virtual screen corresponding to the target application; The first electronic device initiates a parallel view mode and generates a second interface of the virtual screen based on the screen size in the parallel view mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used to display the first application interface and the second application interface of the target application; The first electronic device outputs first control data, which is used to control the second electronic device to display the second interface on the display screen.

2. The method according to claim 1, characterized in that, The first electronic device initiates a parallel view mode and generates a second interface of the virtual screen based on the screen size in the parallel view mode, including: The first electronic device determines whether the target application has enabled the parallel view function; If the target application enables the Parallel View function, the first electronic device starts the Parallel View mode and generates a second interface of the virtual screen based on the screen size in the Parallel View mode.

3. The method according to claim 2, characterized in that, The first electronic device determines whether the target application has enabled the parallel view function, including: The first electronic device determines whether the target application is recorded in a pre-configured whitelist; If so, then the target application is confirmed to have the Parallel View feature enabled; If not, then it is determined that the target application has not enabled the Parallel View feature.

4. The method according to claim 2, characterized in that, If the target application enables the Parallel View function, the first electronic device initiates the Parallel View mode and generates a second interface of the virtual screen based on the screen size in the Parallel View mode, including: If the target application enables the Parallel View feature, the first electronic device determines whether the interface of the first application is a non-homepage interface of the target application. If the first application interface is a non-homepage interface of the target application, the first electronic device starts the parallel view mode and generates a second interface of the virtual screen based on the screen size in the parallel view mode; and the first application interface displayed in the second interface is different from the second application interface.

5. The method according to claim 4, characterized in that, The method further includes: If the first application interface is the homepage interface of the target application, the first electronic device starts the parallel view mode and generates a third interface of the virtual screen based on the screen size in the parallel view mode; wherein, the third interface includes a fourth display window, the size of the fourth display window is larger than the size of the first display window, and the fourth display window is used to display the enlarged first application interface. The first electronic device outputs second control data, which is used to control the second electronic device to display the third interface on the display screen.

6. The method according to claim 5, characterized in that, The method further includes: The first electronic device responds to a second operation based on the first application interface and generates a fourth interface of the virtual screen based on the screen size in the parallel view mode; wherein, the second operation includes an operation for browsing the content in the first application interface; the fourth interface includes a fifth display window and a sixth display window for split-screen display, the fifth display window and the sixth display window are respectively used to display the first application interface and the third application interface of the target application, and the third application interface is the result interface corresponding to the second operation; The first electronic device outputs third control data, which is used to control the second electronic device to display the fourth interface on the display screen.

7. The method according to claim 6, characterized in that, The second operation includes searching for content in the first application interface.

8. The method according to claim 6, characterized in that, The second operation includes viewing the content displayed in the first application interface.

9. The method according to claim 6, characterized in that, The method further includes: The first electronic device acquires a third operation request message sent by the second electronic device in a preset mode. The third operation request message is sent by the second electronic device in response to a third operation on the second interface or the fourth interface. The third operation includes a zoom-out operation on the second interface or the fourth interface. In response to the third operation request message, the first electronic device adjusts the screen size of the virtual screen corresponding to the target application; The first electronic device exits the parallel view mode and generates a fifth interface of the virtual screen based on the adjusted screen size; wherein, the fifth interface includes a seventh display window, which is used to display the first application interface or the third application interface of the target application; The first electronic device outputs fourth control data, which is used to control the second electronic device to display the fifth interface on the display screen.

10. The method according to claim 1, characterized in that, The method further includes: After the first electronic device establishes a communication connection with the second electronic device, it obtains an application launch message for the target application sent by the second electronic device in a preset mode. The application launch message is sent by the second electronic device in response to the launch operation for the target application. In response to the application launch message, the first electronic device creates a virtual screen corresponding to the target application; The first electronic device generates the first interface of the virtual screen based on the screen size of the virtual screen; The first electronic device outputs fifth control data, which is used to control the second electronic device to display the first interface on the display screen.

11. A display method applied to a system including a first electronic device and a second electronic device, the first electronic device being communicatively connected to the second electronic device, the second electronic device having a display screen, characterized in that, The method includes: The second electronic device starts a preset mode and displays a first interface in the preset mode. The first interface includes a first display window, which is used to display the first application interface of the target application. In response to a first operation on the first interface, the second electronic device sends a first operation request message to the first electronic device; wherein the first operation includes maximizing the first interface; The first electronic device acquires the first operation request message sent by the second electronic device; The first electronic device responds to the first operation request message and determines the screen size of the virtual screen corresponding to the target application; The first electronic device initiates a parallel view mode and generates a second interface of the virtual screen based on the screen size in the parallel view mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used to display the first application interface and the second application interface of the target application; The first electronic device outputs first control data, which is used to control the second electronic device to display the second interface on the display screen.

12. A display system, characterized in that, The system includes a first electronic device and a second electronic device, the first electronic device being communicatively connected to the second electronic device, and the second electronic device having a display screen; The second electronic device is used to activate a preset mode and display a first interface in the preset mode. The first interface includes a first display window, which is used to display a first application interface of a target application. In response to a first operation on the first interface, a first operation request message is sent to the first electronic device. The first operation includes maximizing the first interface. The first electronic device is configured to acquire the first operation request message sent by the second electronic device; in response to the first operation request message, determine the screen size of the virtual screen corresponding to the target application; activate the parallel view mode, and generate a second interface of the virtual screen based on the screen size in the parallel view mode; wherein the second interface includes a second display window and a third display window for split-screen display, the second display window and the third display window being used to display the first application interface and the second application interface of the target application, respectively; and output first control data, the first control data being used to control the second electronic device to display the second interface on the display screen.

13. An electronic device, characterized in that, include: A memory for storing instructions executed by one or more processors of the electronic device; A processor, when executing the instructions in the memory, can cause the electronic device to perform the method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the method described in any one of claims 1 to 11.

Citation Information

Patent Citations

  • Self-adaptive interconnection screen projection method for mobile phone and computer terminal

    CN110286864A

  • Electronic equipment, screen projection method thereof and medium

    CN114356258A