Display method, system and equipment and storage medium
By using parallel visibility mode on the car machine to realize split-screen display in the application, the problem of poor user experience in the car machine’s virtual screen mode is solved, the display effect and operation logic are improved, and the user experience is enhanced.
Patent Information
- Application Number
- CN202410046009.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-10
- Publication Date
- 2025-07-18
- Estimated Expiration
- 2044-01-10
AI Technical Summary
In the prior art, when the vehicle computer displays the application of terminal equipment in virtual screen mode, the user's operating experience is poor and the display effect is poor. Especially after the application is maximized from the small window mode to the full screen mode, the interface display position is disordered and the control size is inappropriate, resulting in a decline in user experience.
The parallel vision mode is adopted to display two application interfaces of the same application on the display screen of the car computer at the same time. The car computer is controlled by the mobile phone to display it in the application split screen. The pre-configured whitelist is used to determine whether the application is enabled to ensure the adaptability and aesthetics of the interface.
It improves the amount of information displayed by the car computer, the aesthetics and operation logic are in line with the user's daily use, improves the user experience, reduces the black or white screen areas, and avoids interface display errors.
Smart Images

Figure CN120343315A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a display method, system, device and storage medium. Background Art
[0002] With the development of the Internet of Vehicles industry, car-machine interconnection is becoming a low-cost and efficient car-machine solution. Among them, the solution of playing favorite music through the car-machine speakers is the most widely used. After the terminal device is connected to the car machine, in order to facilitate users to operate various applications on the terminal device through the car machine, you can use the super desktop to realize desktop application sharing. In the super desktop scenario, the car machine can display the application list of the terminal device and use the corresponding application.
[0003] However, in the existing solution, the car computer can only open applications in the terminal device in small window or full screen mode through the virtual screen. When the application is opened in small window mode on the virtual screen of the car computer, if the user clicks the maximized operation control in the interface, the full screen display mode of the application will be directly started. At this time, since the interface of some applications is not adapted to the special-shaped screen or horizontal screen mode of the car computer, the display effect on the car computer after starting the full-screen mode of the application will be poor, resulting in poor operating experience for users during the use of the application, poor appearance of the application display interface, and less application information available. It may also cause problems such as disordered interface display position and inappropriate application control size, which reduces the user's experience. Summary of the invention
[0004] Some embodiments of the present application provide a kind of, and the present application is introduced from multiple aspects below, and the embodiments and beneficial effects of the following multiple aspects can be referenced to each other.
[0005] In a first aspect, an embodiment of the present application provides a display method, which is applied to a first electronic device, the first electronic device is communicatively connected with a second electronic device, and the second electronic device has a display screen, and the method includes:
[0006] The first electronic device obtains a first operation request message sent by the second electronic device in a preset mode, where the first operation request message is sent by the second electronic device in response to a first operation on a first interface; wherein the first interface includes a first display window, the first display window is used to display a first application interface of a target application, and the first operation includes maximizing the first interface;
[0007] The first electronic device determines, in response to the first operation request message, a screen size of a virtual screen corresponding to the target application;
[0008] The first electronic device activates the parallel vision mode and generates a second interface of the virtual screen based on the screen size in the parallel vision mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used to display a first application interface and a second application interface of the target application;
[0009] The first electronic device outputs first control data for controlling the second electronic device to display the second interface on the display screen.
[0010] According to the embodiments of the present application, when the vehicle head unit (as an example of the second electronic device) displays the application interface in the small window mode in the super desktop mode (as an example of the preset mode), if the user performs an operation to maximize and enter the full screen for the small window interface, the mobile phone can control the vehicle head unit to pull up the full screen layout of the parallel vision mode based on this operation, so that the vehicle head unit displays two application interfaces of the same application in the form of in-application split-screen display, and these two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be displayed simultaneously on the vehicle head unit display screen, such as simultaneously displaying the home page interface and the music playing interface of the music playing application. This display method can display more information content on a large screen such as the vehicle head unit, and the display interface is more beautiful, and the operation logic is more in line with the user's daily use, improving the user experience on the vehicle head unit.
[0011] In some embodiments, the first electronic device activates the parallel vision mode and generates a second interface of the virtual screen based on the screen size of the virtual screen, including:
[0012] The first electronic device determines whether the target application enables the parallel vision function;
[0013] If the target application enables the parallel vision function, the first electronic device activates the parallel vision mode and generates a second interface of the virtual screen based on the screen size of the virtual screen.
[0014] In some embodiments, the first electronic device determines whether the target application enables the parallel vision function, including:
[0015] The first electronic device determines whether the target application is recorded in the pre-configured white list;
[0016] If so, it is determined that the target application enables the parallel vision function;
[0017] If not, it is determined that the target application does not enable the parallel vision function.
[0018] According to the embodiments of the present application, since there is no switch control that can be operated by the user in the super desktop scenario, the mobile phone can determine whether the target application enables the parallel vision function according to the pre-configured whitelist, and only control the vehicle-mounted device to pull up the full-screen layout of the parallel vision mode for the application that enables the parallel vision function. Moreover, the applications in the whitelist can be modified according to actual needs, and the applications with a higher degree of adaptation to the vehicle-mounted device display screen can be added to the whitelist, which can ensure the correctness and aesthetics of the interface displayed in the parallel vision mode, and avoid problems such as incorrect interface display positions and inappropriate application control sizes, thereby further ensuring the user experience.
[0019] In some embodiments, if the target application enables the parallel vision function, the first electronic device starts the parallel vision mode and generates a second interface of the virtual screen based on the screen size of the virtual screen in the parallel vision mode, including:
[0020] If the target application enables the parallel vision function, the first electronic device determines whether the first application interface is a non-home page interface of the target application;
[0021] If the first application interface is a non-home page interface of the target application, the first electronic device starts the parallel vision mode and generates a second interface of the virtual screen based on the screen size of the virtual screen in the parallel vision mode; and the first application interface displayed in the second interface is different from the second application interface.
[0022] In some embodiments, the method further includes:
[0023] If the first application interface is a home page interface of the target application, the first electronic device starts the parallel vision mode and generates a third interface of the virtual screen based on the screen size of the virtual screen in the parallel vision mode; wherein, the third interface includes a fourth display window, and the size of the fourth display window is larger than the size of the first display window, and the fourth display window is used to display the enlarged first application interface;
[0024] The first electronic device outputs second control data, and the second control data is used to control the second electronic device to display the third interface on the display screen.
[0025] According to the embodiments of the present application, when the vehicle-mounted device displays the home page interface of the target application in the small window mode, if the user performs an operation to maximize and enter the full screen for the small window interface, the mobile phone can control the vehicle-mounted device to pull up the full-screen layout of the parallel vision mode based on this operation, so that the vehicle-mounted device only displays the enlarged home page interface in a partial area of the display screen, which can increase the display area for displaying the application interface in the display screen, reduce the invalid operation areas such as black screens or white screens, enable the vehicle-mounted device to display more information content, and will not cause the application interface to be stretched excessively, improving the display effect of the application on the vehicle-mounted device.
[0026] In some embodiments, the method further includes:
[0027] In response to a second operation based on the first application interface, the first electronic device generates a fourth interface of the virtual screen based on the screen size of the virtual screen in the parallel vision mode; wherein, the second operation includes an operation for browsing the content in the first application interface; the fourth interface includes a fifth display window and a sixth display window for split-screen display, and the fifth display window and the sixth display window are respectively used to display the first application interface and the third application interface of the target application, and the third application interface is a result interface corresponding to the second operation;
[0028] The first electronic device outputs third control data for controlling the second electronic device to display the fourth interface on the display screen.
[0029] In some embodiments, the second operation includes an operation for searching for content in the first application interface.
[0030] In some embodiments, the second operation includes an operation for viewing the display content in the first application interface.
[0031] According to the embodiments of the present application, when the vehicle-mounted device displays the home page interface of the target application with an enlarged size, if the user performs an operation of searching for content or viewing the display content on the home page interface, the mobile phone can control the vehicle-mounted device to display two application interfaces of the same application in the form of in-application split-screen display, and these two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be displayed on the vehicle-mounted device display screen at the same time, such as displaying the home page interface and the music search interface of the music playing application at the same time. This display method can display more information content on the large screen of the vehicle-mounted device, and the display interface is more beautiful, and the operation logic is more in line with the user's daily use, improving the user experience on the vehicle-mounted device.
[0032] In some embodiments, the method further includes:
[0033] The first electronic device obtains a third operation request message sent by the second electronic device in a preset mode, and the third operation request message is sent by the second electronic device in response to a third operation on the second interface or the fourth interface; wherein, the third operation includes an operation for shrinking the second interface or the fourth interface;
[0034] In response to the third operation request message, the first electronic device adjusts the screen size of the virtual screen corresponding to the target application;
[0035] The first electronic device exits the parallel vision mode and generates a fifth interface of the virtual screen based on the adjusted screen size; wherein, the fifth interface includes a seventh display window for displaying the first application interface or the third application interface of the target application;
[0036] The first electronic device outputs fourth control data for controlling the second electronic device to display a fifth interface on a display screen.
[0037] According to an embodiment of the present application, when a vehicle-mounted device displays two application interfaces of a target application in a parallel vision mode, if a user performs an operation to reduce and exit full screen on the parallel vision interface, the mobile phone can control the vehicle-mounted device to exit the full-screen layout of the parallel vision mode based on this operation, so that the vehicle-mounted device displays one interface of the target application in a small window mode. This way of exiting full screen is simple and convenient to operate, the operation logic conforms to the daily use of users, and it can quickly exit full-screen display, further improving the user experience on the vehicle-mounted device.
[0038] In some embodiments, the method further includes:
[0039] After the first electronic device establishes a communication connection with the second electronic device, it obtains an application start message for the target application sent by the second electronic device in a preset mode, and the application start message is sent by the second electronic device in response to a start operation for the target application;
[0040] The first electronic device creates a virtual screen corresponding to the target application in response to the application start message;
[0041] The first electronic device generates a first interface of the virtual screen based on the screen size of the virtual screen;
[0042] The first electronic device outputs fifth control data for controlling the second electronic device to display the first interface on a display screen.
[0043] According to an embodiment of the present application, after the mobile phone establishes a communication connection with the vehicle-mounted device, the mobile phone can realize heterogeneous screen projection to the vehicle-mounted device through the virtual screen method, thereby realizing the super desktop function of the vehicle-mounted device and sharing the desktop applications of the mobile phone with the vehicle-mounted device. Users can operate each application installed in the mobile phone through the display screen of the vehicle-mounted device, which is more convenient for users to operate during driving and improves the user experience.
[0044] In a second aspect, an embodiment of the present application provides a display method applied to a system including a first electronic device and a second electronic device. The first electronic device is communicatively connected to the second electronic device, and the second electronic device has a display screen. The method includes:
[0045] The second electronic device starts a preset mode and displays a first interface in the preset mode. The first interface includes a first display window for displaying a first application interface of a target application;
[0046] In response to a first operation on a first interface, a second electronic device sends a first operation request message to a first electronic device; wherein, the first operation includes an operation of maximizing the first interface.
[0047] The first electronic device obtains the first operation request message sent by the second electronic device.
[0048] In response to the first operation request message, the first electronic device determines the screen size of a virtual screen corresponding to a target application.
[0049] The first electronic device activates the parallel horizon mode, and generates a second interface of the virtual screen based on the screen size of the virtual screen in the parallel horizon mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used to display a first application interface and a second application interface of the target application.
[0050] The first electronic device outputs first control data, and the first control data is used to control the second electronic device to display the second interface on a display screen.
[0051] The beneficial effects that can be achieved by the second aspect can refer to the beneficial effects of any implementation manner of the first aspect of this application, and will not be elaborated here.
[0052] In a third aspect, an embodiment of this application provides a display system, including a first electronic device and a second electronic device. The first electronic device is communicatively connected to the second electronic device, and the second electronic device has a display screen.
[0053] The second electronic device is configured to activate a preset mode, display a first interface in the preset mode. The first interface includes a first display window, and the first display window is used to display a first application interface of a target application; in response to a first operation on the first interface, send a first operation request message to the first electronic device; wherein, the first operation includes an operation of maximizing the first interface.
[0054] The first electronic device is configured to obtain the first operation request message sent by the second electronic device; in response to the first operation request message, determine the screen size of a virtual screen corresponding to the target application; activate the parallel horizon mode, and generate a second interface of the virtual screen based on the screen size of the virtual screen in the parallel horizon mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used to display a first application interface and a second application interface of the target application; and output first control data, and the first control data is used to control the second electronic device to display the second interface on the display screen.
[0055] The beneficial effects that can be achieved by the third aspect can refer to the beneficial effects of any implementation manner of the first aspect of this application, and will not be elaborated here.
[0056] Fourthly, an embodiment of the present application provides an electronic device, including: a memory for storing instructions executed by one or more processors of the electronic device; a processor, when the processor executes the instructions in the memory, enabling the electronic device to execute each step performed by the first electronic device in the method provided in any embodiment of the first aspect of the present application, or execute each step performed by the second electronic device in the method provided in any embodiment of the first aspect of the present application. The beneficial effects achievable by the fourth aspect can refer to the beneficial effects of any embodiment of the first aspect of the present application, which will not be elaborated here.
[0057] Fifthly, an embodiment of the present application provides a computer-readable storage medium, on which instructions are stored, and when the instructions are executed on a computer, enabling the computer to execute each step performed by the first electronic device in the method provided in any embodiment of the first aspect of the present application, or execute each step performed by the second electronic device in the method provided in any embodiment of the first aspect of the present application. The beneficial effects achievable by the fifth aspect can refer to the beneficial effects of any embodiment of the first aspect of the present application, which will not be elaborated here. Description of the Drawings
[0058] Figure 1a A schematic diagram showing an application scenario provided by an embodiment of the present application;
[0059] Figure 1b A schematic diagram showing a parallel vision mode provided by an embodiment of the present application;
[0060] Figure 2 A schematic diagram showing the process of maximizing to enter full-screen display provided by some embodiments;
[0061] Figure 3a A schematic diagram showing the structure of an electronic device provided by an embodiment of the present application;
[0062] Figure 3b A schematic block diagram showing the software structure of an electronic device provided by an embodiment of the present application;
[0063] Figure 3c Shows Figure 3b A schematic block diagram of the software structure of each module in the application framework layer in
[0064] Figure 4 A flowchart showing a display method provided by an embodiment of the present application;
[0065] Figure 5 A flowchart showing the process of creating and releasing a virtual container provided by an embodiment of the present application;
[0066] Figure 6aShows a schematic diagram of starting an application in a small window mode provided by an embodiment of the present application;
[0067] Figure 6b Shows a schematic diagram of switching from the small window mode to the parallel vision mode provided by an embodiment of the present application;
[0068] Figure 6c Shows a schematic diagram of switching from the small window mode to the normal full - screen mode provided by an embodiment of the present application;
[0069] Figure 7 Shows a flowchart of creating and deleting a virtual screen provided by an embodiment of the present application;
[0070] Figure 8 Shows a flowchart of a display method provided by another embodiment of the present application;
[0071] Figure 9a Shows a schematic diagram of switching from the small window mode to the parallel vision mode provided by another embodiment of the present application;
[0072] Figure 9b Shows a schematic diagram of the process of a user performing a music search operation provided by an embodiment of the present application;
[0073] Figure 10 Shows a flowchart of a display method provided by another embodiment of the present application;
[0074] Figure 11 Shows a flowchart of a display method provided by another embodiment of the present application;
[0075] Figure 12 Shows a flowchart of a display method provided by another embodiment of the present application;
[0076] Figure 13 Shows a schematic diagram of the structure of a System on Chip (SOC) provided by an embodiment of the present application. Detailed implementation manners
[0077] The illustrative embodiments of the present application include but are not limited to a display method, a system, a device, and a storage medium. The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.
[0078] The display method provided by the embodiments of the present application can be applied to the process of in-application split-screen display in a heterogeneous screen mirroring scenario. This scenario may include a first electronic device and a second electronic device that have established a connection. The first electronic device can use heterogeneous screen mirroring technology to project the screen to the second electronic device, enabling the second electronic device to perform in-application split-screen display. For ease of description, the present application uses the parallel vision mode to represent the in-application split-screen function.
[0079] Specifically, heterogeneous screen mirroring means that the first electronic device and the second electronic device can display the screen mirroring content asynchronously, or rather, the display contents of the first electronic device and the second electronic device can be different. Exemplarily, a terminal device (taking the first electronic device as a terminal device in the present application as an example) can create a virtual screen and project the application interface of a music playback application to a car machine (taking the second electronic device as a car machine in the present application as an example) based on the virtual screen, while the physical screen of the terminal device can display the main interface or the application interfaces of other applications. That is to say, during the process of the terminal device displaying the main interface or the application interfaces of other applications, the car machine displays the application interface of the music playback application, that is, the terminal device and the car machine do not display the screen mirroring content synchronously. Heterogeneous screen mirroring technology can enable the terminal device to project the first application interface of the first application to the display screen of the car machine, while the terminal device displays the second application interface of the second application, facilitating user operation. The specific implementation principle of heterogeneous screen mirroring is not elaborated in the embodiments of the present application.
[0080] In a specific embodiment, the display method provided by the embodiments of the present application can be applied to the situation where after the car machine is connected to the terminal device and uses the applications in the terminal device in the super desktop scenario, the application is displayed in the parallel vision mode on the car machine.
[0081] Figure 1a Shows a schematic diagram of a possible application scenario provided by an embodiment of the present application. As Figure 1a shown, the car machine 100 is connected to the terminal device 200 ( Figure 1a taking the terminal device as a mobile phone as an example). Specifically, the car machine 100 can open the super desktop (as an example of a preset mode), automatically discover the connectable terminal device 200, and click on the connectable terminal device 200 to connect. The super desktop is a mode for realizing the desktop application sharing function. After the car machine 100 opens the super desktop and successfully connects to the terminal device 200, the car machine 100 can display each application installed in the terminal device 200 in the super desktop, realizing the sharing of the desktop applications of the terminal device 200 and the car machine 100. The user can use each application in the terminal device 200 through the car machine 100, and the car machine 100 can display the first application interface and the second application interface of the application in the parallel vision mode.
[0082] Figure 1bThe figure shows a schematic diagram of the parallel vision mode of the in-vehicle device 100 provided by the embodiments of the present application. The parallel vision mode of the in-vehicle device 100 in the present application means that two application interfaces of the same application are respectively displayed in the first display window 110 and the second display window 120 of the in-vehicle device 100. For example, taking the music playing application as an example, the application interfaces in the music playing application may include a home page, music playing, music search and other interfaces. As Figure 1b shown, the in-vehicle device can display the home page interface in the music playing application, such as the interface of "recommended music", in the first display window 110, and display the "music playing interface" of the music clicked by the user in the "recommended music interface" in the second display window 120. In addition, the second display window 120 can also display other interfaces in the music playing application, such as the music search interface, the music list interface, or the same interface as that in the first display window 110, which is not limited herein.
[0083] It should be noted that Figure 1a the application scenario of the super desktop shown is only an example, and the embodiments of the present application are not limited thereto.
[0084] In some embodiments, when the user uses an application through the super desktop of the in-vehicle device, the in-vehicle device can open the application in a small window or full-screen mode on the virtual screen, and it is impossible to support the application to be opened in the parallel vision mode when opening some applications on devices such as folding screen mobile phones or tablet computers. Exemplarily, with reference to the attached Figure 2 , Figure 2 the figure shows a schematic diagram of the process of maximizing and entering full-screen display provided by some embodiments. As Figure 2 shown, after the user starts the music playing application through the super desktop 210, the in-vehicle device can display the music playing interface of the music playing application in the first display window 220 in a small window mode, and the music playing interface may include a maximization operation control 221. In the small window mode, the first display window 220 only displays a partial area in the super desktop, and the remaining area still displays the application icons of each application of the terminal device.
[0085] At this time, if the user wants to maximize the display interface, a click operation can be performed on the maximization operation control 221 in the music playing interface. For example, the user directly clicks on the maximization operation control 221 with a finger. As Figure 2As shown, after the vehicle computer receives the user's click operation on the maximized operation control 221, in response to the click operation, the music playback interface of the music playback application can be displayed in the second display window 230 in full-screen mode. In full-screen mode, the second display window 230 fills the entire area of the super desktop, but the display position and size of the content part in the music playback interface do not change, or the content part in the music playback interface is also stretched to fill the entire area of the super desktop. At this time, since the interface of some applications is not adapted to the special-shaped screen or horizontal screen mode of the vehicle computer, after the application enters the full-screen mode, only a small part of the display screen is used to display the application, and most of the area is an invalid operation area such as a black screen or a white screen, which makes the display effect on the vehicle computer poor, resulting in poor user experience in the process of using the application, poor appearance of the application display interface, and less application information that can be obtained. It may also cause problems such as disordered interface display position and inappropriate size of application controls, which reduces the user's experience.
[0086] In order to solve the above problems, an embodiment of the present application provides a display method to realize the display of applications in a parallel field of view mode on a vehicle computer, thereby improving the user experience.
[0087] According to one embodiment of the present application, when a car computer (as an example of a second electronic device) displays an application interface in a small window mode in a super desktop mode (as an example of a preset mode), if the user performs a maximized operation to enter the full screen for the small window interface, the mobile phone can control the car computer to pull up the full screen layout of the parallel vision mode based on the operation, so that the car computer displays two application interfaces of the same application in the form of a split-screen display within the application, and these two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be displayed on the car computer display screen at the same time, such as displaying the home page interface and the music playback interface of a music playback application at the same time. This display method can display more information content on a large screen such as a car computer, and the display interface is more beautiful, and the operation logic is more in line with the user's daily use, which improves the user's experience on the car computer.
[0088] According to an implementation of the present application, since there is no user-operable switch control in the super desktop scenario, the mobile phone can determine whether the target application has the parallel horizon function enabled based on the pre-configured whitelist, and only control the vehicle computer to pull up the full-screen layout of the parallel horizon mode for the application that has the parallel horizon function enabled. In addition, the applications in the whitelist can be modified according to actual needs, and applications with a high degree of adaptation to the vehicle computer display screen can be added to the whitelist, which can ensure the correctness and aesthetics of the interface displayed in the parallel horizon mode, avoid problems such as the disorder of the interface display position and the inappropriate size of the application controls, thereby further ensuring the user experience.
[0089] According to an embodiment of the present application, when the vehicle-mounted device displays the home page interface of the target application in a small window mode, if the user performs an operation to maximize and enter the full screen for the small window interface, the mobile phone can control the vehicle-mounted device to pull up the full screen layout of the parallel vision mode, so that the vehicle-mounted device only displays the enlarged home page interface in a partial area of the display screen, which can increase the display area for displaying the application interface in the display screen, reduce the invalid operation areas such as black screens or white screens, enable the vehicle-mounted device to display more information content, and will not cause the application interface to be stretched excessively, improving the display effect of the application on the vehicle-mounted device.
[0090] According to an embodiment of the present application, when the vehicle-mounted device displays the enlarged home page interface of the target application, if the user performs an operation to search for content or view the displayed content for the home page interface, the mobile phone can control the vehicle-mounted device to display two application interfaces of the same application in the form of in-application split screen display, and these two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be simultaneously displayed on the vehicle-mounted device display screen, such as simultaneously displaying the home page interface and the music search interface of the music playing application. This display method can display more information content on the large screen of the vehicle-mounted device, and the display interface is more beautiful, and the operation logic is more in line with the user's daily use, improving the user experience on the vehicle-mounted device.
[0091] In the above embodiments, the first electronic device and the second electronic device can be a single screen, a folding screen, a curved screen, etc. Among them, the folding screen can be a structure with two physical screens or a structure with one physical screen, which is not limited herein. In other embodiments of the present application, the first electronic device and the second electronic device in the embodiments of the present application can also be electronic devices with more than three screens, which is not limited herein. For an electronic device with one physical screen, it can include a main screen and a secondary screen. Among them, the main screen can be used as the first display window of the electronic device, and the secondary screen can be used as the second display window of the electronic device.
[0092] In the above embodiments, the display method of the second electronic device is split screen display in the vertical screen state of the second electronic device. In other embodiments of the present application, it can also be split screen display in the horizontal screen state, that is, split screen display up and down. Exemplarily, in the split screen display in the vertical screen state of the second electronic device, the first display window is on the left side of the display screen, and the second display window is on the right side of the display screen. In the split screen display in the horizontal screen state of the second electronic device, the first display window is above the display screen, and the second display window is below the display screen.
[0093] The embodiments of the present application do not limit the forms of the first electronic device and the second electronic device. The first electronic device may be an electronic device that supports the parallel vision function, such as a mobile phone, a tablet computer, a laptop computer, etc. The second electronic device may be an electronic device with a display screen, such as a smart screen, a vehicle-mounted device (for example, a car machine, a vehicle-mounted navigator), etc., which are not limited herein.
[0094] The method of the embodiments of the present application will be described below in conjunction with the specific structure of the electronic device. Figure 3a The illustrated electronic device 300 is exemplarily a device that serves as the first electronic device.
[0095] Figure 3a FIG. shows a schematic structural diagram of an electronic device 300 provided by an embodiment of the present application. The electronic device 300 may include a processor 310, an external memory interface 320, an internal memory 321, a Universal Serial Bus (USB) interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a headphone interface 370D, a sensor module 380, a key 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a Subscriber Identification Module (SIM) card interface 395, etc. Among them, the sensor module 380 may include a pressure sensor 380A, a gyroscope sensor 380B, a barometric pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, etc.
[0096] The processor 310 may include one or more processing units. For example, the processor 310 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and / or a Neural Network Processor (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors. For example, the processor 310 may be used to execute each step performed by the first electronic device in the display method of the embodiments of the present application.
[0097] The processor 310 can generate operation control signals according to the instruction operation code and timing signals to complete the control of instruction fetching and execution.
[0098] A memory can also be set in the processor 310 to store instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. This memory can save the instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 310, and thus improves the efficiency of the system.
[0099] In some embodiments, the processor 310 can obtain a maximization operation request message sent by the in-vehicle unit in the super desktop mode, and control the in-vehicle unit to pull up the full-screen layout of the parallel horizon mode based on the maximization request message, so that the in-vehicle unit displays two application interfaces of the same application in the form of in-application split-screen display, and these two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be displayed on the in-vehicle unit display screen at the same time, such as the home page interface and the music playing interface of the music playing application. This display method can display more information content on the large screen of the in-vehicle unit, and the display interface is more beautiful, and the operation logic is more in line with the daily use of users, improving the user experience on the in-vehicle unit.
[0100] In some embodiments, the processor 310 can include one or more interfaces. The interfaces can include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input / Output (GPIO) interface, and a Subscriber Identity Module (SIM) interface.
[0101] It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only for illustrative purposes and does not constitute a structural limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 can also adopt different interface connection methods or a combination of multiple interface connection methods in the above embodiments.
[0102] The wireless communication function of the electronic device 300 can be implemented by Antenna 1, Antenna 2, the mobile communication module 350, the wireless communication module 360, the modulation and demodulation processor, and the baseband processor, etc.
[0103] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, Antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0104] The mobile communication module 350 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc. applied to the electronic device 300. The mobile communication module 350 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves through Antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 350 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through Antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 350 can be disposed in the processor 310. In some embodiments, at least some functional modules of the mobile communication module 350 and at least some modules of the processor 310 can be disposed in the same device.
[0105] The modulation and demodulation processor can include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 370A, the receiver 370B, etc.), or displays an image or video through the display screen 394. In some embodiments, the modulation and demodulation processor can be an independent device. In some other embodiments, the modulation and demodulation processor can be independent of the processor 310 and be disposed in the same device as the mobile communication module 350 or other functional modules.
[0106] The wireless communication module 360 can provide solutions for wireless communications applied to the electronic device 300, including wireless local area networks (WLANs) (such as wireless fidelity (WiFi) networks), Bluetooth (BT), global navigation satellite systems (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 360 can be one or more devices integrating at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 310. The wireless communication module 360 can also receive the signals to be sent from the processor 310, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.
[0107] In some embodiments, antenna 1 of electronic device 300 is coupled to mobile communication module 350, and antenna 2 is coupled to wireless communication module 360, such that electronic device 300 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include Global System For Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), Beidou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS).
[0108] In some embodiments, electronic device 300 can establish a connection with a device as a second electronic device through antenna 2, and send the received message to processor 310 through wireless communication module 360.
[0109] Electronic device 300 implements a display function through a GPU, display screen 394, and an application processor, etc. The GPU is a microprocessor for image processing, and is connected to display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs, which execute program instructions to generate or change display information.
[0110] The display screen 394 is used to display images, videos, etc. The display screen 394 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 300 may include one or N display screens 394, where N is a positive integer greater than 1.
[0111] The electronic device 300 can implement the shooting function through the ISP, the camera 393, the video codec, the GPU, the display screen 394, and the application processor, etc.
[0112] The internal memory 321 can be used to store computer-executable program codes, and the executable program codes include instructions. The internal memory 321 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.). The data storage area can store the data created during the use of the electronic device 300 (such as audio data, phone book, etc.). In addition, the internal memory 321 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 310 executes various functional applications and data processing of the electronic device 300 by running the instructions stored in the internal memory 321, and / or the instructions stored in the memory provided in the processor.
[0113] In some embodiments, instructions of the display method may be stored in the internal memory 321. By running the display method instructions, the processor 310 can obtain the maximization operation request message sent by the in-vehicle unit in the super desktop mode, and control the in-vehicle unit to pull up the full-screen layout of the parallel horizon mode based on the maximization request message, so that the in-vehicle unit displays two application interfaces of the same application in the form of in-application split-screen display, and these two application interfaces can be different application interfaces. In this way, two application interfaces of the same application can be simultaneously displayed on the in-vehicle unit display screen, such as the home page interface and the music playback interface of the music playback application. This display method can display more information content on the large screen of the in-vehicle unit, and the display interface is more beautiful, and the operation logic is more in line with the daily use of users, improving the user experience on the in-vehicle unit.
[0114] The electronic device 300 can implement audio functions through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the headphone jack 370D, and the application processor, etc. Such as music playback, recording, etc.
[0115] The audio module 370 is used to convert digital audio information into analog audio signals for output, and is also used to convert analog audio inputs into digital audio signals. The audio module 370 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 370 can be disposed in the processor 310, or some functional modules of the audio module 370 can be disposed in the processor 310.
[0116] The microphone 370C, also known as the "microphone" or "transmitter", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound close to the microphone 370C with the mouth to input the sound signal into the microphone 370C. The electronic device 300 can be provided with at least one microphone 370C. In some other embodiments, the electronic device 300 can be provided with two microphones 370C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the electronic device 300 can also be provided with three, four or more microphones 370C to implement sound signal collection, noise reduction, and can also identify the sound source to implement functions such as directional recording.
[0117] The pressure sensor 380A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 380A may be disposed on the display screen 394. There are many types of pressure sensors 380A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor may include at least two parallel plates having conductive materials. When a force acts on the pressure sensor 380A, the capacitance between the electrodes changes. The electronic device 300 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 394, the electronic device 300 detects the intensity of the touch operation according to the pressure sensor 380A. The electronic device 300 can also calculate the position of the touch based on the detection signal of the pressure sensor 380A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: When a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
[0118] The gyroscope sensor 380B can be used to determine the motion posture of the electronic device 300. In some embodiments, the angular velocity of the electronic device 300 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 380B. The gyroscope sensor 380B can be used for anti-shake during shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 380B detects the angle of jitter of the electronic device 300, calculates the distance that the lens module needs to compensate based on the angle, and enables the lens to cancel the jitter of the electronic device 300 through reverse movement to achieve anti-shake. The gyroscope sensor 380B can also be used for navigation and in the context of motion-sensing games.
[0119] The touch sensor 380K, also known as a "touch control device". The touch sensor 380K can be disposed on the display screen 394, and the touch sensor 380K and the display screen 394 together form a touch screen, also known as a "touch control screen". The touch sensor 380K is used to detect touch operations acting on it or in its vicinity. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 394. In some other embodiments, the touch sensor 380K can also be disposed on the surface of the electronic device 300, at a different position from that of the display screen 394.
[0120] The software system of the electronic device 300 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of the present invention, taking the Android system with a layered architecture as an example, the software structure of the electronic device 300 is exemplarily described. Among them, the type of the operating system of the electronic device is not limited in this application. For example, Android system, Linux system, Windows system, iOS system, Harmony Operating System (Harmony OS), etc.
[0121] Figure 3b It is a software structure block diagram of the electronic device 300 provided by an embodiment of the present invention. As Figure 3b shown, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely the application layer (APP), the application framework layer (APP Framework), Android Runtime, and system libraries (Libraries), and the kernel layer (Kernel).
[0122] The application layer may include a series of application packages.
[0123] As Figure 3b shown, the application packages may include a gallery, a map, a navigation, music, videos, games, chat, shopping, intelligent travel, etc. Intelligent travel can be used to connect to a vehicle head unit to implement the functions of an intelligent cockpit (super desktop). It mainly determines whether the applications in the super desktop support display in the parallel vision mode through a configuration file, and is also responsible for implementing the logic of maximizing the application display as parallel vision when the application in the super desktop is maximized. Of course, the application layer may also include Figure 3b other application programs other than the applications shown, for example, a camera, a calendar, a call, WLAN, Bluetooth, short messages, etc., which are not elaborated one by one in the embodiments of this application.
[0124] The application framework layer provides application programming interfaces (Application Programming Interface, API) and programming frameworks for the application programs in the application layer. The application framework layer includes some predefined functions.
[0125] As Figure 3bAs shown in the figure, the application framework layer may include a vehicle-mounted middleware platform, a MagicWindowService module, an EasyGo service module, a multi-window framework module, a System Server module, a Package Manager Service (PMS) module, etc. Of course, the application framework layer may also include other modules, such as an Activity Manager Service (AMS) module, a Window Manager Service (WMS) module, a CameraService module, a content provider, a view system, a telephone manager, a resource manager, a notification manager, etc., which will not be elaborated one by one in the embodiments of this application.
[0126] The vehicle-mounted middleware platform is a customized service for the software system and runs in the system service. Its main function is to provide a basic framework for realizing connection functions, screen mirroring functions, audio stream transfer functions, device virtualization functions, etc. in vehicle-machine interconnection.
[0127] Please refer to the attached Figure 3c , Figure 3c which shows the software structure block diagram of each module in the application framework layer. As Figure 3c shown, the vehicle-mounted middleware platform may include: a connection service module, a screen mirroring service module, an audio stream transfer module, a device virtualization module, etc. Among them, the connection service module can be used to realize the communication connection between the electronic device 300 and the vehicle-mounted device, the screen mirroring service module can be used to realize the screen mirroring from the electronic device 300 to the vehicle-mounted device, and the audio stream transfer module can be used to realize the transmission of audio data between the electronic device 300 and the vehicle-mounted device.
[0128] The MagicWindowService module is a customized service for the software system, that is, the MagicWindowService layer, and runs in the system service. Its main function is to encapsulate a series of policy interfaces by combining multiple data modules inside the service, embed a piling process in the processes of starting, managing, and displaying Activities in the native application framework layer, execute the policies of the MagicWindow management service, and provide a basic framework for each application to realize the MagicWindow function. The MagicWindowService layer can be used to process the display logic of applications on the virtual screen, including application display mode switching, window size and position calculation, window visibility, etc.
[0129] Among them, the piling process refers to the code used to replace associated code or unimplemented code, that is, writing or generating stub code. One of the uses of the piling process is to set the behavior of the code related to the policies of the MagicWindow management service during testing to meet the test requirements.
[0130] As Figure 3cAs shown in the figure, the Parallel Horizon service (MagicWindowService) module may include: the Parallel Horizon service interface layer, the window policy module, the split-screen manager, the drag-and-drop management module, the full-screen switching module, etc. Among them, the Parallel Horizon service interface layer is used to provide various interfaces for the Parallel Horizon service. The window policy module is responsible for the display mode and state changes of the window. The window policy module may include the navigation mode (A1An), the shopping mode (AnAn), EasyGo customization, and the single window mode.
[0131] Specifically, the Parallel Horizon service interface layer may include the Parallel Horizon message management (MagicWindowManagerEx) module, the Parallel Horizon management service (MagicWindowManagerService) module, and the Parallel Horizon management (MagicWindowManager) module. The Parallel Horizon message management module, as an interface, processes the distribution of operation request messages for the Parallel Horizon user interface (UI), including the maximize operation request message, the minimize operation request message, the operation request message for browsing the content in the UI, etc. The Parallel Horizon management service module can process the messages distributed by the Parallel Horizon message management module and manage the display mode and state changes of the window. The Parallel Horizon management module can be used to implement the implementation logic of the virtual screen and the display logic of the Parallel Horizon.
[0132] The EasyGo service module can be used to scan the easy.json type files in the application to implement the application configuration update. As Figure 3c shown in the figure, the EasyGo service module may include modules such as application scanning, data parsing, data pushing, application broadcasting, basic protocols, and databases.
[0133] The System Server module can implement the function of starting services. The PMS module is mainly responsible for the application management of the Android system. It provides installation, uninstallation, optimization, and query services for various Android Package (APK) files and can be used to implement functions such as application installation / update / uninstallation.
[0134] The multi-window framework module is the technical foundation for Android multi-window technology and is used to implement the management of display windows. As Figure 3c shown in the figure, the multi-window framework module may include modules such as task stack management, stack boundary control, window drag-and-drop, window rotation, focus switching, window size adjustment (Resize), split-screen display (MultiResume), rounded corner display, and camera (Camera) error correction.
[0135] The AMS module is the most core service in Android, mainly responsible for the startup, switching, scheduling of the four major components in the system, as well as the management and scheduling of application programs. The WMS module is used to manage window programs. The WMS module can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The CameraService module can be used to implement the function of camera management.
[0136] The content provider is used to store and obtain data, and make this data accessible to application programs. The data can include videos, images, audio, incoming and outgoing calls, browsing history and bookmarks, phone books, etc.
[0137] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build application programs. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying pictures.
[0138] The telephony manager is used to provide the communication function of the electronic device 100. For example, the management of call states (including answering, hanging up, etc.).
[0139] The resource manager provides various resources for application programs, such as localized strings, icons, pictures, layout files, video files, and so on.
[0140] The notification manager enables application programs to display notification information in the status bar. It can be used to convey notification-type messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as the notification of a background-running application program, and can also be a notification that appears on the screen in the form of a dialogue window. For example, prompt text information in the status bar, emit a prompt sound, the electronic device vibrates, the indicator light flashes, etc.
[0141] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for the scheduling and management of the Android system.
[0142] The core libraries contain two parts: one part is the functional functions that need to be called by the Java language, and the other part is the core libraries of Android.
[0143] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of object life cycles, stack management, thread management, security and exception management, and garbage collection.
[0144] The system library may include multiple functional modules. For example: Surface Manager, Media Libraries, 3D (Three-Dimensional) graphics processing library (such as: OpenGL ES), 2D (Two-Dimensional) graphics engine (such as: SGL), etc.
[0145] The Surface Manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
[0146] The Media Libraries support the playback and recording of multiple common audio and video formats, as well as static image files, etc. The Media Libraries can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0147] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.
[0148] The 2D graphics engine is a drawing engine for 2D drawing.
[0149] The kernel layer is the layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.
[0150] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0151] The following details the specific process of the display method provided by the embodiments of the present application.
[0152] The display method provided by the embodiments of the present application can be applied to a system including a first electronic device and a second electronic device, and the first electronic device and the second electronic device are communicatively connected. The first electronic device and the second electronic device can be electronic devices having a hardware structure as shown in Figure 3a and a software structure as shown in Figure 3b 、 Figure 3c or electronic devices with similar hardware structures and software structures with more or fewer components than shown in the figure, or combining certain components, or splitting certain components, or having different component arrangements, etc.
[0153] Taking the scenario where the first electronic device is a mobile phone, the second electronic device is a car head unit, and the display interface is maximized as an example, the display method provided by the embodiments of the present application will be described in detail. Multiple applications are installed in the mobile phone, and some or all of these applications support the parallel vision mode (i.e., support the split-screen function within the application), and the car head unit has a display screen.
[0154] Refer to the accompanying Figure 4 , Figure 4 FIG. shows a flowchart of the display method provided by an embodiment of the present application, and this method may include steps S401-S407.
[0155] S401: The mobile phone (as an example of the first electronic device) establishes a communication connection with the car head unit (as an example of the second electronic device).
[0156] In the embodiments of the present application, the mobile phone and the car head unit may establish a communication connection through a short-range wireless communication method such as Bluetooth or WiFi. Specifically, the car head unit may send a connection request to the mobile phone via Bluetooth or WiFi, and the mobile phone may establish a Bluetooth connection or a WiFi connection with the car head unit in response to this connection request. The specific process of establishing a Bluetooth connection or a WiFi connection is not elaborated in the embodiments of the present application.
[0157] It should be noted that the above implementation method of connecting through Bluetooth or WiFi is only an example. In some embodiments, other wireless communication methods may also be used to establish a communication connection, or a wired communication method may be used to establish a communication connection. The embodiments of the present application do not make specific limitations on this.
[0158] In the embodiments of the present application, when the mobile phone and the car head unit establish a communication connection, it may first be determined whether the mobile phone supports the parallel vision function. If the mobile phone supports the parallel vision function, a virtual container (MagicVirtualContainer) may be created based on a pre-configured application profile, and some parameters required for subsequent applications to start in parallel vision may be initialized correspondingly in the constructor of the virtual container.
[0159] Specifically, in combination with reference to the accompanying Figure 5 , Figure 5 FIG. shows a flowchart of creating and releasing a virtual container provided by an embodiment of the present application. As Figure 5As shown, when the mobile phone establishes a communication connection with the in-vehicle unit in step S501, the intelligent travel module located in the mobile phone application layer can determine whether the current mobile phone supports the parallel vision function. Specifically, the intelligent travel module can read the configuration item pre-stored regarding whether the mobile phone supports the parallel vision function, and determine whether the current mobile phone supports the parallel vision function according to the data of the read configuration item. For example, assuming that the configuration item being 1 indicates that the mobile phone supports the parallel vision function, and assuming that the configuration item being 0 indicates that the mobile phone does not support the parallel vision function. Then, when the configuration item read by the intelligent travel module is 1, it can be determined that the mobile phone supports the parallel vision function; when the configuration item read by the intelligent travel module is 0, it can be determined that the mobile phone does not support the parallel vision function.
[0160] Specifically, if the parallel vision function is supported, in step S502, the intelligent travel module can call the parallel vision service layer through the notifyMagicWindow() interface to notify the parallel vision service layer that the current connection state is connected. After receiving the interface call, the parallel vision message management module in the parallel vision service layer can, in step S503, call the handleMsgConnState() interface to send the current connection state to the parallel vision management service module to process the current connection state sent by the intelligent travel module. In step S504, the parallel vision management service module can save and record the current connection state. Among them, the notifyMagicWindow() interface has a corresponding return value. The type of the return value is boolean. A return value of true represents that the parallel vision service layer notifies the intelligent travel module that the connection state has been received successfully, and a return value of false indicates failure.
[0161] Since there is no switch control that can be operated by the user in the super desktop scenario, in the embodiments of the present application, whether to enable the parallel vision function of the application can be controlled by the application whitelist. When the return value of the notifyMagicWindow() interface is true, in step S505, the intelligent travel module can send the application configuration file for enabling the parallel vision function to the parallel vision service layer by calling the sendConfigFiles() interface. The parallel vision service layer can perform corresponding initialization operations according to the received application configuration file. This application configuration file is the pre-configured application whitelist. Each application located in the whitelist enables the parallel vision function, and each application not in the whitelist is regarded as not supporting the parallel vision function. This application configuration file can be modified according to actual needs. For example, according to the adaptation degree of the application to the in-vehicle unit display screen, the application can be pulled into or out of the whitelist.
[0162] Specifically, after the parallel vision message management module receives the interface call, it can, in step S506, send the application configuration file to the parallel vision management service module by calling the handleConfigFiles() interface to process the application configuration file sent by the intelligent travel module. For example, in step S507, the parallel vision management service module can send an initialization request to the parallel vision management module so that the parallel vision management module creates a corresponding virtual container (MagicVirtualContainer) according to the application configuration file. In the constructor of the virtual container, corresponding initialization processing will be performed on some parameters required for the subsequent application to start in parallel vision.
[0163] In a possible embodiment, as Figure 5 shown, when it is determined in step S508 that the mobile phone is disconnected from the in-vehicle unit, the intelligent travel module located in the mobile phone application layer can, in step S509, call the parallel vision service layer through the notifyMagicWindow() interface to notify the parallel vision service layer that the current connection state is a disconnection. After the parallel vision message management module in the parallel vision service layer receives the interface call, it can, in step S510, send the current connection state to the parallel vision management service module by calling the handleMsgConnState() interface to process the current connection state sent by the intelligent travel module. In step S511, the parallel vision management service module can send a release request to the parallel vision management module so that the parallel vision management module releases the corresponding virtual container.
[0164] The process of creating and releasing the virtual container is introduced in detail above. Next, return to step S402 to continue describing the display method provided by the embodiment of the present application.
[0165] S402: The in-vehicle unit starts the super desktop mode (as an example of the preset mode), and displays the music application small window interface (as an example of the first interface) in the super desktop mode. The music application small window interface includes a small window display window (as an example of the first display window), and the small window display window is used to display the music playing interface (as an example of the first application interface) of the "Music" application (as an example of the target application).
[0166] In the embodiments of the present application, the interface size of the music application small window interface can be smaller than the size of the in-vehicle display screen, that is, the first interface is a small window display. The music application small window interface may include a small window display window, and the size of the small window display window can be the same as the size of the music application small window interface, that is, the small window display window fills the entire area of the music application small window interface. The size of the small window display window can also be smaller than the size of the music application small window interface, that is, the small window display window only occupies a part of the area of the music application small window interface. The small window display window can be used to display the music playing interface of the "Music" application.
[0167] In the embodiments of the present application, the first application interface can be a non-home page interface of the target application, such as the details interface corresponding to the home page of the target application. Alternatively, the first application interface can also be the home page interface of the target application. The target application can be any application installed on the mobile phone that supports the parallel vision function, such as third-party applications such as video playback applications (such as "Douyin"), news and information applications (such as "Toutiao"), and music playback applications (such as "Music").
[0168] It should be noted that in the embodiments of the present application, the "Music" application is used as an example of the target application, and the playing interface of a specific music, such as the interface showing the record cover or lyrics, and the operation buttons, is used as an example of the first application interface. However, the present application is not limited thereto. In some embodiments, the first application interface can also be a music search interface, or the home page interface of the "Music" application, etc.
[0169] In the embodiments of the present application, after the in-vehicle device establishes a communication connection with the mobile phone, the user can enter "Settings > Super Terminal > Super Desktop" on the mobile phone to turn on the switch of the super desktop. Bring the mobile phone close to the in-vehicle device. Enter "All Applications > Super Desktop" on the in-vehicle device, and Super Desktop will automatically detect the connectable mobile phone. Click on the connectable mobile phone to establish a connection. After the connection is successful, the in-vehicle device starts the super desktop. When the user clicks on the "Music" application icon in the super desktop, the in-vehicle device can open the "Music" application in a small window mode through the virtual screen and display the home page interface of the "Music" application. When the user performs an operation to browse the information on the home page interface, such as clicking to play a certain music, the in-vehicle device can display the corresponding music playing interface.
[0170] In practical applications, after the in-vehicle infotainment system (IVI) establishes a communication connection with the mobile phone, the mobile phone can use the heterogeneous screen mirroring technology to project the screen to the IVI, so that the "Music" application can be launched in a small window mode onto the virtual screen of the IVI. Specifically, in the super desktop mode, the IVI can obtain the user's launch operation for the "Music" application, and in response to this launch operation, send an application launch message for the "Music" application to the mobile phone. The mobile phone obtains the application launch message sent by the IVI, and in response to this application launch message, can create a virtual screen corresponding to the "Music" application, and generate a music application small window interface for displaying the home page interface of the "Music" application based on the screen size of the virtual screen. The mobile phone can output the control data of this music application small window interface (as an example of the fifth control data) to the IVI, and this control data can be used to control the IVI to display the home page interface of the "Music" application on the display screen.
[0171] Specifically, the IVI can also obtain the user's operation of playing a certain piece of music, and in response to this operation, send a music play operation message for the "Music" application to the mobile phone. The mobile phone obtains the music play operation message sent by the IVI, and in response to this music play operation message, can generate a music application small window interface for displaying the music play interface of the "Music" application based on the screen size of the virtual screen of the "Music" application. The mobile phone can output the control data of this music application small window interface (as an example of the fifth control data) to the IVI, and this control data can be used to control the IVI to display the music play interface of the "Music" application on the display screen.
[0172] Exemplarily, Figure 6a shows a schematic diagram of launching an application in a small window mode provided by an embodiment of the present application. As Figure 6a shown, in the super desktop 600 of the IVI, application icons installed in the mobile phone can be displayed. When the user clicks on the "Music" application icon 601 in the super desktop 600, the IVI can respond to the user's click operation on the application icon 601, open the "Music" application and display the home page interface 610 of the "Music" application. The home page interface 610 may include play controls 602 for playing music. When the user clicks on the play controls 602, the IVI can respond to the user's click operation on the play controls 602 and display the music play interface 620 of the "Music" application.
[0173] In a possible embodiment, after the IVI launches the super desktop, when the user clicks on the "Music" application icon in the super desktop, the IVI can also directly open the "Music" application in a small window mode through the virtual screen and display the music play interface of the "Music" application. This music play interface can be, for example, the play interface of the music that was being played when the user last closed the "Music" application, etc. The embodiments of the present application do not make specific limitations on this.
[0174] Specifically, when the in-vehicle unit is in the super desktop mode, it can obtain the user's startup operation for the "Music" application and send an application startup message for the "Music" application to the mobile phone in response to the startup operation. The mobile phone obtains the application startup message sent by the in-vehicle unit and, in response to the application startup message, can create a virtual screen corresponding to the "Music" application and directly generate a music application small window interface for displaying the music playback interface of the "Music" application on the virtual screen based on the screen size of the virtual screen. The mobile phone can output control data of the music application small window interface (as an example of the fifth control data) to the in-vehicle unit, and the control data can be used to control the in-vehicle unit to display the music playback interface of the "Music" application on the display screen.
[0175] In the embodiment of the present application, when the mobile phone obtains the application startup message for the "Music" application sent by the in-vehicle unit in the super desktop mode, it can first create a virtual screen corresponding to the "Music" application, and then realize heterogeneous screen mirroring to the in-vehicle unit based on the virtual screen, so that the display screen of the in-vehicle unit can display the content on the virtual screen, while the display screen of the mobile phone does not display the content on the virtual screen.
[0176] Specifically, with reference to the attached Figure 7 , Figure 7 FIG. shows a flowchart of creating and deleting a virtual screen provided by an embodiment of the present application. As Figure 7 shown, when creating a virtual screen corresponding to the "Music" application, in step S701, the intelligent travel module located in the mobile phone application layer can call the parallel vision service layer through the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface to notify the parallel vision service layer of the identifier (DisplayId) and screen size information of the virtual screen corresponding to the "Music" application. Among them, reason represents the operation that the "Music" application needs to perform next (such as entering full screen or exiting full screen), targetDisplayId represents the virtual screen to which the "Music" application needs to be launched, and targetWidth and targetHeight represent the specific screen size of the virtual screen (including width and height parameters).
[0177] After receiving an interface call, the Parallel Horizon message management module in the Parallel Horizon service layer can, in step S702, send the virtual screen information (including the identifier and screen size information of the virtual screen) in the call parameters of the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface to the Parallel Horizon management service module. The virtual container (MagicVirtualContainer) created by the Parallel Horizon management module can be initialized according to the virtual screen information, and based on the screen size of the virtual screen, generate the home page interface or music playback interface for displaying the "Music" application on the virtual screen. It should be noted that the screen size of the virtual screen supported in the embodiments of the present application satisfies that the height of a single window in the Parallel Horizon mode is greater than the width.
[0178] Specifically, in step S703, the virtual container can obtain the identifier (attachDisplayId) of the virtual screen. In step S704, the virtual container can update the measurement standard of the virtual screen (updateDisplayMetrics) according to the screen size information of the virtual screen. In step S705, the virtual container can register an event listener (registerEventListener) to, when a virtual screen creation event is detected, in step S706, generate the interface for the home page interface of the "Music" application or the music playback interface of the "Music" application for the virtual screen by calling the interface generation function createMwUi(targetDisplayId, container).
[0179] In a possible embodiment, when the user closes the "Music" application, the in-vehicle device can, in response to the user's closing operation on the "Music" application, send an application closing message to the mobile phone. After receiving the application closing message sent by the in-vehicle device, the mobile phone can close the "Music" application and delete the virtual screen corresponding to the "Music" application. Figure 7As shown, when deleting the virtual screen corresponding to the "Music" application, in step S707, the intelligent travel module in the mobile phone application layer can be called to the parallel vision service layer through the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId) interface to notify the parallel vision service layer of the identifier of the virtual screen corresponding to the "Music" application. After receiving the interface call, the parallel vision message management module in the parallel vision service layer can, in step S708, send the identifier of the virtual screen in the call parameters of the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface to the parallel vision management service module. The virtual container created by the parallel vision management module can delete the corresponding virtual screen according to the identifier of the virtual screen.
[0180] Specifically, in step S709, the virtual container can adjust the camera in the mobile phone to a state without the influence of parallel vision by calling the function updateCameraRotation(-1). In step S710, the virtual container can delete the virtual screen corresponding to the "Music" application by calling the function setVirtualDisplayId(INVALID_DISPLAY).
[0181] The process of creating and deleting virtual screens is introduced in detail above. Next, return to step S403 to continue describing the display method provided in the embodiment of the present application.
[0182] S403: The in-vehicle device obtains a maximization operation (as an example of the first operation) for the small window interface of the music application, and sends a maximization operation request message (as an example of the first operation request message) to the mobile phone in response to the maximization operation.
[0183] In the embodiment of the present application, when the user performs a maximization operation on the small window interface of the music application, the in-vehicle device can generate a maximization operation request message in response to the maximization operation and send it to the mobile phone. Among them, the maximization operation can be used to maximize the small window interface of the music application to make it enter the full-screen state. The maximization operation for the small window interface of the music application can be an operation such as sliding, clicking, or dragging of the user's finger on the small window interface of the music application, or an operation such as sliding, clicking, or dragging of the user's finger on the maximization operation control in the small window interface of the music application. The finger can be a single finger or multiple fingers, which is not limited here.
[0184] Specifically, the in-vehicle unit can be integrated with an in-vehicle unit output module. When the in-vehicle unit is connected to the mobile phone and in the super desktop mode, when the user starts the "Music" application and clicks the maximize operation control, the in-vehicle unit output module can send a maximize operation request message to the intelligent travel module in the mobile phone to inform the user's operation, and then the intelligent travel module is used to pull up the application to full screen.
[0185] S404: The mobile phone obtains the maximize operation request message sent by the in-vehicle unit.
[0186] In the embodiment of the present application, the mobile phone and the in-vehicle unit can realize data interaction through a pre-established communication connection. For example, the in-vehicle unit can send a maximize operation request message to the mobile phone through a Bluetooth connection or a WiFi connection. Specifically, the in-vehicle unit can send a maximize operation request message to the intelligent travel module in the mobile phone through a Bluetooth connection or a WiFi connection, and the intelligent travel module can receive the maximize operation request message sent by the in-vehicle unit.
[0187] S405: In response to the maximize operation request message, the mobile phone determines the screen size of the virtual screen corresponding to the "Music" application.
[0188] In the embodiment of the present application, the implementation of parallel vision display on the in-vehicle unit is different from that of the mobile phone supporting parallel vision. The super desktop is a virtual screen scenario. When starting an application in the super desktop, the mobile phone and the in-vehicle unit are in a heterogeneous screen mirroring scenario. At this time, the mobile phone uses heterogeneous screen mirroring technology to realize screen mirroring to the in-vehicle unit, so that the small window interface of the music application is displayed on the virtual screen of the in-vehicle unit. Therefore, after the mobile phone obtains the maximize operation request message, it can first determine the screen size of the in-vehicle unit and use the screen size of the in-vehicle unit as the screen size of the virtual screen corresponding to the "Music" application after maximization. Among them, the screen size of the in-vehicle unit can be obtained from the in-vehicle unit side. For example, the maximize operation request message sent by the in-vehicle unit can carry the screen size of the in-vehicle unit. It can also store the screen size of the in-vehicle unit in the database in advance. After the mobile phone obtains the maximize operation request message, it can directly obtain the screen size of the in-vehicle unit from the database. The embodiment of the present application does not make specific limitations on this.
[0189] In the embodiment of the present application, after the intelligent travel module receives the maximize operation request message sent by the in-vehicle unit, it can first call the screen mirroring service module by calling the resizeDisplay() interface. The screen mirroring service module can perform size adjustment (Resize) processing on the virtual screen corresponding to the "Music" application according to the received screen size (including width and height parameters). After the size adjustment is successful, the small window will be displayed in full screen size.
[0190] S406: The mobile phone activates the parallel vision mode and generates a split-screen interface for the music application on the virtual screen (as an example of the second interface) based on the screen size of the virtual screen. The split-screen interface for the music application may include a left display window (as an example of the second display window) and a right display window (as an example of the third display window) for split-screen display, and the left display window and the right display window are respectively used to display the music playback interface and the home page interface (as an example of the second application interface) of the "Music" application.
[0191] In the embodiment of the present application, the interface size of the split-screen interface for the music application may be the same as the size of the display screen of the vehicle-mounted computer, that is, the second interface is full-screen display. The sizes of the left display window and the right display window of the split-screen interface for the music application may be the same or different. The left display window and the right display window may be split vertically or horizontally. In the embodiment of the present application, the horizontal split is taken as an example for description. The left display window and the right display window may occupy all or part of the area of the split-screen interface for the music application. The embodiment of the present application does not specifically limit the positions and sizes of the left display window and the right display window. Preferably, in the parallel vision of the present application, the height of a single window may be greater than the width, that is, the heights of both the left display window and the right display window are greater than the width.
[0192] It should be noted that the above embodiment using the home page interface as the second application interface is only an example. In some embodiments, the second application interface may also be other interfaces of the "Music" application. The second application interface may be the same as or different from the first application interface. The embodiment of the present application does not specifically limit this. For example, the second application interface may also be the same interface as the first application interface, that is, the music playback interface of the "Music" application, or it may also be a music search interface, etc.
[0193] In the embodiment of the present application, after the screen projection service module adjusts the screen size of the virtual screen, the intelligent travel module can be called to the parallel vision service layer through the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface to notify the parallel vision service layer of the identifier (DisplayId) of the virtual screen corresponding to the "Music" application and the adjusted screen size information. After receiving the interface call, the parallel vision message management module in the parallel vision service layer can send the virtual screen information (including the identifier of the virtual screen and the adjusted screen size information) in the call parameters to the parallel vision management service module. The virtual container created by the parallel vision management module can start the parallel vision mode according to the virtual screen information, and generate a virtual screen based on the adjusted screen size of the virtual screen in the parallel vision mode, and simultaneously display the music player interface of the "Music" application and the music application split screen interface of the home page interface. Specifically, when the virtual container monitors the display interface for generating the virtual screen, it can generate the music application split screen interface by calling the interface generation function createMwUi(targetDisplayId, container).
[0194] In practical applications, in the virtual screen scenario, the application framework layer of the mobile phone will create a separate task (Task) for this scenario. Among them, a root task is used to identify the in-vehicle scenario (the in-vehicle scenario is a virtual screen scenario, different from the physical screen scenario of the mobile phone) for customized processing, including window display hierarchy, window visibility, window display mode, etc. The Task of the application itself is used to manage activities (activities).
[0195] Exemplarily, Figure 6b shows a schematic diagram of switching from the small window mode to the parallel vision mode provided by an embodiment of the present application. As Figure 6b shown, the small window display window of the music application small window interface in the super desktop 600 displays the music player interface 620 of the "Music" application. The music application small window interface may further include a maximize operation control 603. When the user clicks the maximize operation control 603, the in-vehicle device can generate and send a maximize operation request message to the mobile phone in response to the user's click operation on the maximize operation control 603. The mobile phone can determine the screen size of the virtual screen corresponding to the "Music" application in response to the maximize operation request message, and start the parallel vision mode, and generate a music application split screen interface of the virtual screen based on the screen size of the virtual screen in the parallel vision mode. The left display window of the music application split screen interface displays the home page interface 610 of the "Music" application, and the right display window displays the music player interface 620 of the "Music" application.
[0196] In a possible embodiment, the mobile phone activates the parallel vision mode, and generates a split-screen interface of the music application for the virtual screen based on the screen size of the virtual screen in the parallel vision mode, which may include: the mobile phone determines whether the "Music" application enables the parallel vision function; if the "Music" application enables the parallel vision function, the mobile phone activates the parallel vision mode, and generates a split-screen interface of the music application for the virtual screen in the parallel vision mode.
[0197] In the embodiment of the present application, since only some applications in the mobile phone support the parallel vision mode display, and only some applications can be better adapted to the in-vehicle parallel vision mode display. Therefore, before the mobile phone activates the parallel vision mode, it can first determine whether the "Music" application enables the parallel vision function. In the case of activation, step S405 is executed to activate the parallel vision mode and generate a split-screen interface of the music application for the virtual screen; in the case of non-activation, the music playback interface of the "Music" application is displayed in the normal full-screen mode. In the normal full-screen mode, the display window for displaying the music playback interface fills the entire area of the super desktop, but the display position and size of the content part in the music playback interface do not change, or the content part in the music playback interface is also stretched to fill the entire area of the super desktop.
[0198] Exemplarily, Figure 6c shows a schematic diagram of switching from the small window mode to the normal full-screen mode provided by an embodiment of the present application. As Figure 6c shown, after the user activates the "Video" application in the super desktop 600, the application in the small window can be replaced. At this time, the small window display window of the small window interface of the video application in the super desktop 600 (as another example of the first interface) can display the video playback interface 630 of the "Video" application, and the small window interface of the video application can also include a maximize operation control 604. When the user clicks the maximize operation control 604, the vehicle-mounted computer can respond to the click operation of the user on the maximize operation control 604, generate and send a maximize operation request message to the mobile phone. The mobile phone can respond to the maximize operation request message and determine the screen size of the virtual screen corresponding to the "Video" application. The mobile phone can also determine that the "Video" application does not enable the parallel vision function, so the mobile phone displays the video playback interface 630 of the "Video" application in the normal full-screen mode. In the normal full-screen mode, the display window for displaying the video playback interface 630 fills the entire area of the super desktop 600, but the display position and size of the video content in the video playback interface 630 do not change.
[0199] Specifically, for the mobile phone to determine whether the "Music" application enables the parallel vision function, it may include: the mobile phone determines whether the "Music" application is recorded in a pre-configured whitelist; if so, it determines that the "Music" application enables the parallel vision function; if not, it determines that the "Music" application does not enable the parallel vision function.
[0200] In the embodiments of the present application, by pre-configuring the whitelist, applications within the whitelist can be supported to be displayed in the parallel vision mode when performing the maximization operation to enter the full-screen of the application. The whitelist can be modified according to actual needs. For example, applications can be added to or removed from the whitelist according to the adaptation degree of the application to the in-vehicle display screen. The detailed content of the whitelist will not be elaborated in this application.
[0201] It should be noted that in the embodiments of the present application, the music playback interface is used as an example of the first application interface for description. However, in actual applications, the first application interface can also be other interfaces of the "Music" application.
[0202] In a possible embodiment, when the user performs the maximization operation to enter the full-screen, some applications cannot directly enter the parallel vision mode from the home page interface and display two application interfaces. Therefore, for this type of application, when the first application interface is a non-home page interface of the application, in-application split-screen display will be performed; when the first application interface is the home page interface of the application, split-screen display will not be performed. Here, it is assumed that the "Music" application is this type of application that cannot directly enter the parallel vision mode from the home page interface and display two application interfaces, and the embodiments of the present application will be described.
[0203] Specifically, if the "Music" application enables the parallel vision function, the mobile phone starts the parallel vision mode and generates a split-screen interface of the music application on the virtual screen based on the screen size of the virtual screen, which may include: if the "Music" application enables the parallel vision function, the mobile phone determines whether the first application interface is a non-home page interface of the "Music" application; if the first application interface is a non-home page interface of the "Music" application, the mobile phone starts the parallel vision mode and generates a split-screen interface of the music application on the virtual screen based on the screen size of the virtual screen. Moreover, the first application interface and the second application interface displayed in the split-screen interface of the music application are different application interfaces. For example, the first application interface can be a non-home page interface of the "Music" application, and the second application interface can be the home page interface of the "Music" application. Specifically, the situation where the first application interface is the home page interface of the "Music" application will be described in detail later.
[0204] S407: The mobile phone outputs control data of the split-screen interface of the music application (as an example of the first control data) to the in-vehicle device, and the control data of the split-screen interface of the music application is used to control the in-vehicle device to display the split-screen interface of the music application on the display screen.
[0205] In the embodiments of the present application, the mobile phone can use the heterogeneous screen mirroring technology to achieve screen mirroring to the in-vehicle infotainment system (IVI). During the screen mirroring process, the control data of the split-screen interface of the music application can be output to the IVI, so as to project the split-screen interface of the music application on the virtual screen to the display screen of the IVI for display. The detailed process of achieving screen mirroring to the IVI will not be elaborated in this application.
[0206] The following will describe in detail the case where the first application interface is the home page interface of the "Music" application.
[0207] Refer to the attached drawings of the specification Figure 8 , Figure 8 which shows a flowchart of a display method provided by another embodiment of the present application. The method may include steps S801 - S807.
[0208] S801: The mobile phone (as an example of the first electronic device) establishes a communication connection with the IVI (as an example of the second electronic device).
[0209] S802: The IVI starts the super desktop mode (as an example of the preset mode), and in the super desktop mode, a small window interface of the music application (as an example of the first interface) is displayed. The small window interface of the music application includes a small window display window (as an example of the first display window), and the small window display window is used to display the home page interface (as an example of the first application interface) of the "Music" application (as an example of the target application).
[0210] In the embodiments of the present application, the small window display window of the small window interface of the music application can be used to display the home page interface of the "Music" application, that is, the first application interface is the home page interface of the target application.
[0211] In the embodiments of the present application, after the IVI is successfully connected to the mobile phone, the IVI starts the super desktop. When the user clicks the "Music" application icon in the super desktop, the IVI can open the "Music" application in a small window mode and display the home page interface of the "Music" application through the virtual screen.
[0212] In practical applications, after the in-vehicle infotainment (IVI) system establishes a communication connection with the mobile phone, the mobile phone can use the heterogeneous screen mirroring technology to project the screen to the IVI system, so that the "Music" application can be launched in a small window mode onto the virtual screen of the IVI system. Specifically, in the super desktop mode, the IVI system can obtain the user's startup operation for the "Music" application and send an application startup message for the "Music" application to the mobile phone in response to the startup operation. The mobile phone obtains the application startup message sent by the IVI system and, in response to the application startup message, can create a virtual screen corresponding to the "Music" application and generate a music application small window interface for displaying the home page interface of the "Music" application based on the screen size of the virtual screen. The mobile phone can output the control data of the music application small window interface (as an example of the fifth control data) to the IVI system, and the control data can be used to control the IVI system to display the home page interface of the "Music" application on the display screen.
[0213] S803: The IVI system obtains a maximization operation for the music application small window interface (as an example of the first operation) and sends a maximization operation request message (as an example of the first operation request message) to the mobile phone in response to the maximization operation.
[0214] S804: The mobile phone obtains the maximization operation request message sent by the IVI system.
[0215] S805: The mobile phone determines the screen size of the virtual screen corresponding to the "Music" application in response to the maximization operation request message.
[0216] S806: The mobile phone starts the parallel vision mode and generates a music application large window interface (as an example of the third interface) for the virtual screen based on the screen size of the virtual screen in the parallel vision mode. The music application large window interface can include a large window display window (as an example of the fourth display window), and the size of the large window display window is larger than the size of the small window display window in the music application small window interface. The large window display window is used to display the enlarged home page interface of the "Music" application.
[0217] In the embodiment of the present application, when the first application interface is the home page interface of the "Music" application, the mobile phone will not perform split-screen display when starting the parallel vision mode, but only enlarge the display size of the home page interface.
[0218] Specifically, when the first application interface is the home page interface of the "Music" application, after the mobile phone starts the parallel vision mode, a large window interface of the music application can be generated based on the screen size of the virtual screen in the parallel vision mode. The interface size of the large window interface of the music application can be the same as the size of the display screen of the in-vehicle computer, that is, the third interface is full-screen display. The large window interface of the music application can include a large window display window, and the large window display window can be located only in a partial area of the large window interface of the music application. Preferably, it can be located in the middle area of the large window interface of the music application. The embodiments of the present application do not specifically limit the position and size of the large window display window in the large window interface of the music application. Preferably, in the parallel vision of the present application, the height of a single window can be greater than the width, that is, the height of the large window display window is greater than the width. The area other than the large window display window in the large window interface of the music application can be displayed as blank.
[0219] In a possible embodiment, before the mobile phone starts the parallel vision mode, it can first determine whether the "Music" application enables the parallel vision function. In the case of determining that the parallel vision function is enabled, it can be determined whether the first application interface is the home page interface of the "Music" application. If the first application interface is the home page interface of the "Music" application, the mobile phone starts the parallel vision mode and generates a large window interface of the music application on the virtual screen based on the screen size of the virtual screen in the parallel vision mode.
[0220] It should be noted that the specific generation method of the third interface is similar to that of the second interface, and reference can be made to Figures 4 to 7 the specific content provided by the embodiments shown, and the embodiments of the present application will not be elaborated here.
[0221] Exemplarily, Figure 9a FIG. shows a schematic diagram of switching from the small window mode to the parallel vision mode provided by another embodiment of the present application. As Figure 9a shown, the small window display window of the music application small window interface in the super desktop 900 displays the home page interface 910 of the "Music" application, and the music application small window interface can also include a maximize operation control 901. When the user clicks the maximize operation control 901, the in-vehicle computer can respond to the click operation of the user on the maximize operation control 901, generate and send a maximize operation request message to the mobile phone. The mobile phone can respond to the maximize operation request message, determine the screen size of the virtual screen corresponding to the "Music" application, and start the parallel vision mode, and generate a large window interface of the music application on the virtual screen based on the screen size of the virtual screen in the parallel vision mode. The large window display window of the large window interface of the music application only occupies the middle partial area of the large window interface of the music application, and displays the enlarged home page interface 910 of the "Music" application.
[0222] S807: The mobile phone outputs control data (as an example of the second control data) of the large window interface of the music application to the vehicle head unit. The control data of the large window interface of the music application is used to control the vehicle head unit to display the large window interface of the music application on the display screen.
[0223] In a possible embodiment, with reference to the accompanying drawings of the specification Figure 10 , the method may further include steps S808 - S810.
[0224] S808: The mobile phone obtains a music search operation (as an example of the second operation) based on the home page interface.
[0225] In the embodiments of the present application, the second operation may be an operation for browsing the content in the home page interface of the "Music" application. For example, it may be a search operation for searching content in the home page interface of the "Music" application, or it may be a viewing operation for viewing the displayed content in the home page interface of the "Music" application, etc. The embodiments of the present application do not specifically limit the type of operation. In the embodiments of the present application, the second operation is taken as an example of a music search operation for illustration, but the present application is not limited thereto. In some embodiments, the second operation may also be a music playback operation, etc.
[0226] In the embodiments of the present application, when the user performs a music search operation for searching content in the home page interface of the "Music" application, for example, when the user performs a click operation on the music search control in the home page interface of the "Music" application, the vehicle head unit may send the position information of the click operation to the mobile phone. The mobile phone may determine the corresponding position information in the virtual screen corresponding to the "Music" application according to the position information of the click operation, and further determine that the user performs a music search operation for searching content in the home page interface of the "Music" application. Among them, the music search operation may be used to search for music of interest in the home page interface of the "Music" application.
[0227] It should be noted that the above - mentioned method of implementing content search by performing a click operation on the music search control is only an example, and the present application does not make specific limitations thereto. In some possible embodiments, the music search operation for searching content in the home page interface of the "Music" application may also be operations such as the user's finger sliding, clicking, or dragging on the home page interface of the "Music" application, or operations such as the user's finger sliding or dragging on the music search control in the home page interface of the "Music" application. The finger may be a single finger or multiple fingers, which is not limited herein.
[0228] In a possible embodiment, the mobile phone may also obtain the voice issued by the user for searching content in the home page interface of the "Music" application, and analyze the voice to determine that the user performs a music search operation for searching content in the home page interface of the "Music" application.
[0229] S809: In response to a music search operation, the mobile phone generates a split-screen interface of the music application on the virtual screen based on the screen size of the virtual screen in the parallel vision mode (as an example of the fourth interface). The split-screen interface of the music application may include a left display window (as an example of the fifth display window) and a right display window (as an example of the sixth display window) for split-screen display, and the left display window and the right display window are respectively used to display the music search interface (as an example of the third application interface) and the home page interface of the "Music" application.
[0230] It should be noted that the interface size of the split-screen interface of the music application may be the same as the size of the display screen of the vehicle-mounted device, that is, the fourth interface is a full-screen display. The sizes of the left display window and the right display window of the split-screen interface of the music application may be the same or different. The left display window and the right display window may be split vertically or horizontally. In this embodiment of the application, the horizontal split is taken as an example for description. The left display window and the right display window may occupy all or part of the area of the split-screen interface of the music application. This embodiment of the application does not specifically limit the positions and sizes of the left display window and the right display window. Preferably, in the parallel vision of this application, the height of a single window may be greater than the width, that is, the heights of both the left display window and the right display window are greater than the width.
[0231] In this embodiment of the application, the third application interface may be a result interface corresponding to the second operation. When the second operation is a search operation for searching for content on the home page interface of the "Music" application, the third application interface may be the music search interface of the "Music" application.
[0232] It should be noted that the above implementation manner taking the music search interface as the third application interface is only an example. In some embodiments, depending on different user operations, the third application interface may also be other interfaces of the "Music" application, and this embodiment of the application does not specifically limit this. Exemplarily, when the second operation is a viewing operation for viewing the display content on the home page interface of the "Music" application, the third application interface may be the content details interface of the "Music" application. For example, when the user performs a viewing operation on a certain music chart on the home page interface of the "Music" application, the third application interface may be the chart details interface of the "Music" application. When the second operation is a playback operation for playing music on the home page interface of the "Music" application, the third application interface may be the music playback interface of the "Music" application.
[0233] Specifically, after the mobile phone obtains a music search operation based on the home page interface, since the display interface is already maximized, there is no need to adjust the screen size of the virtual screen anymore, but instead, the split-screen interface of the music application on the virtual screen can be directly generated based on the screen size of the virtual screen.
[0234] It should be noted that the specific method for generating the fourth interface is similar to that for generating the second interface, and reference can be made to Figures 4 to 7 the specific content provided in the embodiments shown, which will not be elaborated herein in the embodiments of the present application.
[0235] Exemplarily, Figure 9b FIG. shows a schematic diagram of the process of a user performing a music search operation provided by an embodiment of the present application. As Figure 9b shown, the large window display window of the music application large window interface in the super desktop displays the home page interface 910 of the "Music" application after being enlarged, and the music application large window interface may further include a music search control 902. When the user clicks on the music search control 902, the vehicle-mounted device can send the position information of the user's click to the mobile phone, and the mobile phone can determine the corresponding position information in the virtual screen corresponding to the "Music" application based on this position information, and further determine that the user performs a click operation on the music search control 902, that is, the mobile phone can obtain the music search operation performed by the user. The mobile phone can, in response to the music search operation performed by the user, generate a split-screen interface of the music application for the virtual screen based on the screen size of the virtual screen in the parallel vision mode. The left display window of the split-screen interface of the music application displays the home page interface 910 of the "Music" application, and the right display window displays the music search interface 920 of the "Music" application.
[0236] S810: The mobile phone outputs control data (as an example of the third control data) of the split-screen interface of the music application to the vehicle-mounted device, and the control data of the split-screen interface of the music application is used to control the vehicle-mounted device to display the split-screen interface of the music application on the display screen.
[0237] It should be noted that for the specific content in steps S801 to S807, and steps S808 to S810 in the embodiments of the present application, reference can be made to Figure 4 the relevant content in steps S401 to S407 in the embodiments shown, which will not be elaborated herein in the embodiments of the present application.
[0238] Next, taking the scenario of reducing the display interface as an example, the display method provided by the embodiments of the present application will be described in detail.
[0239] Refer to the attached Figure 11 , Figure 11 FIG. shows a flowchart of a display method provided by another embodiment of the present application, and the method may include steps S1101 - S1107.
[0240] S1101: The mobile phone (as an example of the first electronic device) establishes a communication connection with the vehicle-mounted device (as an example of the second electronic device).
[0241] S1102: The in-vehicle unit starts the super desktop mode (as an example of a preset mode), and displays a split-screen interface of the music application (as an example of the second interface or the fourth interface) in the super desktop mode.
[0242] S1103: The in-vehicle unit obtains a reduction operation for the split-screen interface of the music application (as an example of the third operation), and sends a reduction operation request message (as an example of the third operation request message) to the mobile phone in response to the reduction operation.
[0243] In the embodiments of the present application, when the user performs a reduction operation on the split-screen interface of the music application, the in-vehicle unit can generate a reduction operation request message in response to the reduction operation and send it to the mobile phone. Among them, the reduction operation can be used to reduce the split-screen interface of the music application to exit the full-screen state. The reduction operation for the split-screen interface of the music application can be an operation such as sliding, clicking, or dragging of the user's finger on the split-screen interface of the music application, or an operation such as sliding, clicking, or dragging of the user's finger on the reduction operation control in the split-screen interface of the music application. The finger can be a single finger or multiple fingers, which is not limited herein.
[0244] Specifically, when the in-vehicle unit is connected to the mobile phone and in the super desktop mode, when the user clicks the reduction operation control in the interface displayed in the parallel vision mode, the in-vehicle unit module in the in-vehicle unit can send a reduction operation request message to the intelligent travel module in the mobile phone to inform the user's operation, and then the intelligent travel module is used to exit the application full screen.
[0245] S1104: The mobile phone obtains the reduction operation request message sent by the in-vehicle unit.
[0246] S1105: The mobile phone adjusts the screen size of the virtual screen corresponding to the "Music" application in response to the reduction operation request message.
[0247] In the embodiments of the present application, after the mobile phone obtains the reduction operation request message, it can first adjust the screen size of the virtual screen, and adjust the screen size of the virtual screen from the screen size of the in-vehicle unit to a preset size, as the screen size of the virtual screen corresponding to the "Music" application after reduction. Among them, the preset size can be set according to actual needs. For example, it can be set to be the same as the screen size of the initial virtual screen when the "Music" application is started. The embodiments of the present application do not make specific limitations on this.
[0248] In the embodiments of the present application, after the intelligent travel module receives the reduction operation request message sent by the in-vehicle unit, it can first call the screen mirroring service module by calling the resizeDisplay() interface. The screen mirroring service module can perform Resize processing on the virtual screen corresponding to the "Music" application according to the received screen size (including width and height parameters). After the Resize is successful, the full-screen state will be exited.
[0249] S1106: The mobile phone exits the parallel vision mode and generates a small window interface of the music application on the virtual screen based on the adjusted screen size of the virtual screen (as an example of the fifth interface). The small window interface of the music application may include a small window display window (as an example of the seventh display window), and the small window display window may be used to display the music playing interface (as an example of the first application interface) or the music search interface (as an example of the third application interface) of the "Music" application.
[0250] In the embodiments of the present application, the interface size of the small window interface of the music application may be smaller than the size of the in-vehicle display screen, that is, the fifth interface is a small window display. The size of the small window display window may be the same as the size of the small window interface of the music application, that is, the small window display window fills the entire area of the small window interface of the music application. The size of the small window display window may also be different from the size of the small window interface of the music application, that is, the small window display window may be located only in a partial area of the small window interface of the music application. The embodiments of the present application do not specifically limit the position and size of the small window display window in the small window interface of the music application.
[0251] Specifically, in the case where the reduction operation request message is a reduction operation request message for the second interface, the small window display window of the small window interface of the music application may be used to display the music playing interface of the "Music" application; in the case where the reduction operation request message is a reduction operation request message for the fourth interface, the small window display window of the small window interface of the music application may be used to display the music search interface of the "Music" application.
[0252] Different from the parallel vision mode display on the mobile phone, when the mobile phone is in the parallel vision mode display, there is no reduction and exit full screen button in the interface, and there is no scenario of exiting from the parallel vision and returning to the single interface. However, in the embodiments of the present application, a reduction and exit full screen button may be displayed in the display interface, and the user can perform a reduction and exit full screen operation on the display interface based on the reduction and exit full screen button.
[0253] Specifically, after the mobile phone receives the shrink operation request message, the intelligent travel module can call the parallel vision service layer through the updateAppMagicWinStatusInMultiDevice(int reason, int targetDisplayId, int targetWidth, int targetHeight) interface. Different from the maximize operation, a corresponding operation (reason) REASON_EXIT_FULLSCREEN is added for the shrink exit full-screen scenario, which is used to indicate exiting the parallel vision mode. When the parallel vision service layer receives this parameter, it can determine whether the virtual screen corresponding to the "Music" application is in the parallel vision mode. If so, it will call the moveFocusTaskToQuitMagicInVirtual method function to obtain the task on the corresponding virtual screen and let it exit the parallel vision mode.
[0254] Specifically, after the mobile phone exits the parallel vision mode, a small window interface of the music application for the virtual screen can be generated based on the adjusted screen size of the virtual screen. The detailed process of generating the small window interface of the music application is not described in detail in the embodiments of this application.
[0255] S1107: The mobile phone outputs control data of the small window interface of the music application (as an example of the fourth control data) to the vehicle head unit, and the control data of the small window interface of the music application is used to control the vehicle head unit to display the small window interface of the music application on the display screen.
[0256] It should be noted that the specific content of steps S1101 to S1107 in the embodiments of this application can refer to Figure 4 the relevant content in steps S401 to S407 in the embodiments shown, and Figures 8 to 10 the relevant content in steps S801 to S810 in the embodiments shown. The embodiments of this application will not elaborate here.
[0257] Next, Figure 12 a display method provided by another embodiment of this application will be described in detail.
[0258] The display method provided by the embodiments of this application can be applied to a first electronic device, and the first electronic device is communicatively connected to a second electronic device. The first electronic device can be an electronic device having a hardware structure as shown in Figure 3a and a software structure as shown in Figure 3b , Figure 3c or an electronic device with a hardware structure and software structure similar to that shown, such as having more or fewer components than shown, or combining certain components, or splitting certain components, or different component arrangements.
[0259] Taking the scenario where the first electronic device is a mobile phone, the second electronic device is a car head unit, and the display interface is maximized as an example, the display method provided by the embodiments of the present application will be described in detail. There are multiple applications installed in the mobile phone, and some or all of the applications support the parallel vision mode (i.e., support the split-screen function within the application), and the car head unit has a display screen.
[0260] Referring Figure 12 as shown, Figure 12 The flowchart of the display method provided by another embodiment of the present application is shown, and the method may include steps S1201-S1204.
[0261] S1201: The mobile phone (as an example of the first electronic device) obtains a maximization operation request message (as an example of the first operation request message) sent by the car head unit (as an example of the second electronic device) in the super desktop mode (as an example of the preset mode). The maximization operation request message is sent by the car head unit in response to a maximization operation (as an example of the first operation) on the small window interface of the music application (as an example of the first interface).
[0262] Among them, the small window interface of the music application includes a small window display window (as an example of the first display window), and the small window display window can be used to display the music playing interface (as an example of the first application interface) of the "Music" application (as an example of the target application).
[0263] In the embodiments of the present application, after the car head unit starts the super desktop mode, when the user clicks the "Music" application icon in the super desktop, the car head unit can open the "Music" application in a small window mode through the virtual screen and display the home page interface of the "Music" application. When the user performs an operation to browse the information on the home page interface, such as clicking to play a certain music, the car head unit can display the corresponding music playing interface in the small window interface of the music application. Or, when the user clicks the "Music" application icon in the super desktop, the car head unit can also open the "Music" application in a small window mode through the virtual screen and directly display the music playing interface of the "Music" application in the small window interface of the music application.
[0264] In the embodiments of the present application, after the car head unit starts the super desktop mode, when the user performs a maximization operation on the small window interface of the music application, the car head unit can generate a maximization operation request message in response to the maximization operation and send it to the mobile phone. Among them, the maximization operation can be used to maximize the small window interface of the music application and make it enter the full-screen state. Correspondingly, the mobile phone can receive the maximization operation request message sent by the car head unit.
[0265] S1202: The mobile phone determines the screen size of the virtual screen corresponding to the "Music" application in response to the maximization operation request message.
[0266] S1203: The mobile phone activates the parallel vision mode and generates a split-screen interface of the music application on the virtual screen (as an example of the second interface) based on the screen size of the virtual screen. The split-screen interface of the music application may include a left display window (as an example of the second display window) and a right display window (as an example of the third display window) for split-screen display. The left display window and the right display window are respectively used to display the music playing interface and the home page interface of the "Music" application (as an example of the second application interface).
[0267] In the embodiment of the present application, the interface size of the split-screen interface of the music application may be the same as the size of the display screen of the vehicle-mounted computer, that is, the second interface is full-screen display. The sizes of the left display window and the right display window of the split-screen interface of the music application may be the same or different. The left display window and the right display window may be split vertically or horizontally. In the embodiment of the present application, the horizontal split is taken as an example for description. The left display window and the right display window may occupy all or part of the area of the split-screen interface of the music application. The embodiment of the present application does not specifically limit the positions and sizes of the left display window and the right display window. Preferably, in the parallel vision of the present application, the height of a single window may be greater than the width, that is, the heights of both the left display window and the right display window are greater than the width.
[0268] S1204: The mobile phone outputs control data of the split-screen interface of the music application (as an example of the first control data). The control data of the split-screen interface of the music application is used to control the vehicle-mounted computer to display the split-screen interface of the music application on the display screen.
[0269] It should be noted that the specific contents of steps S1201 to S1204 in the embodiment of the present application may refer to Figure 4 the relevant contents of steps S401 to S407 in the embodiment shown, and the embodiment of the present application will not elaborate herein.
[0270] In addition, in the above embodiment, only the vertical screen split is described. The display method during the horizontal screen split may be the same as the display method during the vertical screen split. For details, reference may be made to the display process during the vertical screen split, which will not be elaborated herein.
[0271] The present application also provides a display system, which includes a first electronic device and a second electronic device. The first electronic device is communicatively connected to the second electronic device, and the second electronic device has a display screen;
[0272] The second electronic device is used to activate a preset mode and display a first interface in the preset mode. The first interface includes a first display window, and the first display window is used to display a first application interface of a target application; in response to a first operation on the first interface, send a first operation request message to the first electronic device; wherein, the first operation includes an operation of maximizing the first interface.
[0273] The first electronic device is configured to obtain a first operation request message sent by a second electronic device; in response to the first operation request message, determine the screen size of a virtual screen corresponding to a target application; start a parallel vision mode, and generate a second interface of the virtual screen based on the screen size of the virtual screen in the parallel vision mode; wherein, the second interface includes a second display window and a third display window that are split-screen displayed, and the second display window and the third display window are respectively configured to display a first application interface and a second application interface of the target application; and, output first control data for controlling the second electronic device to display the second interface on a display screen.
[0274] This application further provides an electronic device, including:
[0275] a memory configured to store instructions executed by one or more processors of the electronic device, and
[0276] a processor, when the processor executes the instructions in the memory, enabling the electronic device to execute each step performed by the first electronic device in the display method shown in the foregoing embodiments, or execute each step performed by the second electronic device in the display method shown in the foregoing embodiments. Figures 4 to 12 shown in the foregoing embodiments, Figures 4 to 12 shown in the foregoing embodiments.
[0277] This application further provides a computer-readable storage medium, on which instructions are stored. When the instructions are run by a processor, the processor is enabled to execute each step performed by the first electronic device in the display method shown in the foregoing embodiments, or execute each step performed by the second electronic device in the display method shown in the foregoing embodiments. Figures 4 to 12 shown in the foregoing embodiments, Figures 4 to 12 shown in the foregoing embodiments.
[0278] This application further provides a computer program product including instructions. When the computer program product runs on an electronic device, the processor is enabled to execute each step performed by the first electronic device in the display method shown in the foregoing embodiments, or execute each step performed by the second electronic device in the display method shown in the foregoing embodiments. Figures 4 to 12 shown in the foregoing embodiments, Figures 4 to 12 shown in the foregoing embodiments.
[0279] Now refer to the accompanying Figure 13 drawings, which shows a block diagram of a System on Chip (SoC) 1300 according to an embodiment of the present application. In Figure 13 the drawings, similar components have the same reference numerals. Additionally, the dashed boxes are optional features of more advanced SoCs. In Figure 13In [the figure], SoC 1300 includes: an interconnect unit 1350, which is coupled to a processor 1310; a system agent unit 1380; a bus controller unit 1390; an integrated memory controller unit 1340; one or a group of one or more coprocessors 1320, which may include integrated graphics logic, an image processor, an audio processor, and a video processor; a Static Random Access Memory (SRAM) unit 1330; and a Direct Memory Access (DMA) unit 1360. In one embodiment, the coprocessor 1320 includes a dedicated processor, such as, for example, a network or communication processor, a compression engine, a GPGPU, a high-throughput MIC processor, or an embedded processor, etc.
[0280] The Static Random Access Memory (SRAM) unit 1330 may include one or more tangible, non-transitory computer-readable storage media for storing data and / or instructions. Instructions may be stored in the computer-readable storage media, specifically, temporary and permanent copies of the instructions may be stored. The instructions may include: when executed by at least one unit in the processor, causing the Soc 1300 to execute the display method according to the above embodiments. Specifically, reference may be made to the method shown in the above embodiments Figures 4 to 12 as shown, which will not be elaborated here.
[0281] Embodiments of the mechanisms disclosed in this application may be implemented in hardware, software, firmware, or combinations of these implementation methods. Embodiments of this application may be implemented as a computer program or program code executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memories and / or storage elements), at least one input device, and at least one output device.
[0282] The program code may be applied to the input instructions to perform the various functions described in this application and generate output information. The output information may be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a Digital Signal Processor (DSP), a microcontroller, an Application Specific Integrated Circuit (ASIC), or a microprocessor.
[0283] The program code may be implemented in a high-level procedural language or an object-oriented programming language to communicate with the processing system. When needed, the program code may also be implemented in assembly language or machine language. In fact, the mechanisms described in this application are not limited to the scope of any specific programming language. In any case, the language may be a compiled language or an interpreted language.
[0284] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more transitory or non-transitory machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, the instructions may be distributed via a network or via other computer-readable media. Thus, machine-readable media may include any mechanism for storing or transmitting information in a machine-readable form (e.g., for a computer), including but not limited to, floppy disks, optical disks, optical discs, compact disc read only memories (CD-ROMs), magneto-optical disks, read only memories (ROMs), random access memories (RAM), erasable programmable read only memories (EPROMs), electrically erasable programmable read only memories (EEPROMs), magnetic or optical cards, flash memory, or tangible machine-readable memories for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) in electrical, optical, acoustic, or other forms via the Internet. Thus, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a machine-readable form (e.g., for a computer).
[0285] In the drawings, some structural or method features may be shown in a particular arrangement and / or order. However, it should be understood that such a particular arrangement and / or ordering may not be required. Rather, in some embodiments, these features may be arranged in a different manner and / or order than shown in the accompanying drawings of the specification. Additionally, the inclusion of a structural or method feature in a particular figure does not imply that such a feature is required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.
[0286] It should be noted that each unit / module mentioned in the device embodiments of the present application is a logical unit / module. Physically, a logical unit / module can be a physical unit / module, a part of a physical unit / module, or can be implemented by a combination of multiple physical units / module. The physical implementation manner of these logical units / modules themselves is not the most important. The combination of the functions implemented by these logical units / modules is the key to solving the technical problems proposed by the present application. In addition, in order to highlight the innovative part of the present application, the above device embodiments of the present application do not introduce units / modules that are not closely related to solving the technical problems proposed by the present application, which does not mean that there are no other units / modules in the above device embodiments.
[0287] It should be noted that in the examples and descriptions of the present application, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising one" does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.
[0288] Although the present application has been illustrated and described by reference to certain preferred embodiments thereof, those of ordinary skill in the art should understand that various changes can be made in form and detail without departing from the spirit and scope of the present application.
Claims
1. A display method, applied to a first electronic device, the first electronic device being communicatively connected to a second electronic device, the second electronic device having a display screen, characterized in that, The method includes: The first electronic device obtains a first operation request message sent by the second electronic device in a preset mode, where the first operation request message is sent by the second electronic device in response to a first operation on a first interface; wherein, the first interface includes a first display window for displaying a first application interface of a target application, and the first operation includes an operation of maximizing the first interface; The first electronic device determines the screen size of a virtual screen corresponding to the target application in response to the first operation request message; The first electronic device activates the parallel horizon mode and generates a second interface of the virtual screen based on the screen size in the parallel horizon mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used for displaying the first application interface and a second application interface of the target application; The first electronic device outputs first control data for controlling the second electronic device to display the second interface on the display screen.
2. The method according to claim 1, wherein The first electronic device activates the parallel horizon mode and generates a second interface of the virtual screen based on the screen size in the parallel horizon mode, including: The first electronic device determines whether the target application enables the parallel horizon function; If the target application enables the parallel horizon function, the first electronic device activates the parallel horizon mode and generates a second interface of the virtual screen based on the screen size in the parallel horizon mode.
3. The method according to claim 2, wherein The first electronic device determines whether the target application enables the parallel horizon function, including: The first electronic device determines whether the target application is recorded in a pre-configured whitelist; If so, it is determined that the target application enables the parallel horizon function; If not, it is determined that the target application does not enable the parallel horizon function.
4. The method according to claim 2, wherein The "If the target application enables the parallel horizon function, the first electronic device activates the parallel horizon mode and generates a second interface of the virtual screen based on the screen size in the parallel horizon mode" includes: If the target application enables the parallel horizon function, the first electronic device determines whether the first application interface is a non-home page interface of the target application; If the first application interface is a non-home page interface of the target application, the first electronic device activates the parallel horizon mode and generates a second interface of the virtual screen based on the screen size in the parallel horizon mode; and the first application interface displayed in the second interface is different from the second application interface.
5. The method according to claim 4, wherein The method further includes: If the first application interface is a home page interface of the target application, the first electronic device activates the parallel horizon mode and generates a third interface of the virtual screen based on the screen size in the parallel horizon mode; wherein, the third interface includes a fourth display window, and the size of the fourth display window is larger than that of the first display window, and the fourth display window is used for displaying the enlarged first application interface. The first electronic device outputs second control data for controlling the second electronic device to display the third interface on the display screen.
6. The method according to claim 5, wherein The method further includes: In response to a second operation based on the first application interface, the first electronic device generates a fourth interface of the virtual screen based on the screen size in the parallel vision mode; wherein, the second operation includes an operation for browsing the content in the first application interface; the fourth interface includes a fifth display window and a sixth display window for split-screen display, and the fifth display window and the sixth display window are respectively used for displaying the first application interface and the third application interface of the target application, and the third application interface is a result interface corresponding to the second operation; The first electronic device outputs third control data for controlling the second electronic device to display the fourth interface on the display screen.
7. The method according to claim 6, wherein The second operation includes an operation for searching for content in the first application interface.
8. The method according to claim 6, wherein The second operation includes an operation for viewing the display content in the first application interface.
9. The method according to claim 6, wherein The method further includes: The first electronic device obtains a third operation request message sent by the second electronic device in a preset mode, and the third operation request message is sent by the second electronic device in response to a third operation on the second interface or the fourth interface; wherein, the third operation includes an operation for shrinking the second interface or the fourth interface; In response to the third operation request message, the first electronic device adjusts the screen size of the virtual screen corresponding to the target application; The first electronic device exits the parallel vision mode and generates a fifth interface of the virtual screen based on the adjusted screen size; wherein, the fifth interface includes a seventh display window for displaying the first application interface or the third application interface of the target application; The first electronic device outputs fourth control data for controlling the second electronic device to display the fifth interface on the display screen.
10. The method according to claim 1, wherein The method further includes: After establishing a communication connection with the second electronic device, the first electronic device obtains an application start message for the target application sent by the second electronic device in a preset mode, and the application start message is sent by the second electronic device in response to a start operation on the target application; In response to the application start message, the first electronic device creates a virtual screen corresponding to the target application; The first electronic device generates the first interface of the virtual screen based on the screen size of the virtual screen; The first electronic device outputs fifth control data for controlling the second electronic device to display the first interface on the display screen.
11. A display method, applied to a system including a first electronic device and a second electronic device, the first electronic device being communicatively connected to the second electronic device, the second electronic device having a display screen, characterized in that, The method includes: The second electronic device starts a preset mode and displays a first interface in the preset mode. The first interface includes a first display window for displaying the first application interface of the target application. The second electronic device sends a first operation request message to the first electronic device in response to a first operation on the first interface; wherein, the first operation includes an operation of maximizing the first interface. The first electronic device obtains the first operation request message sent by the second electronic device. The first electronic device determines the screen size of the virtual screen corresponding to the target application in response to the first operation request message. The first electronic device activates the parallel vision mode and generates a second interface of the virtual screen based on the screen size in the parallel vision mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used to display a first application interface and a second application interface of the target application. The first electronic device outputs first control data for controlling the second electronic device to display the second interface on the display screen.
12. A display system, characterized in that, The system includes a first electronic device and a second electronic device, the first electronic device is communicatively connected to the second electronic device, and the second electronic device has a display screen. The second electronic device is configured to activate a preset mode, display a first interface in the preset mode, the first interface includes a first display window for displaying a first application interface of a target application; and send a first operation request message to the first electronic device in response to a first operation on the first interface; wherein, the first operation includes an operation of maximizing the first interface. The first electronic device is configured to obtain the first operation request message sent by the second electronic device; determine the screen size of the virtual screen corresponding to the target application in response to the first operation request message; activate the parallel vision mode and generate a second interface of the virtual screen based on the screen size in the parallel vision mode; wherein, the second interface includes a second display window and a third display window for split-screen display, and the second display window and the third display window are respectively used to display a first application interface and a second application interface of the target application; and output first control data for controlling the second electronic device to display the second interface on the display screen.
13. An electronic device, characterized in that, Comprising: A memory for storing instructions executed by one or more processors of the electronic device. A processor, when the processor executes the instructions in the memory, enables the electronic device to perform each step executed by the first electronic device in the method according to any one of claims 1 to 11, or perform each step executed by the second electronic device in the method according to any one of claims 1 to 11.
14. A computer-readable storage medium, characterized in that, Instructions are stored on the computer-readable storage medium, and when the instructions are executed on a computer, the computer is enabled to perform each step executed by the first electronic device in the method according to any one of claims 1 to 11, or perform each step executed by the second electronic device in the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Self-adaptive interconnection screen projection method for mobile phone and computer terminal
CN110286864A
Electronic equipment, screen projection method thereof and medium
CN114356258A
Enhanced user interface to transfer media content
US20120254793A1
Self-adaptive display method, electronic device, and storage medium
WO2022135144A1
Cited By
Interface management method and device, new energy automobile and storage medium
CN120653352A