Cross-screen transmission method among multiple screens, electronic equipment and storage medium

Abstract

The invention provides a multi-screen cross-screen transmission method, electronic equipment and a storage medium, the method is applied to the field of cross-screen transmission, and the method comprises the following steps: in response to a cross-screen transmission operation on a target application, creating a virtual layer corresponding to the target application on a first display screen; determining a first part, corresponding to the first display screen, of the application interface and a second part, corresponding to the second display screen, of the application interface based on the interface movement parameters of the application interface; and displaying the virtual picture of the first part on the virtual layer, and displaying the real picture of the second part on the real layer corresponding to the virtual layer. According to the method, during cross-screen transmission, the virtual picture is displayed on one display screen, and the real picture is displayed on the other display screen, so that the transition effect of transmitting the picture between the two display screens is displayed for a user, the smooth transmission of the picture is ensured, and a natural and smooth visual experience is provided for the user.

Description

Technical Field

[0001] The present application relates to the field of cross-screen transmission, and more specifically, to a method, electronic device and storage medium for cross-screen transmission between multiple screens in the field of cross-screen transmission. Background Art

[0002] At present, with the intelligent development of car cockpit systems, in addition to the navigation display screen (central control screen) at the driver's position, the car display screen has also added a co-pilot screen, a ceiling screen on the ceiling of the car, and a rear entertainment screen in the back seat.

[0003] Based on the multiple displays installed in the car, users can realize multi-screen application transmission through multiple displays. Multi-screen application transmission specifically refers to the function of transmitting and displaying applications between multiple displays in the vehicle cabin. This technology allows users to start an application on one display and then move the application to another display through specific operations.

[0004] In a possible implementation, in the related art, when a user transmits a multi-screen application through multiple display screens, the application is transmitted between two display screens without any transition effect, resulting in a poor visual experience for the user.

[0005] Based on the above problems, how to provide users with a good user experience during the multi-screen transmission of applications has become an issue that needs to be solved urgently. Summary of the invention

[0006] The present application provides a method, electronic device and storage medium for cross-screen transmission between multiple screens. The method can, during cross-screen transmission, display a virtual picture on one display screen and a real picture on another display screen to show the user the transition effect when the picture is transmitted between the two display screens, thereby ensuring smooth transmission of the picture and providing the user with a natural and smooth visual experience.

[0007] In a first aspect, a method for cross-screen transmission between multiple screens is provided, the method comprising: in response to a cross-screen transmission operation on a target application, creating a virtual layer corresponding to the target application on a first display screen, the cross-screen transmission operation being used to transmit an application interface of the target application from the first display screen to a second display screen; based on an interface movement parameter of the application interface, determining a first part of the application interface corresponding to the first display screen and a second part corresponding to the second display screen, the interface movement parameter being used to control a movement speed and a movement direction of the application interface during transmission; displaying the virtual picture of the first part on the virtual layer, and displaying the real picture of the second part on a real layer corresponding to the virtual layer.

[0008] In the above technical scheme, during the cross-screen transmission of an application, the present application proposes a method for cross-screen transmission between multiple screens, which is applied to an electronic device. After receiving the cross-screen transmission operation, the electronic device can first create a virtual layer corresponding to the target application on the first display screen. Among them, the cross-screen transmission operation is used to transmit the application interface of the target application from the first display screen to the second display screen. After that, the electronic device determines the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen based on the interface movement parameters of the application interface, and the interface movement parameters are used to control the movement speed and movement direction of the application interface during transmission. The above process can adjust the two parts displayed on the first display screen and the second display screen in real time during the transmission of the application interface. Finally, the virtual picture of the first part is displayed on the virtual layer, and the real picture of the second part is displayed on the real layer corresponding to the virtual layer. The first display screen can be regarded as the original display screen, and the second display screen can be regarded as the target display screen. During the above-mentioned cross-screen transmission process, by displaying the virtual screen of the application interface on the original display screen and the real screen of the application interface on the target display screen, the contents displayed on the two display screens can achieve a good connection effect, allowing users to visually see the real-time changes and updates of the images on the two display screens during the cross-screen process, thereby ensuring the smoothness of the image transmission and bringing users a good cross-screen experience.

[0009] In combination with the first aspect, in some possible implementations, the virtual layer includes a mirror layer or a screenshot layer, which creates a virtual layer corresponding to the target application on the first display screen in response to a cross-screen transmission operation on the target application, including: in response to the cross-screen transmission operation, obtaining the type of the application interface, the type of the application interface is used to indicate whether the application interface changes during the transmission process; when the type of the application interface is dynamic, obtaining the real-time picture of the application interface at the current moment; creating the mirror layer based on the real-time picture; when the type of the application interface is static, obtaining a screenshot of the application interface at the current moment; and creating the screenshot layer based on the screenshot.

[0010] In the above technical solution, when creating a virtual layer, this application provides two different virtual layer creation methods according to the type of application interface. When the application interface is dynamic, the virtual layer is a mirror layer. Since the application interface is dynamic, the displayed content will continue to change. Therefore, by obtaining the real-time picture, the present application can ensure that the virtual picture displayed on the first display screen is always updated in real time, ensuring the consistency of the content displayed on the two display screens. When the application interface is dynamic, the virtual layer is a screenshot layer. Since the content of the static application interface does not change, the demand can be met by taking a screenshot of the screen once. Therefore, the above process does not require the electronic device to continuously capture and process the real-time picture, which reduces the consumption of computing resources and reduces the complexity of data processing.

[0011] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, the interface movement parameter includes at least one of the interface movement rate, the interface movement duration, and the interface movement size, and the step of determining the interface movement parameter includes: determining the type of the cross-screen transmission operation, the type of the cross-screen transmission operation is used to indicate the duration of the cross-screen transmission operation on the target application; when the type of the cross-screen transmission operation is a transient operation, obtaining the interface movement rate or the interface movement duration; when the type of the cross-screen transmission operation is a continuous operation, obtaining the interface movement size.

[0012] In combination with the first aspect and the above-mentioned implementation manner, in some possible implementation manners, before determining the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen based on the interface movement parameters of the application interface, the method also includes: determining the actual transmission time, the initial width and the initial length of the application interface, and the relative position of the first display screen and the second display screen; and the interface movement parameters include the interface movement rate or the interface movement time, and the determination of the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen based on the interface movement parameters of the application interface includes: when the relative position of the first display screen and the second display screen is positive, determining the width of the first part according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; determining the initial length; and determining the initial width. The length is the length of the first part; or, when the relative position of the first display screen and the second display screen is in the forward direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the initial width is determined to be the width of the first part; or, when the relative position of the first display screen and the second display screen is in the oblique direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the width of the first part is determined according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; the width of the second part is determined according to the width of the first part and the initial width; and, the length of the second part is determined according to the length of the second part and the initial length.

[0013] In combination with the first aspect and the above-mentioned implementation manner, in some possible implementation manners, the interface movement parameter includes the interface movement size, and the interface movement size includes the interface movement width and / or the interface movement length: the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen are determined based on the interface movement parameter of the application interface, including: when the relative position of the first display screen and the second display screen is positive, the width of the first part is determined according to the interface movement width and the initial width; the initial length is determined to be the length of the first part; or, when the relative position of the first display screen and the second display screen is positive, the length of the first part is determined according to the interface movement length and the initial length; the initial width is determined to be the width of the first part; or, when the relative position of the first display screen and the second display screen is oblique, the width of the first part is determined according to the interface movement width and the initial width; the length of the first part is determined according to the interface movement length and the initial length; the width of the second part is determined according to the width of the first part and the initial width; and the length of the second part is determined according to the length of the second part and the initial length.

[0014] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, the virtual picture of the first part is displayed on the virtual layer, and the real picture of the second part of the application interface is displayed on the real layer corresponding to the virtual layer, including: displaying the virtual picture of the first part on the virtual layer according to the length of the first part and the width of the first part; displaying the real picture of the second part on the real layer corresponding to the virtual layer according to the length of the second part and the width of the second part.

[0015] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, the method also includes: during the transmission of the application interface, if the continuous operation is detected to be interrupted, determining the current size and continuous operation duration of the application interface on the first display screen; obtaining the actual transmission duration, and the interface movement rate or the interface movement duration during the cross-screen transmission process; and updating the first part and the second part according to the current size, the actual transmission time, the continuous operation duration, and the interface movement rate or the interface movement duration.

[0016] In the above technical solution, during the cross-screen transmission process, if the operation type is a non-transient operation. When the transmission process is not completed but the operation is suddenly interrupted, the electronic device cannot continue to update the first part and the second part according to the user's operation intention. In this case, the electronic device can continue to adjust the first part and the second part according to the actual transmission time, current size, continuous operation time, preset interface movement rate or interface movement time. The above process ensures that the interface remains consistent and coherent after the user operation is interrupted, achieves a good transition effect, avoids sudden interruption of interface transmission, reduces the user's visual sense of discontinuity, and improves the user's experience.

[0017] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, after displaying the virtual picture of the first part on the virtual layer and displaying the real picture of the second part on the real layer corresponding to the virtual layer, the method also includes: when the screen size of the first display screen and the screen size of the second display screen are different, adjusting the second part according to the screen size of the second display screen and the display ratio of the application interface; updating the first part according to the display ratio of the application interface and the screen size of the first display screen.

[0018] In the above technical solution, when the screen sizes of two display screens are different, the electronic device can adjust the size of the partial screen displayed on each display screen based on the screen size of each display screen and the display ratio of the application interface, so that the content displayed on each display screen can be better adapted to the screen size of the current display screen, providing a good visual display effect.

[0019] In a second aspect, a device for cross-screen transmission between multiple screens is provided, and the device includes: a layer creation module, which is used to create a virtual layer corresponding to the target application on a first display screen in response to a cross-screen transmission operation on a target application, and the cross-screen transmission operation is used to transmit the application interface of the target application from the first display screen to the second display screen; a determination module, which is used to determine a first part of the application interface corresponding to the first display screen and a second part corresponding to the second display screen based on an interface movement parameter of the application interface, and the interface movement parameter is used to control the movement speed and movement direction of the application interface during transmission; a picture display module, which is used to display the virtual picture of the first part on the virtual layer, and display the real picture of the second part on the real layer corresponding to the virtual layer.

[0020] In combination with the second aspect, in some possible implementations, the virtual layer includes a mirror layer or a screenshot layer, and the layer creation module is specifically used to: in response to the cross-screen transmission operation, obtain the type of the application interface, and the type of the application interface is used to indicate whether the application interface changes during the transmission process; when the type of the application interface is dynamic, obtain the real-time picture of the application interface at the current moment; create the mirror layer based on the real-time picture; when the type of the application interface is static, obtain a screenshot of the application interface at the current moment; and create the screenshot layer based on the screenshot.

[0021] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the interface movement parameter includes at least one of the interface movement rate, the interface movement duration, and the interface movement size, and the determination module is specifically used to: determine the type of the cross-screen transmission operation, and the type of the cross-screen transmission operation is used to indicate the duration of the cross-screen transmission operation on the target application; when the type of the cross-screen transmission operation is a transient operation, obtain the interface movement rate or the interface movement duration; when the type of the cross-screen transmission operation is a continuous operation, obtain the interface movement size.

[0022] In combination with the second aspect and the above-mentioned implementation manner, in some possible implementation manners, before determining the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen based on the interface movement parameters of the application interface, the determination module is also used to: determine the actual transmission time, the initial width and the initial length of the application interface, and the relative position of the first display screen and the second display screen; and, the interface movement parameters include the interface movement rate or the interface movement time, and the determination module is also used to: when the relative position of the first display screen and the second display screen is positive, determine the width of the first part according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; determine the initial length to be the length of the first part; or, when the first display screen and the second display screen are in the positive direction, determine the initial length to be the length of the first part. When the relative position of the second display screen is in the forward direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the initial width is determined to be the width of the first part; or, when the relative position of the first display screen and the second display screen is in the oblique direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the width of the first part is determined according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; the width of the second part is determined according to the width of the first part and the initial width; and, the length of the second part is determined according to the length of the second part and the initial length.

[0023] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the interface movement parameter includes the interface movement size, and the interface movement size includes the interface movement width and / or the interface movement length; the determination module is also used to: when the relative position of the first display screen and the second display screen is positive, determine the width of the first part according to the interface movement width and the initial width; determine the initial length as the length of the first part; or, when the relative position of the first display screen and the second display screen is positive, determine the length of the first part according to the interface movement length and the initial length; determine the initial width as the width of the first part; or, when the relative position of the first display screen and the second display screen is oblique, determine the width of the first part according to the interface movement width and the initial width; determine the length of the first part according to the interface movement length and the initial length; determine the width of the second part according to the width of the first part and the initial width; and, determine the length of the second part according to the length of the second part and the initial length.

[0024] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the screen display module is specifically used to: display the virtual screen of the first part on the virtual layer according to the length of the first part and the width of the first part; and display the real screen of the second part on the real layer corresponding to the virtual layer according to the length of the second part and the width of the second part.

[0025] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, the device also includes: a first update module, which is used to determine the current size and continuous operation duration of the application interface on the first display screen if the continuous operation is detected to be interrupted during the transmission of the application interface; obtain the actual transmission duration and the interface movement rate or the interface movement duration during the cross-screen transmission process; and update the first part and the second part according to the current size, the actual transmission time, the continuous operation duration, and the interface movement rate or the interface movement duration.

[0026] In combination with the second aspect and the above-mentioned implementation methods, in some possible implementation methods, after displaying the virtual picture of the first part on the virtual layer and displaying the real picture of the second part on the real layer corresponding to the virtual layer, the device also includes a second update module, which is used to adjust the second part according to the screen size of the second display screen and the display ratio of the application interface when the screen size of the first display screen and the screen size of the second display screen are different; and update the first part according to the display ratio of the application interface and the screen size of the first display screen.

[0027] In a third aspect, an electronic device is provided, comprising a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the electronic device executes the method in the first aspect or any possible implementation of the first aspect.

[0028] In a fourth aspect, a computer program product is provided, comprising: a computer program code, which, when executed on a computer, enables the computer to execute the method in the first aspect or any possible implementation of the first aspect.

[0029] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the method in the above-mentioned first aspect or any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1This is a schematic diagram of a multi-screen cross-screen transmission scenario provided by an embodiment of the present application;

[0031] Figure 2 This is another schematic diagram of a multi-screen cross-screen transmission scenario provided by an embodiment of the present application;

[0032] Figure 3 This is a schematic diagram of an interactive scenario of multi-screen cross-screen transmission provided by an embodiment of the present application;

[0033] Figure 4 is a schematic flow chart of a method for multi-screen cross-screen transmission provided by an embodiment of the present application;

[0034] Figure 5 is a schematic diagram of a scenario for determining a first part and a second part provided in an embodiment of the present application;

[0035] Figure 6 is another schematic diagram of a scenario for determining a first part and a second part provided in an embodiment of the present application;

[0036] Figure 7 is another schematic diagram of a scenario for determining a first part and a second part provided in an embodiment of the present application;

[0037] Figure 8 is another schematic diagram of a scenario for determining a first part and a second part provided in an embodiment of the present application;

[0038] Fig. 9 It is a structural schematic diagram of a device for multi-screen cross-screen transmission provided by an embodiment of the present application;

[0039] Fig.10 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0040] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0041] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0042] Before introducing the method of the embodiment of the present application, the professional terms that may be involved in the embodiment of the present application are first explained.

[0043] Cross-screen transmission: is a user interface technology that refers to the ability to move and display applications between multi-screen devices. It allows users to start an application on one display and then move the application to another display to continue displaying through specific operations.

[0044] Mirror Layer: A technique for copying and displaying the contents of another layer in real time in the user interface. It is usually used to create a copy of the same content as the source layer, so that the same content can be displayed in a different location or context. Since the copying process of the mirror layer is real-time, the mirror layer will be updated synchronously with the changes in the content of the source layer.

[0045] Animation: refers to the process of simulating movement or change through a series of continuously changing images. Animation plays a key role in the cross-screen transmission process. It can maintain a series of animation parameters. During the animation execution process, Animation continuously updates these animation parameters and calls the drawing application programming interface (Application Programming Interface, API) to draw the surface.

[0046] Surface Flinger: In the Android system, it is generally called a surface compositor or surface manager. It is responsible for managing and synthesizing the contents of all layers to obtain a final image and display it on the display.

[0047] Window Manager Service (WMS): Responsible for managing the layout, display, and interaction of all application windows.

[0048] After introducing the professional terms that may be involved in the embodiments of the present application, the application scenarios of the embodiments of the present application are introduced below.

[0049] Based on the multiple displays installed in the vehicle, users can achieve cross-screen transmission through multiple displays.

[0050] In one possible implementation, when implementing the cross-screen transmission function in the related technology, the user mainly clicks on the same application icon in two display screens, thereby triggering the running screen of the application to be transmitted from one display screen to another.

[0051] Below through Figure 1 The above cross-screen transmission process is described in detail.

[0052] Figure 1 This is a schematic diagram of a multi-screen cross-screen transmission scenario provided in an embodiment of the present application.

[0053] For example, Figure 1 As shown, it is assumed that the multiple display screens installed in the vehicle include display screen 1 and display screen 2. Among them, application A is installed in both display screen 1 and display screen 2, and icons of application A are displayed in the status bars of display screen 1 and display screen 2 respectively.

[0054] Optionally, the embodiment of the present application does not limit the relative position of display screen 1 and display screen 2. Relative position includes positive and oblique. Among them, the relative position of display screen 1 and display screen 2 is positive, which specifically means that display screen 1 and display screen 2 are arranged in a straight line inside the vehicle and are located in the same horizontal plane or vertical plane. The relative position of display screen 1 and display screen 2 is oblique, which specifically means that the relative position of display screen 1 and display screen 2 inside the vehicle is at a certain angle and is not in the same horizontal plane or vertical plane.

[0055] Figure 1 In the figure, the relative positions of display screen 1 and display screen 2 are taken as the positive direction for illustration.

[0056] like Figure 1 As shown in (a) in FIG. 1 , based on the application A installed in the display screen 1 , the user can configure the application A in the display screen 1 so that the display screen 1 displays the running screen of the application A.

[0057] Optionally, when display screen 1 displays the running screen of application A, the user can select "full screen mode" to display the running screen of application A in the entire display area of ​​display screen 1; or select "non-full screen mode" to display the running screen of application A in part of the display area of ​​display screen 1.

[0058] like Figure 1 As shown in (b), further, based on the icons of application A displayed in the status bars of display screen 1 and display screen 2, when the user needs to realize cross-screen transmission through display screen 1 and display screen 2, he can click the icons of application A in the status bars of display screen 1 and display screen 2 at the same time, thereby controlling the vehicle to start the cross-screen transmission process. During cross-screen transmission, the running screen of the current application A can be migrated from display screen 1 to display screen 2, so that the running screen of application A is displayed on display screen 2, and the running screen of application A is no longer displayed on display screen 1.

[0059] In one case, when display screen 1 displays the running screen of application A in full-screen mode, if cross-screen transmission is required, the user can first control display screen 1 to exit full-screen mode, and then click the icon of application A in the status bar of display screen 1 and display screen 2 at the same time to control the vehicle to achieve cross-screen transmission of the application screen.

[0060] In another case, when display screen 1 displays the running screen of application A in non-full-screen mode, if cross-screen transmission is required, the user can directly click the icon of application A in the status bar of display screen 1 and display screen 2 at the same time to control the vehicle to achieve cross-screen transmission of the application screen.

[0061] like Figure 1 As shown in (b), after the cross-screen transmission is completed, when the vehicle controls the display screen 2 to display the running screen of application A, it can be displayed in "full-screen mode" by default to provide users with a comfortable viewing experience.

[0062] like Figure 1 As shown in (c), the related technology is used to implement the above Figure 1 The interactive block diagram of the cross-screen process shown in (a)-(b) in the figure. The process of implementing cross-screen transmission in the vehicle mainly involves the interaction between the application and the operating system. Specifically: the user clicks on the icon of application A on display screen 1 and display screen 2, the application captures the click operation, generates a cross-screen transmission request and sends the cross-screen transmission request to the window management service (Windows Manager Service, WMS) in the operating system through the application programming interface (Application Programming Interface, API) provided by the operating system. After receiving the cross-screen transmission request, the WMS performs a window moving operation to move the application window from display screen 1 to display screen 2, so that the running screen of application A moves from display screen 1 to display screen 2. Among them, the window moving operation specifically refers to that after the WMS receives the cross-screen transmission request, it will update the configuration information of the window, specifically, according to the screen size of display screen 2, the display size of the screen of application A and other relevant parameters, calculate and set the specific coordinates of the window on display screen 2, so that the window can be better displayed on display screen 2.

[0063] When WMS completes the above process, it will send a notification to Surface Flinger to inform it of the new window configuration information. Surface Flinger resets the position and order of each layer according to the new window configuration information, and synthesizes it with other graphic elements, and finally displays the running screen of application A on display 2.

[0064] In the cross-screen transmission method provided by the above-mentioned related technology, the running screen of application A moves instantaneously when it moves from display screen 1 to display screen 2. This method results in no transition effect in the cross-screen transmission process, and the user cannot perceive how the screen moves during the cross-screen transmission process, resulting in a poor visual experience for the user.

[0065] Based on this, an embodiment of the present application provides a method for cross-screen transmission between multiple screens. During cross-screen transmission, the method can display a virtual picture on one display screen and a real picture on another display screen to show the user the transition effect when the picture is transmitted between the two display screens, thereby ensuring smooth transmission of the picture and providing the user with a natural and smooth visual experience.

[0066] In addition, compared to the related art in which cross-screen transmission can only be triggered by clicking the same application icon in two display screens, the embodiment of the present application can also trigger the start of the cross-screen transmission process through a specific trigger gesture (such as finger sliding).

[0067] Below through Figure 2 , the specific implementation scenarios and implementation principles of the multi-screen cross-screen transmission method provided in the embodiment of the present application are introduced.

[0068] Figure 2 This is a schematic diagram of another scenario of multi-screen cross-screen transmission provided in an embodiment of the present application.

[0069] For example, Figure 2 As shown, during the implementation process of the multi-screen cross-screen transmission method provided in the embodiment of the present application, compared with the related art, a trigger condition for cross-screen transmission is added.

[0070] Optionally, the cross-screen transmission triggering conditions provided in the embodiments of the present application can be triggered by specific triggering gestures, such as sliding a finger on the display screen before cross-screen transmission, in addition to clicking the icon of the same application on two display screens at the same time.

[0071] Optionally, when a finger slide triggers cross-screen transmission, the embodiment of the present application does not limit the number of fingers, and can be a single finger slide or a multi-finger slide. In the following, when introducing the embodiment of the present application, three-finger slide is used as an example for detailed description.

[0072] like Figure 2 As shown in (a), application A is installed in display screen 1. By configuring application A, the user can control display screen 1 to display the running screen of application A in the display area. In order to facilitate the user's viewing, when display screen 1 displays the running screen of application A, the display mode adopted is "full screen display".

[0073] Display screen 1 is the central control screen, and display screen 2 is the co-pilot screen. When the user needs to transfer the running screen of application A from the central control screen to the co-pilot screen, the user can slide three fingers horizontally to the right on display screen 1, or click the icon of application A on display screen 1 and display screen 2 at the same time. The sliding direction during the three-finger sliding process depends on the relative positions of display screen 1 and display screen 2. For example Figure 2As shown in (a) in the figure, since the relative positions of the co-pilot screen and the central control screen are positive, and the co-pilot screen is located on the right side of the central control screen, the sliding direction of the three-finger sliding is horizontally to the right.

[0074] The vehicle responds to the above three-finger sliding operation or clicking operation to start the cross-screen transmission process. Figure 2 As shown in (b), at any moment during the cross-screen transmission process, the vehicle can control display screen 1 to display the left half of the running screen of application A at the current moment, and control display screen 2 to display the right half of the running screen of application A at the current moment. Among them, the left half of the running screen of application A displayed on display screen 1 is a virtual screen, which is described in detail below. Therefore, for the user, in terms of visual effects, it can be intuitively seen that at any moment during the cross-screen transmission process, the left half of the screen of application A displayed on display screen 1 and the right half of the screen of application A displayed on display screen 2 constitute the complete running screen of application A at that moment, so that the user can intuitively see the connection process of the screens displayed on the two display screens during the cross-screen transmission process.

[0075] like Figure 2 As shown in (c), after the cross-screen transmission is completed, display screen 2 can display the complete running screen of application A, while display screen 1 no longer displays the running screen of application A.

[0076] After introducing the general process of the embodiment of the present application, the following introduces a schematic diagram of the interactive scenario of the embodiment of the present application in implementing the above-mentioned cross-screen transmission process.

[0077] Figure 3 This is a schematic diagram of an interactive scenario for cross-screen transmission between multiple screens provided in an embodiment of the present application.

[0078] For example, Figure 3 As shown, reference Figure 1 ,When realizing cross-screen transmission among multiple screens, it mainly relies on the interaction between the ,application and the operating system.

[0079] It should be understood that in order to ensure that a good visual transition effect is provided to users during cross-screen transmission in the embodiment of the present application, the cross-screen transmission process is increased by WMS creating a non-real screen layer of the application and displaying a non-real screen by calling Surface Flinger, as well as executing animation customization and related execution steps of animation execution during application transmission through Animation.

[0080] Based on the two triggering methods for cross-screen transmission provided in the embodiments of the present application, the specific process of implementing cross-screen transmission for the vehicle is different under different triggering methods.

[0081] The first method: The user clicks the same app icon on both displays. Figure 1 In the cross-screen interaction process shown in (c), the embodiment of the present application, at the operating system level, by adding a non-real screen layer, displaying a non-real screen, customizing motion effects during application transmission, and executing related execution programs for motion effects, can ensure that when cross-screen transmission is implemented, the running screen of application A no longer flashes directly from display screen 1 to display screen 2, but presents a transmission process in which the running screen moves slowly.

[0082] The specific interaction process is as follows:

[0083] When the user clicks the same application icon on two display screens at the same time, the application captures the operation, generates a cross-screen transmission request, and sends the cross-screen transmission request to the WMS of the operating system through the API interface provided by the operating system.

[0084] After receiving the cross-screen transmission request, WMS calls Surface Flinger to obtain the running screen of application A displayed on display screen 1, obtains the non-real screen of the running screen, and obtains the transmission parameters corresponding to the Animation cross-screen transmission, and moves the running screen of application A, so that the left half of the non-real screen of the running screen of application A is displayed on display screen 1, and the right half of the real screen of the running screen of application A is displayed on display screen 2.

[0085] In the second method: when the user triggers the cross-screen transmission process by sliding multiple fingers, since this method is a new triggering method added in the embodiment of the present application, in order to accurately monitor the user's multi-finger sliding operation on the display screen 1 during the implementation process, the embodiment of the present application also needs to rely on the Input system in the operating system to implement it.

[0086] like Figure 3 As shown in the figure, the Input system includes several important components for processing events, namely EventHub, Iuput event dispatcher and Input event receiver. Among them, EventHub is mainly responsible for collecting raw input events from different input devices (such as touch screen, keyboard, mouse, etc.); Input event dispatcher is responsible for distributing captured input events to appropriate windows or views. Input event receiver is responsible for receiving input events sent by Input event dispatcher, passing the received events to the event processing logic of the application, and returning the processing results to Input event dispatcher after processing the events.

[0087] The specific cross-screen transmission process is as follows: during the running of the application, the user performs a three-finger sliding operation on display screen 1, and the application detects the click event and sends it to the Input system in the operating system. First, the EventHub in the Input system receives the click event and sends it to the Input event dispatcher, and then the Input event dispatcher sends the click event to the Input event receiver. The Input event receiver sends the click event to the multi-finger sliding listener pre-registered in the application. Thus, the multi-finger sliding listener is called, and the application receives the cross-screen transmission request through the API interface. After the WMS receives the cross-screen transmission request, it calls Surface Flinger to obtain the running screen of application A displayed on display screen 1, obtains the non-real screen of the running screen, and obtains the transmission parameters corresponding to the Animation cross-screen transmission, and moves the running screen of application A, so that the left half of the non-real screen of the running screen of application A is displayed on display screen 1, and the right half of the real screen of the running screen of application A is displayed on display screen 2.

[0088] After introducing the application scenarios and general working principles of the embodiments of the present application, a method for cross-screen transmission between multiple screens provided by the embodiments of the present application is introduced below.

[0089] Figure 4 It is a schematic flow chart of a method for cross-screen transmission between multiple screens provided in an embodiment of the present application. It should be understood that the method can be applied to any cross-screen transmission scenario, and the execution subject of the method can be any electronic device capable of performing cross-screen transmission. In an embodiment of the present application, taking the cross-screen transmission scenario of cross-screen transmission between two display screens in a vehicle as an example, the electronic device is an electronic control unit (Electronic Control Unit, ECU, also called "controller") in the vehicle for controlling at least two display screens, specifically a multimedia controller.

[0090] For example, Figure 4 As shown, the method 400 includes:

[0091] 401 , in response to a cross-screen transmission operation on a target application, creating a virtual layer corresponding to the target application on a first display screen, wherein the cross-screen transmission operation is used to transmit an application interface of the target application from the first display screen to the second display screen.

[0092] The multiple display screens installed in the vehicle generally include the central control screen at the driver's seat, the co-pilot screen at the co-pilot seat, the rear entertainment screen at the rear seat, the ceiling screen, etc. In order to bring users a more convenient and intelligent experience, the multiple display screens can support users to use specific gestures to transmit across screens, thereby realizing the solution process of the embodiment of the present application.

[0093] Specifically, any two of the multiple display screens of the vehicle are recorded as "display screen 1" and "display screen 2". In combination with the above, it can be seen that there are two ways to trigger cross-screen transmission in the embodiment of the present application: clicking the icon of the same application on the two display screens, or sliding three fingers on display screen 1. Therefore, it is not difficult to understand that in order to achieve cross-screen transmission between display screens 1 and 2, the premise is that display screen 1 has a touch function, or display screen 1 and display screen 2 have touch functions at the same time.

[0094] When the above prerequisites are met, the target application is installed on both display screen 1 and display screen 2. In the process of implementing cross-screen transmission, the user can first configure the target application on display screen 1. In response to the configuration operation, the electronic device controls display screen 1 to display the application interface of the target application in the display area. Display screen 1 is the display screen used to display the application interface of the target application before cross-screen transmission, and is recorded as the "first display screen".

[0095] Further, the user triggers the cross-screen transmission process through the cross-screen transmission operation. The electronic device controls the application interface of the target application to be transmitted from display screen 1 to display screen 2. Display screen 2 is the display screen used to display the application interface of the target application after the cross-screen transmission, and is recorded as the "second display screen".

[0096] Optionally, the cross-screen transmission operation may be any one of a click operation and a three-finger sliding operation, which is not limited in the present embodiment of the application.

[0097] Exemplarily, when both display screen 1 and display screen 2 have touch functions, the user can click the icons of the target application on display screen 1 and display screen 2 at the same time to trigger the start of the cross-screen transmission operation process.

[0098] In another example, when display screen 1 has a touch function, the user can control three fingers on display screen 1 to slide along the direction of display screen 2 relative to display screen 1 to trigger the cross-screen transmission operation process to start. For example, when display screen 1 is the central control screen and display screen 2 is the co-pilot screen, the user can control three fingers on display screen 1 to slide horizontally to the right. When display screen 1 is the central control screen and display screen 2 is a ceiling screen, assuming that the ceiling screen is located at the lower right of the central control screen, the user can control three fingers on display screen 1 to slide along the lower right.

[0099] The specific process of determining the first display screen and the second display screen is as follows.

[0100] For example, Figure 3As shown, when the display screen is displayed, each window is associated with a specific display screen. Based on this, WMS can obtain the display screen where the current window is located by querying the properties of the window. In the Android system, each window corresponds to a display (Display) object, which describes the physical or virtual display screen associated with the window. Each display screen corresponds to a unique display identity document (Display ID). Based on this, WMS can use the Display ID to determine the first display screen.

[0101] For the second display screen, when the cross-screen transmission operation is the user clicking on the icons of the target application in the first display screen and the second display screen at the same time, WMS can track the position of each touch point and determine the Display ID of the second display screen based on the position of the touch point. When the cross-screen transmission operation is the user sliding with three fingers, after determining the Display ID of the first display screen, WMS obtains the position change of each contact point during the three-finger sliding process through the Motion Event object, and determines the direction of the three-finger sliding based on the position change of the contact points. Furthermore, WMS can determine the Display ID of the second display screen based on the direction of the three-finger sliding and the relative position between the first display screen and other displays in the vehicle.

[0102] Regardless of any of the above cross-screen transmission operations, when the electronic device receives the cross-screen transmission operation, it can respond to the cross-screen transmission operation, determine the first display screen and the second display screen, and start the cross-screen transmission process.

[0103] It should be understood that in the process of implementing cross-screen transmission, the embodiment of the present application can display a virtual screen of a part of the application interface of the target application on the first display screen, and display a real screen of a part of the application interface of the target application on the second display screen, so that the user can see the screen displayed on the two display screens smoothly during the cross-screen transmission process. Therefore, after receiving the cross-screen transmission operation, the electronic device can first create a virtual layer corresponding to the target application on the first display screen.

[0104] The difference between virtual images and real images will be introduced in detail later.

[0105] Optionally, the virtual layer includes a mirror layer or a screenshot layer.

[0106] A mirror layer is a new layer created by copying the content of a layer. Mirror layers are suitable for scenes where the display content changes dynamically.

[0107] The screenshot layer is a layer that takes a screenshot of the original layer's content at a certain moment and generates a new static layer. The screenshot layer is suitable for scenes that need to display fixed content for a long time.

[0108] When creating a virtual layer corresponding to the target application on the first display screen, the electronic device can choose to create different virtual layers according to the type of application interface.

[0109] In a possible implementation, in response to a cross-screen transfer operation on a target application, creating a virtual layer corresponding to the target application on a first display screen includes:

[0110] In response to the cross-screen transmission operation, obtaining the type of the application interface, where the type of the application interface is used to indicate whether the application interface changes during the transmission process;

[0111] When the type of the application interface is dynamic, obtain the real-time image of the application interface at the current moment; create a mirror layer according to the real-time image;

[0112] When the type of the application interface is static, a screenshot of the application interface at the current moment is obtained; and a screenshot layer is created according to the screenshot.

[0113] For the type of the application interface, the electronic device can determine whether the type of the application interface is dynamic or static by periodically capturing the screen of the application interface and comparing the difference between two adjacent frames. When the difference between the two frames is large, the electronic device can determine that the type of the application interface is dynamic; when the difference between the two frames is small or there is no difference, the electronic device can determine that the type of the application interface is static.

[0114] For the specific virtual layer creation process, please refer to Figure 3 The system structure shown.

[0115] For example, Figure 3As shown, when the type of the application interface is dynamic, when the application side receives the user's three-finger sliding operation event, the operation event is sent to the WMS in the operating system through the API interface. Since the WMS in the Android system is responsible for managing the life cycle of all tasks and windows. Therefore, when WMS receives the operation event, it will use Activity Manager to obtain the top task identity number (top taskIdentity document, top task id) in the current first display screen. The top task id is an identifier used to identify the current foreground task in the Android system. In Android, the information of the top task id is managed and transmitted by WMS. For example, for the first display screen, the current foreground displays the application interface of the target application, then the target application is the foreground task. WMS can obtain the top task id of the current foreground task and send the top task id to Surface Flinger. Specifically, when WMS communicates with Surface Flinger, it can use the Binder mechanism or the Broadcast Receiver mechanism.

[0116] Surface Flinger searches for the corresponding top-level layer, that is, the real-time image, according to the top task id, and calls the createMirrorLayer method to copy the current layer to obtain the mirror layer.

[0117] Similarly, when the application interface type is static, Surface Flinger searches for the corresponding top-level layer, that is, the real-time screen, according to the top task id, and then calls the createScreenshotLayer method to create a new Layer as the screenshot layer.

[0118] In the above technical solution, when creating a virtual layer, this application provides two different virtual layer creation methods according to the type of application interface. When the application interface is dynamic, the virtual layer is a mirror layer. Since the application interface is dynamic, the displayed content will continue to change. Therefore, by obtaining the real-time picture, the present application can ensure that the virtual picture displayed on the first display screen is always updated in real time, ensuring the consistency of the content displayed on the two display screens. When the application interface is dynamic, the virtual layer is a screenshot layer. Since the content of the static application interface does not change, the demand can be met by taking a screenshot of the screen once. Therefore, the above process does not require the electronic device to continuously capture and process the real-time picture, which reduces the consumption of computing resources and reduces the complexity of data processing.

[0119] Thus, through the above process, the electronic device can create a virtual layer.

[0120] 402, based on the interface movement parameters of the application interface, determine the first part of the application interface corresponding to the first display screen and the second part of the application interface corresponding to the second display screen, the interface movement parameters are used to control the movement speed and movement direction of the application interface during transmission.

[0121] In the embodiment of the present application, at each moment when the application interface is transmitted, since the first display screen and the second display screen both display parts of the application interface, the electronic device can calculate the first part of the current application interface on the first display screen and the second part of the application interface on the second display screen for display.

[0122] For example, Figure 3 As shown, after the target application running in the electronic device captures the cross-screen transmission operation, it can send the cross-screen transmission operation to the operating system through the API interface, specifically to the WMS in the operating system. The WMS calculates the interface movement parameters during the application screen movement process. Among them, the interface movement parameters are used to control the movement speed and direction of the application interface during transmission.

[0123] Optionally, the interface movement parameter includes at least one of an interface movement rate, an interface movement duration, and an interface movement size. The interface movement rate and the interface movement duration determine the speed of the application interface during the transmission process and are preset parameters.

[0124] It should be understood that during the cross-screen transmission process, if the user's cross-screen transmission operation is continuous, the electronic device can determine the interface movement parameters according to the user's cross-screen needs. When the cross-screen transmission operation is a click operation, the cross-screen transmission operation is instantaneous in this case, and the cross-screen of the application interface can only rely on the pre-set interface movement parameters. Therefore, when determining the interface movement parameters, the electronic device can specifically obtain the interface movement parameters according to the type of cross-screen transmission operation.

[0125] In a possible implementation, the process of determining the interface movement parameters is as follows:

[0126] Determine the type of the cross-screen transfer operation, where the type of the cross-screen transfer operation is used to indicate the duration of the cross-screen transfer operation on the target application;

[0127] When the cross-screen transmission operation type is a transient operation, the interface movement rate or the interface movement duration is obtained;

[0128] When the cross-screen transfer operation type is a continuous operation, obtain the interface movement size.

[0129] The type of cross-screen transfer operation represents the duration of the cross-screen transfer operation on the target application. When the cross-screen transfer operation is a click operation, the duration of the click operation on the target application can refer to both the duration of the cross-screen transfer operation on the target application on the first display screen and the duration of the click operation on the target application on the second display screen.

[0130] Optionally, the types of cross-screen transmission operations include transient operations and continuous operations.

[0131] Exemplarily, for the type of the cross-screen transmission operation, the electronic device may obtain the duration of the cross-screen transmission operation through the WMS, and determine the type of the cross-screen transmission operation based on the duration.

[0132] For example, the cross-screen transmission operation in the embodiment of the present application includes a click operation or a three-finger sliding operation. For the click operation, it is generally a transient operation, and the user's finger is only in contact with the display screen for a moment. For the three-finger sliding operation, when the sliding speed is faster, it can also be approximately considered that the user's finger and the display screen are in instantaneous contact, similar to the "flying screen or flicking screen" operation. In this case, the type of cross-screen transmission operation is also a transient operation. On the contrary, when the sliding speed is slower, the user's finger and the display screen are in contact for a longer time, and it is a continuous sliding process. In this case, the type of cross-screen transmission operation is a continuous operation.

[0133] For transient operations, the user's finger is in contact with the display screen for a short time, and only at the beginning of the cross-screen transmission. Therefore, the speed of the target application interface transmission during the cross-screen transmission does not depend on the user's operation. For continuous operations, the user's finger is in contact with the display screen for a long time. Therefore, the speed of the application interface transmission during the cross-screen transmission is closely related to the sliding operation.

[0134] When the electronic device determines that the type of the cross-screen transmission operation is a transient operation, a preset interface movement rate or interface movement duration can be obtained.

[0135] For example, in an Android system, the preset interface movement rate or interface delivery time is generally configured in Animation. Therefore, the electronic device can obtain the above interface movement rate or interface movement time through Animation in the operating system.

[0136] When the electronic device determines that the type of cross-screen transmission operation is a continuous operation, since the non-transient operation corresponds to a sliding track during the continuous process. Therefore, in order to match the transmission process with the user's sliding process, the electronic device can first determine the track size generated during the continuous operation, that is, the interface movement size. The electronic device can perform the acquisition of the interface movement size and the determination process of the first part and the second part through the WMS in the operating system.

[0137] Therefore, through the above process, the electronic device can obtain the interface movement parameters of the application interface at the current moment.

[0138] After obtaining the interface movement parameters of the application interface, the electronic device can determine the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen based on the interface movement parameters.

[0139] It should be understood that when the electronic device determines the first part of the application interface corresponding to the first display screen, it essentially determines the size of the first part. Similarly, when the electronic device determines the second part of the application interface corresponding to the second display screen, it essentially determines the size of the second part.

[0140] The process of determining the first part and the second part is different according to the different interface movement parameters.

[0141] In a possible implementation, before determining the first portion of the application interface corresponding to the first display screen and the second portion of the application interface corresponding to the second display screen based on the interface movement parameter of the application interface, the method further includes:

[0142] Determine the actual transmission duration, the initial width and initial length of the application interface, and the relative position of the first display screen and the second display screen;

[0143] And, the interface movement parameter includes an interface movement rate or an interface movement duration, and based on the interface movement parameter of the application interface, determining a first part of the application interface corresponding to the first display screen and a second part corresponding to the second display screen, including:

[0144] When the relative positions of the first display screen and the second display screen are in the positive direction, the width of the first part is determined according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; the initial length is determined as the length of the first part; or,

[0145] When the relative positions of the first display screen and the second display screen are in the positive direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement speed or the interface movement time; the initial width is determined as the width of the first part; or,

[0146] When the relative positions of the first display screen and the second display screen are oblique, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the width of the first part is determined according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time;

[0147] The width of the second portion is determined according to the width of the first portion and the initial width; and the length of the second portion is determined according to the length of the second portion and the initial length.

[0148] The above process is a step for determining the first part and the second part when the interface movement parameter is the interface movement rate or the interface movement duration.

[0149] When determining the first part and the second part, in addition to the interface movement rate or the interface movement duration, the electronic device also needs to determine the current actual transmission duration, the initial width and initial length of the application interface, in order to determine the size of the display interfaces of the two display screens at the current moment. In addition, combined with the above analysis, it can be seen that the relative position of the first display screen and the second display screen will also affect the cross-screen transmission process. Therefore, the electronic device also needs to determine the relative position of the first display screen and the second display screen.

[0150] Exemplarily, the initial width and initial length of the application interface of the target application may be obtained by the WMS in the operating system from the layout parameters of the current window.

[0151] Exemplarily, for the actual transmission duration, when the cross-screen transmission operation starts, the electronic device can obtain the duration of the cross-screen transmission through a built-in timer in the operating system or a custom timer, which is the actual transmission duration.

[0152] Optionally, the relative position of the first display screen and the second display screen includes a positive direction and an oblique direction. As mentioned above, the relative position of the first display screen and the second display screen is a positive direction, which specifically means that the first display screen and the second display screen are arranged in a straight line inside the vehicle and are located in the same horizontal plane or vertical plane. The relative position of the first display screen and the second display screen is an oblique direction, which specifically means that the relative positions of the first display screen and the second display screen inside the vehicle are at a certain angle and are not in the same horizontal plane or vertical plane.

[0153] Exemplarily, for the relative position of the first display screen and the second display screen, after the electronic device determines the respective Display IDs of the first display screen and the second display screen, it can determine the coordinates of the two display screens based on the Display IDs of the two display screens, and determine whether the relative position of the two display screens is forward or oblique based on the coordinates of the two display screens.

[0154] When the type of cross-screen transmission operation is a transient operation and the interface movement parameter is the interface movement rate or the interface movement duration, according to the relative positions of the first display screen and the second display screen, the determination process of the first part and the second part is divided into the following two scenarios.

[0155] Scenario 1: The relative position of the first display and the second display is positive

[0156] Figure 5 It is a schematic diagram of a scenario for determining a first part and a second part provided in an embodiment of the present application.

[0157] For example, Figure 5 As shown in (a), display screen 1 is the first display screen, and display screen 2 is the second display screen. Display screen 1 can be a central control screen, and display screen 2 can be a co-pilot screen. The relative positions of display screen 1 and display screen 2 are positive.

[0158] Based on this, when the cross-screen transfer operation is a transient operation, it means that the user may have clicked the icons of application A on display screen 1 and display screen 2 at the same time, or the user performed a three-finger flying screen operation on display screen 1. In this case, it is assumed that the initial width of the application interface on the first display screen is equal to the screen width of display screen 1, the initial length of the application interface is equal to the screen width of display screen 1, and the screen size of the first display screen is equal to the screen size of the second display screen.

[0159] like Figure 5 As shown in (a), the second display screen is located on the right side of the first display screen, so the translation direction is rightward. During the cross-screen transmission process, the display width of the application interface remains unchanged, only the display length in display screen 1 gradually decreases during the translation process, while the display length in display screen 2 gradually increases during the translation process.

[0160] When determining the size of the first part, when the interface movement parameter is the interface movement duration, based on the interface movement duration and the initial length, the electronic device can determine the transmission rate of the application interface, and then determine the corresponding movement length within the actual transmission duration according to the transmission rate and the actual transmission duration, that is, Figure 5 The length of the first part at the current moment can be obtained by subtracting the initial length from Δa. Since the display width remains unchanged, the width of the first part is also the initial width.

[0161] When the interface movement parameter is the interface movement rate, based on the interface movement rate and the actual transmission time, the electronic device can calculate the corresponding movement length within the actual transmission time, that is, Figure 5The length of the first part at the current moment can be obtained by subtracting the initial length from Δa. Since the display width remains unchanged, the width of the first part is also the initial width.

[0162] After determining the length and width of the first part, in order to achieve the interface connection effect, when the width of the first part is the initial width, the width of the second part is also equal to the width of the first part, which is also equal to the initial width. The length of the second part is the difference between the initial length and the length of the first part, that is, Figure 5 Δa in (a).

[0163] For example, Figure 5 As shown in (b), it is assumed that the screen size of the first display screen is equal to the screen size of the second display screen. Display screen 1 is the first display screen, and display screen 2 is the second display screen. For example, display screen 1 can be the co-pilot screen, display screen 2 can be the rear screen directly behind the co-pilot screen, and the second display screen is located directly behind the second display screen (directly below on the two-dimensional plane). Therefore, the translation direction of the application interface is vertically downward. During the cross-screen transmission process, the display length of the application interface remains unchanged, only the display width in display screen 1 gradually decreases with the translation process, while the display width in display screen 2 gradually increases with the translation process.

[0164] like Figure 5 As shown in (b) in the figure, when calculating the length and width of the first part, when the interface movement parameter is the interface movement duration, based on the interface movement duration and the initial width, the electronic device can determine the transmission rate of the application interface, and then determine the corresponding movement width within the actual transmission duration according to the transmission rate and the actual transmission duration, that is, Figure 5 Δb is shown in (b) in the figure. By subtracting the initial width from Δb, the width of the first part at the current moment can be obtained. Since the display length remains unchanged, the length of the first part is also the initial length.

[0165] When the interface movement parameter is the interface movement rate, based on the interface movement rate and the actual transmission time, the electronic device can calculate the corresponding movement width within the actual transmission time, that is, Figure 5 Δb is shown in (b) in the figure. By subtracting the initial width from Δb, the width of the first part at the current moment can be obtained. Since the display length remains unchanged, the length of the first part is also the initial length.

[0166] After determining the length and width of the first part, in order to achieve the interface connection effect, when the length of the first part is equal to the initial length, the length of the second part is the same as the length of the first part, which is also equal to the initial length. The width of the second part is the difference between the initial width and the width of the first part, that is, Figure 5Δb in (b).

[0167] Scenario 2: The first display screen and the second display screen are in an oblique relative position

[0168] Figure 6 This is another scenario schematic diagram for determining the first part and the second part provided in an embodiment of the present application.

[0169] For example, Figure 6 As shown, it is assumed that the screen size of the first display screen is equal to the screen size of the second display screen. Display screen 1 is the first display screen, and display screen 2 is the second display screen. For example, display screen 1 can be the central control screen, display screen 2 can be the rear screen directly behind the co-pilot screen, and the second display screen is located to the right rear of the first display screen (lower right on the two-dimensional plane). Therefore, the moving direction of the application interface is the lower right. During the cross-screen transmission process, the display length and display width of the application interface in display screen 1 will gradually decrease with the movement process, while the display width and display length in display screen 2 will gradually increase with the movement process.

[0170] like Figure 6 As shown, when determining the length and width of the first part, when the interface movement parameter is the interface movement duration, based on the interface movement duration and the initial length, the electronic device can determine the transmission rate of the application interface, and then determine the corresponding movement length within the actual transmission duration according to the transmission rate and the actual transmission duration, that is, Figure 6 The length of the first part at the current moment can be obtained by subtracting the initial length from Δa.

[0171] Similarly, based on the acquired preset transmission time and initial display width, the electronic device can determine the transmission rate of the application interface, and then determine the corresponding movement width within the actual transmission time according to the transmission rate and the actual transmission time, that is, Figure 6 By subtracting the initial width from Δb, the width of the first part at the current moment can be obtained.

[0172] When the interface movement parameter is the interface movement rate, based on the interface movement rate and the actual transmission time, the electronic device can calculate the corresponding movement length within the actual transmission time, that is, Figure 6 The length of the first part at the current moment can be obtained by subtracting the initial length from Δa.

[0173] Similarly, the electronic device can calculate the corresponding moving width within the actual transmission time, that is, Figure 6 By subtracting the initial width from Δb, the width of the first part at the current moment can be obtained.

[0174] After determining the length and width of the first part, in order to achieve the interface connection effect, the sum of the lengths of the first part and the second part is the initial length, and the sum of the widths of the first part and the second part is the initial width. It is not difficult to conclude that the width of the second part is the difference between the initial width and the width of the first part, that is, Figure 6 The length of the second part is the difference between the initial length and the length of the first part, that is, Figure 6 Δa shown.

[0175] Thus, through the above process, the electronic device can solve the application interface in the first part of the first display screen and the second part of the second display screen when the operation type of the cross-screen transmission operation is a transient operation.

[0176] The following describes the steps for determining the first and second parts when the cross-screen transfer operation type is a continuous operation.

[0177] In a possible implementation, the interface movement size includes an interface movement width and / or an interface movement length: based on the interface movement parameters of the application interface, determining a first portion of the application interface corresponding to the first display screen and a second portion of the application interface corresponding to the second display screen includes:

[0178] When the relative positions of the first display screen and the second display screen are in the positive direction, the width of the first part is determined according to the interface movement width and the initial width; the initial length is determined as the length of the first part; or,

[0179] When the relative positions of the first display screen and the second display screen are in the positive direction, the length of the first part is determined according to the interface movement length and the initial length; the initial width is determined as the width of the first part; or,

[0180] When the relative positions of the first display screen and the second display screen are oblique, the width of the first part is determined according to the interface movement width and the initial width; and the length of the first part is determined according to the interface movement length and the initial length;

[0181] The width of the second portion is determined according to the width of the first portion and the initial width; and the length of the second portion is determined according to the length of the second portion and the initial length.

[0182] Optionally, corresponding to the initial size, the interface movement size also includes at least one of the interface movement length and the interface movement width. When the sliding direction of the three-finger sliding is horizontal, the interface movement size refers to the interface movement length. When the sliding direction of the three-finger sliding is vertical, the interface movement size refers to the interface movement width. When the sliding direction of the three-finger sliding is oblique, the interface movement size includes both the interface movement length and the interface movement width.

[0183] Exemplarily, when the sliding direction of the three-finger sliding is horizontal or vertical, the electronic device can track the touch point through WMS, and obtain the interface movement length or interface movement width by the coordinate difference between the current touch point and the initial touch point in real time. When the sliding direction of the three-finger sliding is oblique, the electronic device can track the touch point through WMS, and obtain the oblique interface movement size by the coordinate difference between the current touch point and the initial touch point. In addition, the electronic device can also calculate the inclination angle of the finger, that is, the angle between the finger and the first display screen, based on the coordinates between any two touch points during the sliding process, and then obtain the two components in the horizontal and vertical directions, that is, the interface movement length and the interface movement width, based on the angle and the oblique interface movement size.

[0184] When the type of the cross-screen transmission operation is a continuous operation and the interface movement parameter is the interface movement size, according to the different relative positions of the first display screen and the second display screen, the specific scenarios of the first part and the second part are divided into the following types.

[0185] Scenario 1: The relative position of the first display and the second display is positive

[0186] Figure 7 This is another scenario schematic diagram for determining the first part and the second part provided in an embodiment of the present application.

[0187] For example, Figure 7 As shown in (a), display screen 1 is the first display screen, and display screen 2 is the second display screen. It is assumed that the screen size of the first display screen is equal to the screen size of the second display screen. Display screen 1 can be a central control screen, and display screen 2 can be a co-pilot screen. It is still assumed here that the initial length is equal to the screen length of display screen 1, and the initial width is equal to the screen width of display screen 1.

[0188] When calculating the length and width of the first part, when the user continuously slides three fingers on the display screen 1, as the sliding process proceeds, the fingers generate a certain sliding track on the display screen 1. The electronic device can calculate the interface movement length during the horizontal sliding process of the fingers, that is, Figure 7 Δa' shown in (a) of FIG. 1 , and then the length of the first part is obtained according to the initial length and Δa'. Since the display width of the application interface remains unchanged during the translation process, the width of the first part is equal to the initial width.

[0189] After determining the length and width of the first part, in order to achieve the interface connection effect, the width of the second part is always equal to the width of the first part, that is, the initial width, while the width of the first part remains unchanged. The length of the second part is the difference between the initial length and the length of the first part, that is, Figure 7 Δa' shown in (a) in FIG.

[0190] For example, Figure 7 As shown in (b) in the figure, it is assumed that the screen size of the first display screen is equal to the screen size of the second display screen. Display screen 1 is the first display screen, and display screen 2 is the second display screen. For example, display screen 1 can be a co-pilot screen, display screen 2 can be a rear screen directly behind the co-pilot screen, and the second display screen is located directly behind the first display screen. Therefore, when three fingers slide continuously, the sliding direction is to slide directly below display screen 1. Therefore, when three fingers slide, the sliding direction is to slide directly below display screen 1. In this case, during the cross-screen transmission process, the display length of the application interface remains unchanged, only the display width in display screen 1 gradually decreases with the translation process, while the display width in display screen 2 gradually increases with the translation process.

[0191] like Figure 7 As shown in (b) in FIG. 1 , when calculating the width and length of the first part, during the continuous sliding of three fingers, the electronic device can calculate the interface movement width during the sliding process, that is, Figure 7 Δb' is shown in (b) in the figure. By subtracting the initial width from Δb', the width of the first part at the current moment can be obtained. Since the display length remains unchanged, the length of the first part is also the initial length.

[0192] After determining the length and width of the first part, in order to achieve the interface connection effect, the length of the second part is always equal to the length of the first part, that is, the initial length, on the basis of the length of the first part remaining unchanged. The width of the second part is the difference between the initial width and the width of the first part, that is, Figure 7 Δb' shown in (b) in FIG.

[0193] Scenario 2: The first display screen and the second display screen are in an oblique relative position

[0194] Figure 8 This is another scenario schematic diagram for determining the first part and the second part provided in an embodiment of the present application.

[0195] For example, Figure 8 As shown, it is assumed that the screen size of the first display screen is equal to the screen size of the second display screen. Display screen 1 is the first display screen, and display screen 2 is the second display screen. For example, display screen 1 can be the central control screen, display screen 2 can be the rear screen directly behind the co-pilot screen, and the second display screen is located to the right rear of the first display screen. Therefore, when sliding with three fingers, the sliding direction is to slide along the lower right side of display screen 1. In this case, during the cross-screen transmission process, the display length and display width of the application interface in display screen 1 will gradually decrease with the sliding process, while the display width and display length in display screen 2 will gradually increase with the sliding process.

[0196] like Figure 8As shown, when determining the length and width of the first part, during the continuous sliding of three fingers, the electronic device can respectively calculate the interface movement width and interface movement length during the sliding process, that is, Figure 8 The Δb' and Δa' shown are shown. The length of the first part at the current moment is obtained by subtracting the initial length from Δa', and the width of the first part at the current moment is obtained by subtracting the initial width from Δb'.

[0197] After determining the length and width of the first part, in order to achieve the interface connection effect, the sum of the lengths of the first part and the second part is the initial length, and the sum of the widths of the first part and the second part is the initial width. It is not difficult to conclude that the width of the second part is the difference between the initial width and the width of the first part, that is, Figure 8 The length of the second part is the difference between the initial length and the length of the first part, that is, Figure 8 Δa' is shown.

[0198] Thus, through the above process, the electronic device can solve the application interface in the first part of the first display screen and the second part of the second display screen when the type of the cross-screen transmission operation is a continuous operation.

[0199] 403 , displaying the first part of the virtual picture on the virtual layer, and displaying the second part of the real picture on the real layer corresponding to the virtual layer.

[0200] After obtaining the first part and the second part through 402, the electronic device can display the virtual image of the first part on the virtual layer based on the size of the first part, and display the real image of the second part on the real layer corresponding to the virtual layer based on the size of the second part.

[0201] In a possible implementation, displaying the first part of the virtual screen on the virtual layer, and displaying the second part of the real screen of the application interface on the real layer corresponding to the virtual layer, includes:

[0202] Displaying a virtual picture of the first part on the virtual layer according to the length of the first part and the width of the first part;

[0203] According to the length of the second part and the width of the second part, a real picture of the second part is displayed on the real layer corresponding to the virtual layer.

[0204] For example, Figure 3As shown, after WMS calculates the length and width of the first part, the length and width of the first part can be sent to the Animation service. After receiving the parameters provided by WMS, the Animation service will use the animation framework (Value Animator) to calculate the animation state of each frame during the cross-screen transmission process, including position, size, and transparency. After obtaining the animation state of each frame, the Animation service will send the calculated animation state to Surface Flinger, which will update the position and size of the mirror layer according to the current animation state, and synthesize the mirror layer and other fixed layers (such as the status bar layer) on the second display screen to obtain the final virtual image.

[0205] Correspondingly, after WMS calculates the length and width of the second part, it can send the length and width of the second part to the Animation service. After receiving the parameters provided by WMS, the Animation service will use the animation framework (Value Animator) to calculate the animation state of each frame during the cross-screen transmission process, including position, size, and transparency. After obtaining the animation state of each frame, the Animation service will send the calculated animation state to SurfaceFlinger, which will update the position and size of the real layer according to the current animation state, and synthesize the real layer and other fixed layers (such as the status bar layer) on the first display screen to obtain the final real picture.

[0206] It should be noted that in the embodiments of the present application, the difference between the real screen and the virtual screen is that the real screen is drawn inside the application, specifically, each frame of the screen drawn by the application according to its logic and data, involving the rendering and graphics drawing processing logic of the user interface (UI) component. The virtual screen is obtained by processing the real screen by Surface Flinger in the operating system, and is not a screen drawn inside the application.

[0207] It should be understood that when the screen size of the first display screen is the same as the screen size of the second display screen, the size of the application interface of the target application displayed on the second display screen does not need to be scaled. When the screen size of the first display screen is not exactly the same as the screen size of the second display screen, when the electronic device displays the real picture on the second display screen, it can further automatically adjust the display size of the real picture based on the screen size of the second display screen to make it better fit the screen size of the second display screen.

[0208] In a possible implementation, after displaying the first portion of the virtual picture on the virtual layer and displaying the second portion of the real picture on the real layer corresponding to the virtual layer, the method further includes:

[0209] When the screen size of the first display screen is different from the screen size of the second display screen, adjusting the second part according to the screen size of the second display screen and the display ratio of the application interface;

[0210] The first part is updated according to the display ratio of the application interface and the screen size of the first display screen.

[0211] For example, Figures 5 to 8 As shown, when the screen sizes of the first display screen and the second display screen are exactly the same, the sizes of the second part are specifically as follows:

[0212] When the relative positions of the first display screen and the second display screen are in the positive direction, in one scenario, the width of the second part is equal to the screen width of the second display screen, that is, the initial width. The length of the second part is equal to the difference between the initial length and the length of the first part. In another scenario, the length of the second part is equal to the screen length of the second display screen, that is, the initial length. The width of the second part is equal to the difference between the initial width and the width of the first part.

[0213] When the first plane and the second plane are in different planes, the length of the second part is equal to the moving length or the trajectory length, that is, the difference between the initial length and the length of the first part; the width of the second part is equal to the moving width or the trajectory width, that is, the difference between the initial width and the width of the first part.

[0214] That is, when the screen size of the first display screen is the same as the screen size of the second display screen, the electronic device can calculate the size of the second part on the second display screen by the size of the first part and the screen size of the original display screen, and the size can be understood as the ideal size of the second part. When the second part is displayed on the second display screen with the size of the second part, it is usually displayed with the above-mentioned ideal size by default, and the ideal size can be understood as the size of the second part before adjustment.

[0215] When the screen sizes of the first display screen and the second display screen are different, both the real picture and the virtual picture need to match the screen size of the respective display screens.

[0216] It should be understood that since the virtual screen is obtained from the real screen, when adjusting the size of the application interface, it is necessary to first adjust the size of the real screen and then further adjust the size of the virtual screen synchronously.

[0217] Specifically, when adjusting the size of the second part, the electronic device can obtain a display ratio of the application interface according to the initial size of the application interface and the screen size of the first display screen. The display ratio includes a length display ratio and a width display ratio.

[0218] Based on the obtained display ratio of the application interface and the screen size of the second display screen, the electronic device can calculate the size corresponding to the application interface when displayed on the second display screen. The display size is the size of the adjusted second part, and finally the electronic device can display the real picture of the second part with the adjusted size of the second part.

[0219] Since the virtual screen is copied and changed in real time with the real screen, after the size of the second part is adjusted, the size of the first part displayed on the first display screen will also be changed to the adjusted size of the second part. Therefore, the electronic device needs to further adjust or update the size of the first part according to the display ratio of the application interface and the screen size of the first display screen.

[0220] In the above technical solution, when the screen sizes of two display screens are different, the electronic device can adjust the size of the partial screen displayed on each display screen based on the screen size of each display screen and the display ratio of the application interface, so that the content displayed on each display screen can be better adapted to the screen size of the current display screen, providing a good visual display effect.

[0221] In addition, when the cross-screen transmission operation is a non-transient operation, that is, the finger continues to slide. When the transmission process is not completed, the user's finger suddenly leaves the first display screen. In order to ensure that the transmission process is not interrupted, the embodiment of the present application also provides further processing measures.

[0222] In a possible implementation manner, the method further includes:

[0223] During the transmission of the application interface, if a continuous operation interruption is detected, determining the current size of the application interface on the first display screen and the continuous operation duration;

[0224] Obtain the actual transmission time, interface movement rate or interface movement time during cross-screen transmission;

[0225] The first part and the second part are updated according to the current size, the actual transmission time, the continuous operation time, and the interface movement speed or the interface movement time.

[0226] Specifically, when the user's finger leaves the first display screen during the cross-screen transmission process, resulting in an interruption of the continuous sliding operation, the electronic device can determine the interruption moment, the current size of the application interface of the first display screen, and the duration of the continuous operation. The current size is the size of the first part at the interruption moment.

[0227] For example, the current size can be obtained through the layout parameters of the window. The duration of the continuous operation can be obtained through the timer built into the operating system.

[0228] When the continuous operation is interrupted, the electronic device cannot continue to adjust the size of the first part based on the interface movement size. In this case, reference can be made to the method for determining the first part under transient operation. The electronic device can dynamically adjust the first part and the second part of the first display screen by the interface movement rate or interface movement duration, actual transmission duration, duration of continuous operation, and current size.

[0229] In combination with the above statements, when the interface movement parameter is the interface movement duration, in the process of updating the first part and the second part, the electronic device can first calculate the corresponding remaining transmission time for continuing to transmit after the continuous operation stops based on the interface movement duration and the duration of the continuous operation. Further, based on the remaining transmission duration and the current size, calculate the transmission rate from the current moment to the end of the transmission process. In the process of updating the first part and the second part, obtain the actual transmission duration, and obtain the transmission duration after the non-transient operation is interrupted by calculating the difference between the actual transmission duration and the duration of the continuous operation. Combine the transmission duration and the transmission rate after the continuous operation is interrupted, and calculate the updated first part and second part.

[0230] For example, Figure 7 As shown in (a), after the interruption operation, the width of the updated first part is still equal to the initial width. The actual transmission duration is subtracted from the duration of the continuous operation to obtain the transmission duration after the continuous operation is interrupted. The duration is multiplied by the transmission rate to obtain the moving length of the application interface during the transmission process after the continuous operation is interrupted. The length of the updated first part is equal to the difference between the current size and the moving length. The update process in other scenarios is similar.

[0231] When the interface movement parameter is the interface movement rate, after the operation is interrupted, the electronic device can first obtain the transmission time after the continuous operation is interrupted according to the actual transmission time and the continuous operation duration, then multiply the transmission time and the interface movement rate to obtain the movement size after the continuous operation is interrupted, and update the first part and the second part according to the current size and the movement size.

[0232] In the above technical solution, during the cross-screen transmission process, if the operation type is a non-transient operation. When the transmission process is not completed but the operation is suddenly interrupted, the electronic device cannot continue to update the first part and the second part according to the user's operation intention. In this case, the electronic device can continue to adjust the first part and the second part according to the actual transmission time, current size, continuous operation time, preset interface movement rate or interface movement time. The above process ensures that the interface remains consistent and coherent after the user operation is interrupted, achieves a good transition effect, avoids sudden interruption of interface transmission, reduces the user's visual sense of discontinuity, and improves the user's experience.

[0233] In another scenario, during the cross-screen transmission process, the embodiment of the present application can also control the second display screen to display a virtual picture, while controlling the first display screen to continue to display a real picture. The specific size calculation process is the same as described above. When the cross-screen transmission process is completed, the electronic device can switch the picture displayed on the second display screen from the virtual picture to the real picture.

[0234] In summary, in the process of cross-screen transmission of applications, the present application proposes a method for cross-screen transmission between multiple screens, which is applied to electronic devices. After receiving the cross-screen transmission operation, the electronic device can first create a virtual layer corresponding to the target application on the first display screen. Among them, the cross-screen transmission operation is used to transmit the application interface of the target application from the first display screen to the second display screen. After that, the electronic device determines the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen based on the interface movement parameters of the application interface, and the interface movement parameters are used to control the movement speed and movement direction of the application interface during transmission. The above process can adjust the two parts displayed on the first display screen and the second display screen in real time during the transmission of the application interface. Finally, the virtual picture of the first part is displayed on the virtual layer, and the real picture of the second part is displayed on the real layer corresponding to the virtual layer. The first display screen can be regarded as the original display screen, and the second display screen can be regarded as the target display screen. During the above-mentioned cross-screen transmission process, by displaying the virtual screen of the application interface on the original display screen and the real screen of the application interface on the target display screen, the contents displayed on the two display screens can achieve a good connection effect, allowing users to visually see the real-time changes and updates of the images on the two display screens during the cross-screen process, thereby ensuring the smoothness of the image transmission and bringing users a good cross-screen experience.

[0235] Fig. 9 It is a structural diagram of a device for cross-screen transmission between multiple screens provided in an embodiment of the present application.

[0236] For example, Fig. 9 As shown, the device 900 includes:

[0237] A layer creation module 901, for creating a virtual layer corresponding to the target application on the first display screen in response to a cross-screen transmission operation on the target application, wherein the cross-screen transmission operation is used to transmit the application interface of the target application from the first display screen to the second display screen;

[0238] A determination module 902, configured to determine a first portion of the application interface corresponding to the first display screen and a second portion of the application interface corresponding to the second display screen based on an interface movement parameter of the application interface, wherein the interface movement parameter is used to control a movement speed and a movement direction of the application interface during transmission;

[0239] The picture display module 903 is used to display the first part of the virtual picture on the virtual layer, and to display the second part of the real picture on the real layer corresponding to the virtual layer.

[0240] In one possible implementation, the virtual layer includes a mirror layer or a screenshot layer, and the layer creation module 901 is specifically used to: in response to the cross-screen transmission operation, obtain the type of the application interface, and the type of the application interface is used to indicate whether the application interface changes during the transmission process; when the type of the application interface is dynamic, obtain the real-time picture of the application interface at the current moment; create the mirror layer based on the real-time picture; when the type of the application interface is static, obtain a screenshot of the application interface at the current moment; and create the screenshot layer based on the screenshot.

[0241] In one possible implementation, the interface movement parameter includes at least one of an interface movement rate, an interface movement duration, and an interface movement size. The determination module 902 is specifically used to: determine the type of the cross-screen transmission operation, where the type of the cross-screen transmission operation is used to indicate the duration of the cross-screen transmission operation on the target application; when the type of the cross-screen transmission operation is a transient operation, obtain the interface movement rate or the interface movement duration; when the type of the cross-screen transmission operation is a continuous operation, obtain the interface movement size.

[0242] In a possible implementation, before determining the first part of the application interface corresponding to the first display screen and the second part corresponding to the second display screen based on the interface movement parameters of the application interface, the determination module 902 is also used to: determine the actual transmission time, the initial width and initial length of the application interface, and the relative position of the first display screen and the second display screen; and, the interface movement parameters include the interface movement rate or the interface movement time, and the determination module is also used to: when the relative position of the first display screen and the second display screen is positive, determine the width of the first part according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; determine the initial length to be the length of the first part; or, when the relative position of the first display screen and the second display screen is positive, determine the initial length to be the length of the first part. When the relative position of the first display screen and the second display screen is in a forward direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the initial width is determined to be the width of the first part; or, when the relative position of the first display screen and the second display screen is in an oblique direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the width of the first part is determined according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; the width of the second part is determined according to the width of the first part and the initial width; and, the length of the second part is determined according to the length of the second part and the initial length.

[0243] In a possible implementation, the interface movement parameter includes the interface movement size, and the interface movement size includes the interface movement width and / or the interface movement length; the determination module 902 is also used to: when the relative position of the first display screen and the second display screen is positive, determine the width of the first part according to the interface movement width and the initial width; determine the initial length as the length of the first part; or, when the relative position of the first display screen and the second display screen is positive, determine the length of the first part according to the interface movement length and the initial length; determine the initial width as the width of the first part; or, when the relative position of the first display screen and the second display screen is oblique, determine the width of the first part according to the interface movement width and the initial width; determine the length of the first part according to the interface movement length and the initial length; determine the width of the second part according to the width of the first part and the initial width; and, determine the length of the second part according to the length of the second part and the initial length.

[0244] In a possible implementation, the screen display module 903 is specifically used to: display the virtual screen of the first part on the virtual layer according to the length of the first part and the width of the first part; and display the real screen of the second part on the real layer corresponding to the virtual layer according to the length of the second part and the width of the second part.

[0245] In one possible implementation, the device also includes: a first update module, which is used to determine the current size and continuous operation duration of the application interface on the first display screen if the continuous operation is detected to be interrupted during the transmission of the application interface; obtain the actual transmission duration and the interface movement rate or the interface movement duration during the cross-screen transmission process; and update the first part and the second part according to the current size, the actual transmission time, the continuous operation duration, and the interface movement rate or the interface movement duration.

[0246] Optionally, after displaying the virtual picture of the first part on the virtual layer and displaying the real picture of the second part on the real layer corresponding to the virtual layer, the device also includes a second update module for adjusting the second part according to the screen size of the second display screen and the display ratio of the application interface when the screen size of the first display screen is different from the screen size of the second display screen; and updating the first part according to the display ratio of the application interface and the screen size of the first display screen.

[0247] Fig.10 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application.

[0248] For example, Fig.10 As shown, the electronic device 1000 includes: a memory 1001 and a processor 1002, wherein the memory 1001 stores an executable program code 10011, and the processor 1002 is used to call and execute the executable program code 10011 to perform a method for cross-screen transmission between multiple screens.

[0249] In addition, an embodiment of the present application also protects a device, which may include a memory and a processor, wherein the memory stores an executable program code, and the processor is used to call and execute the executable program code to execute a method for cross-screen transmission between multiple screens provided in an embodiment of the present application.

[0250] In this embodiment, the functional modules of the device can be divided according to the above method example. For example, each functional module can be corresponded, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0251] In the case of dividing each functional module according to each function, the device may also include a layer creation module, a determination module, and a screen display module, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here.

[0252] It should be understood that the device provided in this embodiment is used to execute the above-mentioned method of cross-screen transmission between multiple screens, and thus can achieve the same effect as the above-mentioned implementation method.

[0253] In the case of an integrated unit, the device may include a processing module and a storage module. When the device is applied to a vehicle, the processing module may be used to control and manage the actions of the vehicle. The storage module may be used to support the vehicle in executing relevant program codes, etc.

[0254] The processing module may be a processor or a controller, which may implement or execute various exemplary logic blocks, modules and circuits shown in conjunction with the disclosure of the present application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module may be a memory.

[0255] In addition, the device provided in the embodiments of the present application may specifically be a chip, a component or a module, and the chip may include a connected processor and a memory; wherein the memory is used to store instructions, and when the processor calls and executes the instructions, the chip can execute a method for cross-screen transmission between multiple screens provided in the above embodiments.

[0256] This embodiment also provides a computer-readable storage medium, which stores computer program code. When the computer program code runs on a computer, the computer executes the above-mentioned related method steps to implement a method for cross-screen transmission between multiple screens provided in the above embodiment.

[0257] This embodiment also provides a computer program product. When the computer program product runs on a computer, it enables the computer to execute the above-mentioned related steps to implement a method for cross-screen transmission between multiple screens provided in the above embodiment.

[0258] Among them, the device, computer-readable storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0259] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0260] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0261] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for multi-screen cross-screen transmission, characterized in that: The method comprises: In response to a cross-screen transmission operation on a target application, creating a virtual layer corresponding to the target application on the first display screen, wherein the cross-screen transmission operation is used to transmit an application interface of the target application from the first display screen to the second display screen; Determining a first portion of the application interface corresponding to the first display screen and a second portion of the application interface corresponding to the second display screen based on an interface movement parameter of the application interface, wherein the interface movement parameter is used to control a movement speed and a movement direction of the application interface during transmission; The virtual picture of the first part is displayed on the virtual layer, and the real picture of the second part is displayed on the real layer corresponding to the virtual layer.

2. The method according to claim 1, characterized in that: The virtual layer includes a mirror layer or a screenshot layer, and in response to the cross-screen transmission operation of the target application, creating a virtual layer corresponding to the target application on the first display screen includes: In response to the cross-screen transmission operation, obtaining a type of the application interface, where the type of the application interface is used to indicate whether the application interface changes during the transmission process; When the type of the application interface is dynamic, obtaining a real-time picture of the application interface at the current moment; and creating the mirror layer according to the real-time picture; In the case where the type of the application interface is static, a screenshot of the application interface at the current moment is obtained; and according to the screenshot, the screenshot screen layer is created.

3. The method according to claim 1, characterized in that The interface movement parameter includes at least one of an interface movement rate, an interface movement duration, and an interface movement size. The step of determining the interface movement parameter includes: Determine a type of the cross-screen transmission operation, where the type of the cross-screen transmission operation is used to indicate a duration of the cross-screen transmission operation on the target application; When the type of the cross-screen transmission operation is a transient operation, acquiring the interface movement rate or the interface movement duration; When the type of the cross-screen transfer operation is a continuous operation, the interface movement size is obtained.

4. The method according to claim 3, characterized in that Before determining the first portion of the application interface corresponding to the first display screen and the second portion of the application interface corresponding to the second display screen based on the interface movement parameter of the application interface, the method further includes: Determining an actual transmission duration, an initial width and an initial length of the application interface, and a relative position of the first display screen and the second display screen; Furthermore, the interface movement parameter includes the interface movement rate or the interface movement duration, and the determining, based on the interface movement parameter of the application interface, a first portion of the application interface corresponding to the first display screen and a second portion corresponding to the second display screen, includes: In the case where the relative positions of the first display screen and the second display screen are in a forward direction, the width of the first part is determined according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; the initial length is determined to be the length of the first part; or In the case where the relative positions of the first display screen and the second display screen are in a forward direction, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the initial width is determined to be the width of the first part; or In the case where the relative positions of the first display screen and the second display screen are oblique, the length of the first part is determined according to the actual transmission time, the initial length, and any one of the interface movement rate or the interface movement time; the width of the first part is determined according to the actual transmission time, the initial width, and any one of the interface movement rate or the interface movement time; The width of the second portion is determined according to the width of the first portion and the initial width; and the length of the second portion is determined according to the length of the second portion and the initial length.

5. The method according to claim 4, characterized in that The interface movement parameter includes the interface movement size, and the interface movement size includes an interface movement width and / or an interface movement length. The determining, based on the interface movement parameter of the application interface, a first portion of the application interface corresponding to the first display screen and a second portion corresponding to the second display screen includes: In the case where the relative positions of the first display screen and the second display screen are in a positive direction, the width of the first part is determined according to the interface movement width and the initial width; the initial length is determined to be the length of the first part; or, In the case where the relative positions of the first display screen and the second display screen are in a positive direction, the length of the first part is determined according to the interface movement length and the initial length; the initial width is determined to be the width of the first part; or, In the case where the relative positions of the first display screen and the second display screen are oblique, the width of the first part is determined according to the interface movement width and the initial width; and the length of the first part is determined according to the interface movement length and the initial length; The width of the second portion is determined according to the width of the first portion and the initial width; and the length of the second portion is determined according to the length of the second portion and the initial length.

6. The method according to claim 5, characterized in that The step of displaying the first portion of the virtual screen on the virtual layer, and displaying the second portion of the real screen of the application interface on the real layer corresponding to the virtual layer, includes: Displaying a virtual picture of the first part on the virtual layer according to the length of the first part and the width of the first part; According to the length of the second part and the width of the second part, a real picture of the second part is displayed on the real layer corresponding to the virtual layer.

7. The method according to claim 3, characterized in that The method further comprises: During the transmission of the application interface, if the interruption of the continuous operation is detected, determining the current size and continuous operation duration of the application interface on the first display screen; Acquire the actual transmission duration during the cross-screen transmission process, and the interface movement rate or the interface movement duration; The first part and the second part are updated according to the current size, the actual transmission time, the continuous operation time, and the interface movement speed or the interface movement time.

8. The method according to claim 1, characterized in that After displaying the first portion of the virtual picture on the virtual layer, and displaying the second portion of the real picture on the real layer corresponding to the virtual layer, the method further includes: When the screen size of the first display screen is different from the screen size of the second display screen, adjusting the second part according to the screen size of the second display screen and the display ratio of the application interface; The first part is updated according to the display ratio of the application interface and the screen size of the first display screen.

9. An electronic device, characterized in that: The electronic device comprises: A memory for storing executable program codes; A processor, configured to call and run the executable program code from the memory, so that the electronic device executes the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 8 is implemented.

Images