Multi-screen display control method, system, device, product, storage medium and vehicle

Abstract

The present application discloses a multi-screen display control method, a multi-screen display system, an electronic device, a computer program product, a computer-readable storage medium and a vehicle. The multi-screen display control method includes the following steps: obtaining a target display object, wherein the display interface of the target display object is part or all of a first user interface, and the first user interface is displayed on a first screen; determining a second user interface according to the target display object; and controlling at least one second screen to display the second user interface. The present application can directly determine the image corresponding to the current frame based on the image corresponding to the target display object on the current main control display screen, and directly send the determined corresponding image to the secondary display screen for display. When displaying the corresponding content on the secondary display screen, there is no need to re-run the application program and re-render, thereby saving hardware resources and improving device performance. In addition, when determining the corresponding image according to the current frame, the image can also be adjusted to achieve a better display effect on the secondary display screen.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to a multi-screen display control method, a multi-screen display system, an electronic device, a computer program product, a computer-readable storage medium and a vehicle. Background Art

[0002] The car system with Android as the operating system is generally equipped with a main control display screen and multiple sub-display screens. In some application scenarios, some controls of a certain application on the main control display screen need to be displayed synchronously on one or more sub-display screens, and the changes in the display content also need to be synchronized on the main control display screen and the sub-display screens. In the current related technology, the method of realizing the above-mentioned synchronous display is generally to pass the original data that needs to be displayed synchronously to the control end of the sub-display screen, reprocess the above-mentioned original data based on the execution of the application program, and render the display controls. However, this method will result in the need to re-execute the application program and re-render the display image for each sub-display screen, which causes a waste of device performance and hardware resources. Summary of the invention

[0003] The present application provides a multi-screen display control method, a multi-screen display system, an electronic device, a computer program product, a computer-readable storage medium, and a vehicle.

[0004] The multi-screen display control method involved in the embodiment of the present application includes the following steps:

[0005] Acquire a target display object, where the display interface of the target display object is part or all of a first user interface, and the first user interface is displayed on a first screen;

[0006] determining a second user interface according to the target display object;

[0007] Control at least one second screen to display the second user interface.

[0008] In this way, the application can directly determine the image corresponding to the current frame based on the image corresponding to the target display object on the current main display screen, and directly send the determined corresponding image to the secondary display screen for display. When displaying the corresponding content on the secondary display screen, there is no need to re-run the application and re-render, saving hardware resources and improving device performance. In addition, when determining the corresponding image based on the current frame, the image can also be adjusted to make the display effect on the secondary display screen better.

[0009] In some implementations, acquiring the target display object includes:

[0010] The target area of ​​the first user interface is registered to a first preset program to obtain a display interface of the target display object, and the first preset program is set in an application framework layer of a display system.

[0011] In this way, the present application can register the area to be displayed on the secondary display screen in the first user interface at the application layer based on the application layer of the vehicle display system, so as to facilitate the subsequent distribution of the corresponding display content to the secondary display screen.

[0012] In some implementations, determining the second user interface according to the target display object includes:

[0013] Rendering first display data to generate an image frame, wherein the first display data is interface data of the first user interface, and the image frame is display data of the first screen;

[0014] A second user interface is determined according to the target display object and the image frame.

[0015] In this way, the present application can filter out display content that needs to be displayed on the secondary display screen based on each image frame corresponding to the user interface of the main control display screen and based on the target display object.

[0016] In some implementations, determining the second user interface according to the target display object and the image frame includes:

[0017] Determine the target image frame according to second display data, where the second display data is display data corresponding to the target display object in the first display data, and the image frame includes the target image frame;

[0018] The target image frame is rendered into the second user interface.

[0019] In this way, the present application can determine an image frame of the target display object based on the portion corresponding to the target display object in the application running status corresponding to the first user interface, and further determine it as the second user interface to be displayed by the secondary display screen.

[0020] In some embodiments, determining the target image frame according to the second display data includes:

[0021] Acquire the running status data through a first preset program, wherein the running status data is the running status data of the second display data;

[0022] The target image frame is determined according to the operating status data.

[0023] In this way, the present application can utilize the client program of the system framework layer to obtain the running status information from the running data of the application program, so as to further filter out the specific content of the second user interface to be displayed by the secondary display screen based on the running status information.

[0024] In some embodiments, the running state data includes token data and / or stack data, and determining the target image frame according to the running state data includes:

[0025] Acquiring the token data and / or the stack data from the first preset program through a second preset program, wherein the second preset program is arranged in a program system operation layer of the display system;

[0026] The token data and / or the stack data are processed to generate the target image frame.

[0027] Thus, the present application also provides specific types of operating status data.

[0028] In some embodiments, the processing of the token data and / or the stack data to generate the target image frame includes:

[0029] In the case where the target display object is bound to the second preset program, determining the original target image frame according to the token data and / or the stack data through the second preset program;

[0030] The original target image frame is subjected to image processing to determine the target image frame.

[0031] In this way, the present application can perform image processing on the filtered data after the original image frame is obtained based on the above-mentioned running status data after the above-mentioned target display object is bound with the second preset program, and determine the content finally displayed by the secondary display screen.

[0032] In some implementations, the original target image frame includes a first object and a second object, and performing image processing on the original target image frame to determine the target image frame includes:

[0033] A preset merging process is performed on the first object and the second object to determine the target image frame.

[0034] Thus, the present application also provides a specific method for performing image processing on the original image frame.

[0035] In some embodiments, the processing of the token data and / or the stack data to generate the target image frame further includes:

[0036] In a case where the target display object and the second preset program are not bound or are to be bound, the target display object and the second preset program are bound.

[0037] In this way, the present application can also preferentially bind the target display object to the second preset program before determining the original image frame.

[0038] In some embodiments, controlling at least one second screen to display the second user interface includes:

[0039] Distributing the second user interface to a display buffer corresponding to the second screen through a second preset program;

[0040] The corresponding second screen is controlled to display the second user interface from the display buffer.

[0041] In this way, the present application can control the secondary display screen to display the second user interface by sending the image data to the buffer zone.

[0042] In certain embodiments, the method further comprises:

[0043] In response to the first display data, when the first screen stops displaying the first user interface, the target area is unregistered from the first preset program.

[0044] In this way, the present application can also unregister the target area of ​​the first user interface from the first preset program when the application is exited and the main display screen stops displaying, thereby ending the process of distributing display content to the secondary display screen.

[0045] In certain embodiments, the method further comprises:

[0046] Through the first preset program, an unbinding instruction is sent to the second preset program, and the target display object is unbound from the second preset program.

[0047] In this way, after the target area is unregistered, the present application can also notify the server program by the client program to unbind the target display object, thereby ending the process of distributing display content to the secondary display screen, and when the server program receives the unbinding instruction sent by the client program, it unbinds the target display object, thereby ending the process of distributing display content to the secondary display screen.

[0048] The multi-screen display system in an embodiment of the present application includes a display controller, which is used to execute the above-mentioned multi-screen display control method, control the first screen to display a first user interface, and at least one second screen to display a second user interface, wherein the first user interface includes the second user interface.

[0049] In some embodiments, the display controller includes:

[0050] a first preset program, the first preset program is used to register the second user interface, and the first preset program is set in the application framework layer of the display system;

[0051] The second preset program is used to bind the second user interface and send the second user interface to the second screen. The second preset program is set in the application system running layer of the display system.

[0052] The electronic device in the implementation mode of the present application includes a memory and a processor. The memory stores a computer program. When the computer program is executed by the processor, the above method is implemented.

[0053] A computer-readable storage medium in an embodiment of the present application stores a computer program, and when the computer program is executed by one or more processors, the above method is implemented.

[0054] A computer program product in an embodiment of the present application includes a computer program, and the computer program implements the above method when executed by one or more processors.

[0055] The vehicle in the implementation manner of the present application includes the above-mentioned multi-screen display system and can implement the above-mentioned method.

[0056] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0058] Figure 1 This is one of the flowcharts of the multi-screen display control method in the implementation manner of the present application;

[0059] Figure 2 This is the second flow chart of the multi-screen display control method in the implementation manner of the present application;

[0060] Figure 3 This is the third flow chart of the multi-screen display control method in the implementation manner of the present application;

[0061] Figure 4 This is a fourth flow chart of the multi-screen display control method in the implementation manner of the present application;

[0062] Figure 5This is the fifth flow chart of the multi-screen display control method in the implementation manner of the present application;

[0063] Figure 6 This is the sixth flow chart of the multi-screen display control method in the implementation manner of the present application;

[0064] Figure 7 This is the seventh flow chart of the multi-screen display control method in the implementation manner of the present application;

[0065] Figure 8 This is the eighth flow chart of the multi-screen display control method in the implementation manner of the present application;

[0066] Fig. 9 Schematic diagram of an application scenario of the multi-screen display control method in an embodiment of the present application. DETAILED DESCRIPTION

[0067] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.

[0068] The vehicle display system in the embodiment of the present application includes a first screen and at least one second screen. Figure 1 , a multi-screen display control method, specifically comprising the following steps:

[0069] 01: Get the target display object,

[0070] The display interface of the target display object is part or all of the first user interface, and the first user interface is displayed on the first screen;

[0071] 02: Determine the second user interface according to the target display object;

[0072] 03: Control at least one second screen to display a second user interface.

[0073] The control device in the embodiment of the present application can implement the above-mentioned multi-screen display control method. The control device includes a processing unit and a transceiver unit, wherein the transceiver unit is used to obtain a target display object, and the processing unit is also used to determine a second user interface according to the target display object, and to control at least one second screen to display the second user interface.

[0074] The electronic device in the embodiment of the present application can implement the above-mentioned multi-screen display control method. Specifically, the electronic device includes a memory and a processor, wherein the memory stores a computer program, and the processor is used to obtain a target display object, and to determine a second user interface according to the target display object, and to control at least one second screen to display the second user interface.

[0075] Specifically, compared with the current related art solution that requires re-rendering controls based on the running status of the application when displaying on each secondary display screen, the present application can distribute the content needed on the main display screen to each secondary display screen for display at a lower performance and hardware resource consumption level.

[0076] The vehicle display system in the above method generally includes a main control display screen (corresponding to the first screen) and at least one secondary display screen (corresponding to the second screen). Exemplarily, the main control display screen is the central control screen in the vehicle cabin or the control screen corresponding to the driver's seat, and the secondary display screen is the display screen corresponding to the co-pilot seat or the back seat.

[0077] When the target application is running, the vehicle display system controls the main display screen to display user interface A (corresponding to the first user interface) corresponding to the above-mentioned target application, wherein user interface A is a user interface displayed on the main display screen by real-time rendering by the vehicle display system based on the application running data (corresponding to the first display data) corresponding to the target application, and controlled by the vehicle display system to facilitate user interaction with the target application.

[0078] The above user interface includes multiple controls, including at least one target control (corresponding to a target display object) that needs to be distributed to one or more secondary display screens for simultaneous display. Therefore, before distributing display content to the secondary display screens, it is necessary to obtain the target control that needs to be distributed first according to actual needs. Generally, the selection of the target control can be determined by the user and selected by the operation instruction system, or it can be determined by the system according to actual conditions. The specific selection method of the target control can be adjusted according to actual conditions, and this application does not make specific limitations.

[0079] Then, based on the acquired target control, the display content that needs to be distributed to the secondary display screen for display is determined in the multiple image frames corresponding to the target control in the multiple rendering cycles in the user interface A, and it is used as the user interface B (corresponding to the second user interface) displayed on the secondary display screen. Finally, the vehicle display system distributes the screened user interface B to one or more secondary display screens that need to be displayed synchronously, and controls each secondary display screen to display the user interface B, completing the synchronous display control process. In this way, in the process of synchronous display between the secondary display screen and the main control display screen, the link of re-running the target application and re-rendering the user interface based on the application running data is omitted, and the rendering image corresponding to the display interface on the main control display screen is directly projected onto the secondary display screen for display, and is updated in real time based on the rendering cycle, so that the synchronous display of the same control on the main control display screen and the secondary display screen can be achieved.

[0080] In addition, after obtaining user interface B, the vehicle display system can also perform image processing based on the image data of user interface B to change the image properties of user interface B such as brightness, contrast, size, and color, so that user interface B can better adapt to the display effect on the secondary display screen.

[0081] In this way, the application can directly determine the image corresponding to the current frame based on the image corresponding to the target display object on the current main display screen, and directly send the determined corresponding image to the secondary display screen for display. When displaying the corresponding content on the secondary display screen, there is no need to re-run the application and re-render, saving hardware resources and improving device performance. In addition, when determining the corresponding image based on the current frame, the image can also be adjusted to make the display effect on the secondary display screen better.

[0082] In some embodiments, step 01 includes:

[0083] Registering the target area of ​​the first user interface to the first preset program to obtain a display interface of the target display object,

[0084] The first preset program is set in the application program framework layer of the display system.

[0085] In some embodiments, the transceiver unit is further configured to register the target area of ​​the first user interface to the first preset program to obtain a display interface of the target display object.

[0086] In some embodiments, the processor is further configured to register the target area of ​​the first user interface to a first preset program to obtain a display interface of the target display object.

[0087] Specifically, on the basis of the above implementation, in order to enable the target control to be correctly displayed on the secondary display screen, it is also necessary to clarify the prerequisites for the target control to be displayed on the secondary display screen. Therefore, taking the vehicle display system as an Android system as an example, in some examples, after the target area corresponding to the target control that needs to be displayed synchronously is delineated on the user interface A in response to the user's instructions or the automatic instructions of the vehicle display system, the above target area needs to be registered to the SingleViewComposerClient system service (corresponding to the first preset program) preset in the application framework layer (Framework layer) of the Android system, so as to clarify the object type and other attribute data of the content to be synchronously displayed on the secondary display screen, so as to avoid errors when the secondary display screen processes the display of the user interface B. At the same time, the subsequent acquisition of the running data of the target application by the SingleViewComposerClient system service also requires the support of the above registration process.

[0088] In this way, the present application can register the area to be displayed on the secondary display screen in the first user interface at the application layer based on the application layer of the vehicle display system, so as to facilitate the subsequent distribution of the corresponding display content to the secondary display screen.

[0089] See also Figure 2 In some embodiments, the first user interface includes an image frame generated by rendering the first display data. On this basis, step 02 includes:

[0090] 021: Rendering the first display data to generate an image frame,

[0091] The first display data is interface data of the first user interface, and the image frame is display data of the first screen;

[0092] 022: Determine a second user interface according to the target display object and the image frame.

[0093] In some embodiments, the processing unit is further configured to render the first display data to generate an image frame, and to determine a second user interface according to the target display object and the image frame.

[0094] In some embodiments, the processor is further configured to render the first display data to generate an image frame, and to determine a second user interface according to the target display object and the image frame.

[0095] Specifically, based on the above implementation, the above real-time rendering process is to render the user interface A based on the application running data corresponding to the target application in each rendering cycle period to obtain the image frame of the user interface A in the current rendering cycle. When determining the above user interface B, in order to improve the convenience of the display content determination process, the actual display content of the user interface B is generally determined within the image frame range of the user interface A based on the operation of the target control.

[0096] In this way, the present application can filter out display content that needs to be displayed on the secondary display screen based on each image frame corresponding to the user interface of the main control display screen and based on the target display object.

[0097] See also Figure 3 In some embodiments, step 022 includes:

[0098] 0221: determining a target image frame according to the second display data,

[0099] The second display data is display data corresponding to the target display object in the first display data, and the image frame includes the target image frame;

[0100] 0222: Render the target image frame into a second user interface.

[0101] In some embodiments, the processing unit is further configured to determine a target image frame according to the second display data, and to render the target image frame into a second user interface.

[0102] In some embodiments, the processor is further configured to determine a target image frame according to the second display data, and to render the target image frame into a second user interface.

[0103] Specifically, based on the above implementation, in some examples, for the problem of determining the image frames that need to be distributed to the secondary display screen for display from the multiple image frames corresponding to the target control in the user interface A in multiple rendering cycles, since each image frame of the target control is rendered in real time based on the data portion corresponding to the target control in the running data of the application (corresponding to the first display data), when performing image screening in the above image frames, the target image frames that need to be distributed are determined based on the running data of the application, which is more direct and accurate than other screening methods. Therefore, in some examples, during the actual running of the application corresponding to the user interface A, the running data of the above application includes part of the running data corresponding to the target control (corresponding to the second display data), then when screening the actual display content of the user interface B (corresponding to the target image frame), the target image frame corresponding to the target control can be captured in the display system based on the part of the running data corresponding to the above target control, and it can be known that the target image frame is included in the range of each image frame corresponding to the user interface A.

[0104] In this way, the present application can determine an image frame of the target display object based on the portion corresponding to the target display object in the application running status corresponding to the first user interface, and further determine it as the second user interface to be displayed by the secondary display screen.

[0105] See also Figure 4 , further, step 0221 includes:

[0106] 0223: Obtaining operation status data through the first preset program,

[0107] The running status data is the running status data of the second display data;

[0108] 0224: Determine the target image frame based on the operating status data.

[0109] In some embodiments, the processing unit is further configured to obtain operating status data corresponding to the target display object based on a first preset program, and to determine a target image frame according to the operating status data.

[0110] In some embodiments, the processor is further configured to obtain operating status data corresponding to the target display object based on a first preset program, and to determine a target image frame according to the operating status data.

[0111] Furthermore, on the basis of ensuring direct and accurate screening, in order to be able to more conveniently screen the above-mentioned target image frames, in some examples, after the target area of ​​the first user interface is registered with the SingleViewComposerClient system service, the SingleViewComposerClient system service enters a registered state, and based on the registration information received in the above-mentioned registration process, obtains the running data of the target application from other services within the application framework layer for managing the operation of the application, especially the running status data that can represent the current running status of the application, because the running status data can accurately correspond to the current image frame of user interface A.

[0112] Finally, the vehicle display system can obtain the running status data from the SingleViewComposerClient system service, and use the corresponding logic of the running status data and the image frame to filter the target image frame that the secondary display screen needs to display, and finally control the secondary display screen to display the target image frame as user interface B.

[0113] In this way, the present application can utilize the client program of the system framework layer to obtain the running status information from the running data of the application program, so as to further filter out the specific content of the second user interface to be displayed by the secondary display screen based on the running status information.

[0114] See also Figure 5 In some embodiments, the running state data includes token data and / or stack data, and step 0224 includes:

[0115] 0225: acquiring token data and / or stack data from the first preset program through the second preset program,

[0116] The second preset program is set in the application system operation layer of the display system;

[0117] 0226: Process the token data and / or stack data to generate a target image frame.

[0118] In some embodiments, the processing unit is further configured to obtain token data and / or stack data from the first preset program via a second preset program, and to process the token data and / or stack data to generate a target image frame.

[0119] In some embodiments, the processor is further configured to obtain token data and / or stack data from the first preset program via a second preset program, and to process the token data and / or stack data to generate a target image frame.

[0120] Specifically, based on the above implementation, when the SingleViewComposerClient system service enters the registration state, the SingleViewComposerClient system service obtains the token data (token) and stack data (stack) of the target application from other services within the application framework layer for managing the operation of the application according to the registration information corresponding to the target control received during the registration process. The token is used to identify the application, and the stack is used to indicate the running status of the application. Since both have the characteristics of real-time update, they can indicate the current running status of the application in real time, thereby serving as the data basis for filtering image frames.

[0121] Then, the SingleViewComposerServer system service (corresponding to the second preset program) set in the vehicle display system code layer (Native layer) obtains the above token and stack data from the SingleViewComposerClient system service. The data flow between the SingleViewComposerClient system service and the SingleViewComposerServer system service needs to cross the application framework layer (Framework layer) and the code layer (Native layer). Therefore, it is necessary to use the data flow means between layers in the vehicle display system and use the interfaces (APIs) set between different system services to achieve it.

[0122] Therefore, for the data flow between the SingleViewComposerClient system service and the SingleViewComposerServer system service, in some examples, the communication method between the two adopts the Binder communication mode. Specifically, an aidl file corresponding to the Binder communication mode is added to the vehicle display system, and the two have a common set of aidl resources. The above aidl resources provide the following APIs for the SingleViewComposerClient system service and the SingleViewComposerServer system service to transfer data:

[0123] For the SingleViewComposerClient system service, the API includes a registration interface, a removal interface, an interface for obtaining the current registration object, and an interface for determining the current running status. The registration interface is used to receive the registration information of the target control from the application layer, the removal interface is used to release the above registration information and notify the application layer that the registration has been released, the interface for obtaining the current registration object is used to obtain the target control after registration, and the interface for determining the current running status is used to determine the running status of the current SingleViewComposerClient system service.

[0124] For the SingleViewComposerServer system service, the API includes a binding interface, an unbinding interface, a success callback interface, and a failure callback interface. The binding interface is used to bind the target control when the token and stack data are received from the SingleViewComposerClient system service. The unbinding interface is used to release the binding from the target control. The success callback interface is used to feedback success information to the SingleViewComposerClient system service when the token and stack data are successfully obtained. The failure callback interface is used to feedback failure information to the SingleViewComposerClient system service when an exception or error occurs in the process of obtaining the token and stack data.

[0125] According to the above description, based on the above aidl resources, the data flow between the SingleViewComposerClient system service and the SingleViewComposerServer system service is generally manifested as follows:

[0126] After the target area in user interface A on the main screen is registered to the SingleViewComposerClient system service using the above-mentioned registration interface, the SingleViewComposerClient system service enters the registration state, and based on the registration information received in the above-mentioned registration process, obtains the token and stack data of the target application from other services within the application framework layer that are used to manage the operation of the application, and passes the above-mentioned token and stack data to the SingleViewComposerServer system service through Binder, and finally sets its current state to the success state.

[0127] On this basis, one situation is that when the SingleViewComposerServer system service successfully obtains the token and stack data, the SingleViewComposerServer system service feeds back success information to the SingleViewComposerClient system service through the success callback interface. At this time, the SingleViewComposerClient system service changes its own running state back to the registered state after receiving the feedback success information to indicate that the data interaction is completed, while ensuring that the screening process of the second user interface is correct.

[0128] Another situation is that when an error or exception occurs in the process of the SingleViewComposerServer system service obtaining token and stack data, the SingleViewComposerServer system service feeds back failure information to the SingleViewComposerClient system service through the failure callback interface. At this time, the SingleViewComposerClient system service changes its own running state back to the registered state after receiving the feedback failure information, so as to resume data flow.

[0129] Furthermore, the data correspondence relationship can be processed based on the above-mentioned token data and stack data, so as to filter out the image frame data to be displayed on the secondary display screen from the image frames corresponding to the user interface A.

[0130] Thus, the present application also provides specific types of operating status data.

[0131] See also Figure 6 In some embodiments, step 0226 includes:

[0132] 0227: when the target display object is bound to the second preset program, determining the original target image frame according to the token data and / or the stack data through the second preset program;

[0133] 0228: Perform image processing on the original target image frame to determine the target image frame.

[0134] In some embodiments, the processing unit is further used to determine the original target image frame according to the token data and / or the stack data through the second preset program when the target display object is bound to the second preset program, and to perform image processing on the original target image frame to determine the target image frame. In some embodiments, the processor is further used to determine the original target image frame according to the token data and / or the stack data through the second preset program when the target display object is bound to the second preset program, and to perform image processing on the original target image frame to determine the target image frame. Specifically, based on the above implementation method, after the token data and stack data are successfully transferred from the SingleViewComposerClient system service to the SingleViewComposerServer system service through the above-mentioned Binder method, in order to maximize the accuracy of the image frame acquisition process, before the image frame is screened according to the token data and the stack data, the SingleViewComposerServer system service needs to be bound to the target control. If the two are currently bound, the SingleViewComposerServer system service parses the token data and stack data received based on the Binder, and finally determines the original image frame data corresponding to the user interface B in the rendered image frame according to the above-mentioned token and stack data. At the same time, in order to ensure the correct display of the user interface B on the secondary display screen, the above-mentioned original image frame data needs to be further processed to form a complete and correct image.

[0135] In this way, the present application can perform image processing on the filtered data based on the above-mentioned operating status data and after filtering the original image frame, and determine the content finally displayed by the secondary display screen when the above-mentioned target display object is bound to the second preset program.

[0136] In some implementations, the original target image frame includes a first object and a second object, based on which step 0228 includes:

[0137] A preset merging process is performed on the first object and the second object to determine a target image frame.

[0138] In some embodiments, the processing unit is further configured to perform a preset merging process on the first object and the second object to determine a target image frame.

[0139] In some implementations, the processor is further configured to perform a preset merging process on the first object and the second object to determine a target image frame.

[0140] Specifically, based on the above implementation, the original target image frame data that is screened generally includes two parts: a surface object (corresponding to the first object) and a layer object (corresponding to the second object), wherein the surface object is mainly used to determine the display boundary of the user interface B, and the layer object is mainly used to determine the specific display content of the user interface B. The two objects can only be combined to form a complete image frame. Therefore, illustratively, after the surface object and the layer object are screened and determined in the above implementation, the two objects need to be combined to form a complete image frame.

[0141] Furthermore, before the vehicle display system sends the above-mentioned image frames to each secondary display screen for display, in order to adapt to the inherent properties of the secondary display screen, the image properties corresponding to the user interface B can also be adjusted according to the display properties such as the size, brightness, and contrast of the secondary display screen, so that the secondary display screen can correctly display the user interface B. The specific image processing method can be adjusted according to the actual situation, and this application does not make any specific limitation.

[0142] Thus, the present application also provides a specific method for performing image processing on the original image frame.

[0143] In some embodiments, step 0226 further includes:

[0144] When the target display object is not bound to the second preset program or is to be bound, the target display object is bound to the second preset program.

[0145] In some embodiments, the processing unit is further configured to bind the target display object to the second preset program when the target display object is not bound to the second preset program or is to be bound.

[0146] In some implementations, the processor is further configured to bind the target display object to the second preset program when the target display object is not bound to the second preset program or is to be bound.

[0147] Specifically, based on the above implementation, if the current SingleViewComposerServer system service and the target control are not bound, the SingleViewComposerServer system service needs to bind the two through the above binding interface. Because before binding, the SingleViewComposerServer system service may be in the process of determining the previous image frame of user interface B, if you want to start determining the current original target image frame, you need to first unbind the historical target control in the previous determination process and set the status of the SingleViewComposerServer system service to the pending binding state. In addition, when the SingleViewComposerServer system service is currently idle, before starting to bind the current target control, it is also necessary to prioritize setting the status of the SingleViewComposerServer system service to the pending binding state.

[0148] On this basis, if the current state of the SingleViewComposerServer system service is to be bound, the above binding port is called to bind the target control to the SingleViewComposerServer system service. If an error or exception occurs in the above process, the SingleViewComposerServer system service determines that the current operation has failed, and uses the above unbinding interface to unbind the target control and wait for the next rebinding.

[0149] In this way, the present application can also preferentially bind the target display object to the second preset program before determining the original image frame.

[0150] See also Figure 7 In some embodiments, step 03 includes:

[0151] 031: Distribute the second user interface to the display buffer corresponding to the second screen through the second preset program,

[0152] The second preset program is set in the application system operation layer of the vehicle display system;

[0153] 032: Control the corresponding second screen to display the second user interface from the display buffer.

[0154] In some embodiments, the processing unit is further used to distribute the second user interface to a display buffer corresponding to the second screen through a second preset program, and to control the corresponding second screen to display the second user interface from the display buffer.

[0155] In some embodiments, the processor is further configured to distribute the second user interface to a display buffer corresponding to the second screen through a second preset program, and to control the corresponding second screen to display the second user interface from the display buffer.

[0156] Specifically, based on the above implementation, when the SingleViewComposerServer system service parses the token data and stack data received based on Binder, and searches for the surface object and layer object in the corresponding running state from the SurfaceFlinger service of the vehicle display system through the analysis results, in order to synchronize the update of user interface B with user interface A, the timing of distributing user interface B to each secondary display screen needs to be coordinated with the overall display refresh frequency of the system.

[0157] Therefore, in some examples, after the SingleViewComposerServer system service determines the user interface B, it waits for the vertical synchronization signal VSYNC periodically issued by the vehicle display system. Generally speaking, the time interval between two adjacent sets of vertical synchronization signals VSYNC issued by the vehicle display system is 16ms. Whenever the SingleViewComposerServer system service receives the vertical synchronization signal VSYNC, it uses graphics programming interfaces such as OpenGL to convert the obtained surface objects and layer objects into user interface B that can be actually displayed and has been adapted for the secondary display screen, and distributes user interface B to each secondary display screen for display.

[0158] Furthermore, after the SingleViewComposerServer system service determines the user interface B, it waits for the vertical synchronization signal VSYNC (corresponding to the preset signal) periodically issued by the vehicle display system. Generally speaking, the time interval between two adjacent sets of vertical synchronization signals VSYNC issued by the vehicle display system is 16ms. Whenever the SingleViewComposerServer system service receives the vertical synchronization signal VSYNC, it uses OpenGL and other graphics programming interfaces to convert the obtained surface objects and layer objects into user interface B that can be actually displayed and has been adapted for the secondary display screen, and sends the obtained user interface B to the display buffer Framebuffer of each secondary display screen participating in the synchronous display. When the corresponding display buffer Framebuffer contains image data, the vehicle display system will draw the data in the buffer to the secondary display screen, thereby completing the synchronous display of the main control display screen and the secondary display screen.

[0159] In this way, the present application can control the secondary display screen to display the second user interface by sending the image data to the buffer zone.

[0160] See also Figure 8 In some embodiments, the multi-screen display control method further includes:

[0161] 001: In response to first display data, when the first screen stops displaying the first user interface, unregistering the target area from the first preset program.

[0162] On this basis, the above-mentioned multi-screen display control method further includes:

[0163] 002: Sending an unbinding instruction to the second preset program through the first preset program, and unbinding the target display object from the second preset program.

[0164] In some embodiments, the processing unit is further configured to send an unbinding instruction to the second preset program through the first preset program, and unbind the target display object from the second preset program.

[0165] In some embodiments, the processor is further configured to send an unbinding instruction to the second preset program through the first preset program, and unbind the target display object from the second preset program.

[0166] Specifically, in addition to the above-mentioned synchronous display process, when the target application is exited, the user interface A on the main display screen will stop displaying as a whole, and the content synchronously displayed on the secondary display screen also needs to stop displaying. Therefore, in order to stop displaying, it is necessary to unregister and unbind the target control based on the running data of the target application, so as to stop displaying the user interface B on the secondary display screen.

[0167] Therefore, when the main control display stops displaying user interface A, the vehicle display system first detects the running data of the target application. When it detects that the target application stops running, the SingleViewComposerClient system service uses the above-mentioned removal interface to remove the registration information corresponding to the target control, thereby releasing the registration information of the target control in the application framework layer.

[0168] After the above registration information is removed, the SingleViewComposerClient system service communicates with the SingleViewComposerServer system service through Binder and sends an unbinding notification to the SingleViewComposerServer system service. When the SingleViewComposerServer system service receives the above unbinding notification, it detects whether it is currently bound to the target control. If so, it unbinds itself from the target control based on the above unbinding interface. In this way, even if the vertical synchronization signal VSYNC sent by the vehicle display system is received at this time, the SingleViewComposerServer system service will no longer call OpenGL or other graphics program interfaces to draw the user interface B, nor will it distribute the surface object and layer object to each secondary display screen. In this way, due to the unregistration and unbinding of the target control, the display basis of the user interface B on the secondary display screen no longer exists. At this time, the secondary display screen stops displaying the user interface B, and the synchronous display process ends.

[0169] In this way, the server program in the present application can also unbind the target display object after the target area is unregistered, and the client program can notify the server program to unbind the target display object, ending the process of distributing display content to the secondary display screen, and when the server program receives the unbinding instruction sent by the client program, it can unbind the target display object and end the process of distributing display content to the secondary display screen. Fig. 9 It should be noted that for the convenience of drawing, Fig. 9 Only one set of secondary display screens is drawn, but it can be understood that in the implementation manner of the present application, multiple secondary display screens can be set, and each secondary display screen corresponds to a display buffer.

[0170] The multi-screen display system in the implementation manner of the present application includes a display controller, which is used to execute the above-mentioned multi-screen display control method and control at least one second screen to display a second user interface.

[0171] In some embodiments, the display controller includes:

[0172] A first preset program is used to register the second user interface, and the first preset program is set in the application framework layer of the display system;

[0173] The second preset program is used to bind the second user interface and send the second user interface to the second screen. The second preset program is set in the program system running layer of the display system.

[0174] The computer-readable storage medium in the embodiments of the present application stores a computer program, and when the computer program is executed by one or more processors, the above method is implemented.

[0175] A computer program product in an embodiment of the present application includes a computer program, and when the computer program is executed by one or more processors, the above method is implemented.

[0176] The vehicle in the implementation manner of the present application includes the above-mentioned multi-screen display system and can implement the above-mentioned multi-screen display control method.

[0177] In the description of this specification, the descriptions with reference to the terms "certain embodiments", "in an example", "exemplarily", etc., mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0178] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0179] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A multi-screen display control method, used in a multi-screen display system, characterized in that: The method comprises: Registering a target area of ​​the first user interface to a first preset program to obtain a display interface of the target display object, wherein the first preset program is set in an application framework layer of the display system, the display interface is part or all of the first user interface, and the first user interface is displayed on a first screen; Rendering first display data to generate an image frame, wherein the first display data is interface data of the first user interface, and the image frame is display data of the first screen; Acquiring running status data through the first preset program, the running status data is running status data of second display data, the running status data includes token data and / or stack data, the second display data is display data corresponding to the target display object in the first display data, the image frame includes a target image frame, and the stack data is used to represent the running status of the target application; Acquiring the token data and / or the stack data from the first preset program through a second preset program, the second preset program being arranged in an application system operation layer of the display system; Processing the token data and / or the stack data to generate the target image frame; Rendering the target image frame into a second user interface; Control at least one second screen to display the second user interface.

2. The method according to claim 1, characterized in that The processing of the token data and / or the stack data to generate the target image frame includes: In the case where the target display object is bound to the second preset program, determining the original target image frame according to the token data and / or the stack data through the second preset program; The original target image frame is subjected to image processing to determine the target image frame.

3. The method according to claim 2, characterized in that The original target image frame includes a first object and a second object, and performing image processing on the original target image frame to determine the target image frame includes: A preset merging process is performed on the first object and the second object to determine the target image frame.

4. The method according to claim 2, characterized in that: The processing of the token data and / or the stack data to generate the target image frame further includes: In a case where the target display object and the second preset program are not bound or are to be bound, the target display object and the second preset program are bound.

5. The method according to claim 1, characterized in that The controlling at least one second screen to display the second user interface includes: Distributing the second user interface to a display buffer corresponding to the second screen through the second preset program; The second screen is controlled to obtain and display the second user interface from the display buffer.

6. The method according to claim 1, characterized in that The method further comprises: In response to the first display data, the target area is unregistered from the first preset program when the first screen stops displaying the first user interface.

7. The method according to claim 6, characterized in that The method further comprises: Through the first preset program, an unbinding instruction is sent to the second preset program, and the target display object is unbound from the second preset program.

8. A multi-screen display system, characterized in that: The multi-screen display system includes a display controller, which is used to execute the multi-screen display control method as described in any one of claims 1-7, control the first screen to display a first user interface, and at least one second screen to display a second user interface, wherein the first user interface includes the second user interface.

9. The multi-screen display system according to claim 8, characterized in that: The display controller comprises: a first preset program, the first preset program is used to register the second user interface, and the first preset program is set in the application framework layer of the display system; The second preset program is used to bind the second user interface and send the second user interface to the second screen. The second preset program is set in the application system running layer of the display system.

10. An electronic device, characterized in that: The electronic device includes a memory and a processor, the memory stores a computer program, and when the computer program is executed by the processor, the method according to any one of claims 1 to 7 is implemented.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by one or more processors, the method according to any one of claims 1 to 7 is implemented.

12. A computer program product, characterized in that The invention comprises a computer program, which, when executed by one or more processors, implements the method according to any one of claims 1 to 7.

13. A vehicle, characterized in that: The vehicle comprises the multi-screen display system according to claim 8 or 9, and the vehicle can implement the method according to any one of claims 1-7.

Images