Display control method and device based on multiple systems and electronic equipment

Abstract

The invention discloses a display control method and device based on multiple systems and electronic equipment. The method comprises the following steps: reading a preset configuration file for a plurality of systems, and determining hardware resources corresponding to the systems according to the preset configuration file; determining a register address space of the hardware resource according to a preset configuration file so as to limit the access authority of a system corresponding to the hardware resource to the register address space; and receiving to-be-displayed pictures corresponding to the systems respectively, and outputting the to-be-displayed pictures through the hardware resources corresponding to the systems respectively. According to the method and the device, the access authority of the system to the hardware is limited in a manner of recording the binding relationship between the hardware resource and the system through the configuration file, so that isolation of the hardware between different systems is realized, and the different systems can respectively display own to-be-displayed pictures without conflicts; system display control can be independently realized in a scene of a single display controller, and hardware use among different systems does not influence each other.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of display control, and in particular to a display control method and device based on multiple systems, and an electronic device. BACKGROUND

[0002] In the related art, in the case of multiple systems, multiple display controllers are added in chip design, different display controllers are independent display modules, and each display module is independently assigned to a certain system for display. The disadvantage of this scheme is that the addition of multiple display controllers increases hardware cost and may cause waste of hardware resources. For example, a chip can run two systems or three systems, and when a chip adds three display controllers, it will cause waste in the scenario of dual-system dual-screen display. When a chip adds two display controllers, it cannot support a product with three systems and three screens.

[0003] In the related art, there is also a scheme in which multiple systems share one display controller, a virtual display device for configuring a second system is constructed by a first system / safe system, a second system virtual display driver is constructed by the second system, the second system transmits display parameters to the virtual display device constructed by the first system, and the first system completes configuration and management of the display channel of the second system. The disadvantage of this scheme is that the second system completely depends on the first system, and if the first system cannot work or the communication between the two systems is abnormal, the second system cannot work normally. SUMMARY

[0004] The present application provides a display control method and device based on multiple systems, and an electronic device, which realizes independent control of each system in a single display controller scenario.

[0005] In one aspect of the present application, a display control method based on multiple systems is provided. The method comprises: reading preset configuration files for multiple systems, determining hardware resources corresponding to each system respectively according to the preset configuration files; determining register address spaces of the hardware resources according to the preset configuration files, so as to limit the access permission of the system corresponding to the hardware resources to the register address spaces; and receiving to-be-displayed pictures corresponding to each system respectively, and outputting the to-be-displayed pictures through the hardware resources corresponding to each system respectively.

[0006] In another aspect of the present application, a display control device based on multiple systems is provided. The device comprises: a single display controller comprising: a first display driver corresponding to a first system of multiple systems, configured to manage first hardware resources allocated to the first system according to a preset configuration file, have access rights limited to a first register address space of the first hardware resources determined according to the preset configuration file, and receive a first to-be-displayed picture corresponding to the first system and output the first to-be-displayed picture through the first hardware resources; and a second display driver corresponding to a second system of the multiple systems, configured to manage second hardware resources allocated to the second system according to the preset configuration file, have access rights limited to a second register address space of the second hardware resources determined according to the preset configuration file, and receive a second to-be-displayed picture corresponding to the second system and output the second to-be-displayed picture through the second hardware resources.

[0007] In yet another aspect of the present application, an electronic device is provided. The electronic device comprises a memory configured to store an executable program; and a processor configured to execute the program to perform the display control method of multiple systems described above.

[0008] According to the technical solution of the present application, the hardware resources available to different systems are configured by a configuration file, and the register address space corresponding to the hardware resources is limited in access rights of the systems according to the configuration file, so that different systems can only access the register address space corresponding to the hardware resources configured in the configuration file, thereby eliminating the need to configure a separate display controller for each system, and instead limiting the access rights of the systems to the hardware resources by recording the binding relationship between the hardware resources and the systems in the configuration file, achieving isolation of the hardware resources between different systems, allowing different systems to display their own to-be-displayed pictures without conflict, and enabling each system to independently achieve display control in the scenario of a single display controller, with the hardware resources used by different systems not affecting each other. BRIEF DESCRIPTION OF DRAWINGS

[0009] Figure 1 A flowchart of the display control method based on multiple systems according to an embodiment of the present application; Figure 2 A flowchart of the display control method based on multiple systems in a specific scenario according to an embodiment of the present application; Figure 3 A schematic diagram of the relationship between a system and hardware resources according to an embodiment of the present application; Figure 4 A schematic diagram of data flow according to an embodiment of the present application; Figure 5 A block diagram of the display control device based on multiple systems according to an embodiment of the present application; Figure 6 a block diagram of a first hardware resource and a second hardware resource according to an embodiment of the present application; Figure 7 a schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0010] To make the technical content of the present application, the achieved purposes and effects clear, the following will be described in detail in combination with the embodiments and the accompanying drawings.

[0011] In the prior art, if the separate control of different systems is to be realized, multiple display controllers corresponding to the systems respectively need to be designed, or a virtual display driver for a second system is constructed by a first system based on a display controller. In this way, the second system completely depends on the first system to run, and if the first system fails, both systems cannot work.

[0012] To solve at least the above technical problems, the present disclosure provides a display control scheme based on a single display controller for multiple systems. According to the present disclosure, a configuration file is added, the hardware resource corresponding to each system is set by the configuration file, and the register address space of the hardware resource corresponding to each system is bound to the system, so that the system is limited to access only the bound hardware resource. In this way, according to the embodiments of the present disclosure, each system can be realized to run independently without affecting each other without setting multiple display controllers.

[0013] In the technical scheme of the present disclosure, multiple systems share a single display controller, the resources of the display controller are allocated to different systems by specifying a configuration file, each system manages the hardware resource allocated to the current system, and different hardware resources / sub-modules are protected by a firewall to ensure that the current system can only operate the hardware resource allocated to the current system.

[0014] In some embodiments, the first system can run a Linux system, the display driver (DRM driver) of the first system manages the hardware resource allocated to the first system, including a display layer, a display control port, a display output interface and a corresponding display device. The upper layer display application of the first system will submit the image cache and parameter configuration to the DRM driver of the first system through the interface provided by the DRM driver of the first system. The DRM driver of the first system will update the corresponding configuration to each hardware module corresponding to the first system, and complete the display process of the first system. At this time, the second system and the corresponding hardware resource are not aware of and have no influence on the behavior of the first system.

[0015] In some embodiments, the second system can also run an Android system. The DRM driver of the second system manages the hardware resources allocated to the second system, including display layers, display control ports, display output interfaces, and corresponding display devices. The upper-layer display application of the second system submits the drawn second-system image and parameters to the DRM driver of the second system through the interface provided by the DRM driver. The DRM driver of the second system updates the corresponding configuration to the corresponding hardware resources of the second system, and completes the display process of the second system. At this time, the first system and its corresponding hardware resources have no awareness and no influence on the behavior of the second system.

[0016] In some embodiments, the DRM driver of the first system only registers the hardware resources allocated to the first system, and the hardware resources of the second system are invisible and inoperable to the first system. The DRM driver of the second system only registers the hardware resources allocated to the second system, and the hardware resources of the first system are invisible and inoperable to the second system.

[0017] In some embodiments, the first system and the second system can only operate the hardware resources of the current system, and cannot operate the hardware resources allocated to the other system. Specifically, the current system can only operate the registers of the hardware resources of the current system, and cannot operate the registers of the hardware resources of the other system, through the form of a firewall.

[0018] In some embodiments, the configuration file of the hardware resources allocated to the two systems is set according to product definition. According to the configuration file, the register address space corresponding to the hardware resources of each system is confirmed, and each system can only access the register address space corresponding to the hardware resources of the current system. If the register of the hardware module of the other system is accessed by accident or maliciously, a failure or an error is returned, so as to ensure that the current system cannot operate or control the hardware module register of the other system.

[0019] Hereinafter, the technical solution according to the present disclosure will be described with reference to specific embodiments and in conjunction with the accompanying drawings.

[0020] Figure 1 is a flowchart showing a multi-system-based display control method 100 according to an embodiment of the present disclosure. Referring to Figure 1 The method 100 includes the following steps 102 to 106.

[0021] In step 102, a preset configuration file for a plurality of systems is read, and hardware resources corresponding to each system are determined according to the preset configuration file.

[0022] In some embodiments, determining the hardware resources corresponding to each system according to the preset configuration file comprises: allocating a display layer, a display control port, a display output interface and a display device corresponding to each system according to the preset configuration file.

[0023] In this way, the hardware required for the entire display process is allocated, ensuring that the system can successfully invoke the required hardware when display is required, and the hardware invocation between different systems during the entire display process can be isolated.

[0024] In some embodiments, the plurality of systems correspond to different user spaces and system kernels. In this way, the user spaces and system kernels between the systems are separated, avoiding the case that a high-security system is attacked by a low-security system when the user spaces and system kernels are shared.

[0025] In step 104, the register address space of the hardware resources is determined according to the preset configuration file, so as to limit the access permission of the system corresponding to the hardware resources to the register address space.

[0026] In step 106, the to-be-displayed pictures corresponding to each system are received, and the to-be-displayed pictures are respectively output by the hardware resources corresponding to each system.

[0027] In some embodiments, outputting the to-be-displayed pictures by the hardware resources corresponding to each system respectively comprises: when a target system in the plurality of systems accesses a target address space in a register, judging whether the target address space is within the range of the register address space corresponding to the target system; if yes, access is allowed; otherwise, an access failure prompt is returned.

[0028] In this way, when the target system accesses the hardware resources, the hardware resources to be accessed are located through the corresponding target address space, and if the target address space and the range controlled by the register address corresponding to the system are inconsistent, access is not allowed, and the system can only access the hardware resources corresponding to itself, avoiding the problem of mutual interference of multiple systems during the display process.

[0029] In some embodiments, receiving the to-be-displayed pictures corresponding to the respective systems respectively, and outputting the to-be-displayed pictures through the hardware resources corresponding to the respective systems respectively includes: when a target system in the plurality of systems receives a to-be-displayed picture, accessing a target hardware resource allocated to the target system through a display driver of the target system; and outputting the to-be-displayed picture through the target hardware resource. In this way, the display process of the to-be-displayed picture in the system is controlled by the display driver of the system itself, and the display driver is limited to only being able to access the bound hardware resource, thereby realizing independent display processes of the to-be-displayed pictures of different systems.

[0030] In some embodiments, the to-be-displayed picture includes image data and parameter configuration, and receiving the to-be-displayed pictures corresponding to the respective systems respectively, and outputting the to-be-displayed pictures through the hardware resources corresponding to the respective systems respectively includes: processing the image data according to the parameter configuration to obtain a target display picture through a target hardware resource allocated to a target system in the plurality of systems, to output the target display picture. In this way, the image data itself and the requirements during display are distinguished, and the display effect of the to-be-displayed picture can be separately defined, thereby improving the flexibility of display.

[0031] In some embodiments, the method can further include: when each system is initialized, reading the hardware resources corresponding to the respective systems; and registering the hardware resources in the display drivers corresponding to the respective systems of the single display controller respectively. In this way, after the target hardware resource corresponding to the target system is obtained, the target hardware resource is registered in the display driver of the target system, and when the display driver needs to call the corresponding hardware resource to complete the display of the to-be-displayed picture, the target hardware resource registered can be directly called, the process of permission judgment is simplified, and the hardware resource associated with other systems is avoided from being called, thereby realizing isolation of different systems during display.

[0032] In some embodiments, the systems in the above include an instrument panel system and a multimedia system. In this way, in a vehicle scene, different systems are used for the instrument panel and other media screens with different safety requirements, so that the instrument panel region with high safety and low interaction and the media screen region with relatively low safety requirements and high interaction can be managed and adapted for use by users in different regions.

[0033] In some embodiments, the dashboard system comprises a Linux system, and the multimedia system comprises an Android system. In this way, the security of the dashboard system is ensured by the efficient firewall of the Linux system, and the Linux system is more concise in basic functions, reducing the possibility of vulnerability; the Android system has more developers developing various application programs based on the platform, which is convenient for users to select according to needs, and the open source system is convenient for secondary development and can be transformed according to different needs.

[0034] In some embodiments, the steps S102 to S106 are completed by a display controller.

[0035] Figure 2 is a flow chart illustrating a display control method based on multiple systems in a specific scenario according to an embodiment of the present application. Referring to Figure 2 , the method comprises the following steps 202 to 206.

[0036] In step 202, the hardware resources in the display controller are allocated to different systems by specifying configuration files, so that each system can only manage and operate the allocated hardware resources, and the hardware resources / submodules in different systems are protected by a firewall. The firewall technology can use various firewall technologies that can achieve hardware isolation in the prior art, such as by limiting the accessible register address space, which is not limited here.

[0037] In this way, if one system accesses the hardware resources bound to another system due to an accident or maliciousness, the access will fail directly or an error will be thrown, thereby ensuring the security and independence between systems, i.e. one system cannot operate or control the hardware resources bound to another system.

[0038] Specifically, Figure 3 is a schematic diagram of the relationship between the system and the hardware resource according to an embodiment of the present application. Referring to Figure 3 , taking the first system as a Linux system and the second system as an Android system as an example, the hardware resources allocated to the first system include a display layer PLANE1, a display control port CRTC1, a display output interface ENCODER1 / CONNECTOR1, and a corresponding display device PANEL1. In addition, the hardware resources allocated to the second system include a display layer PLANE2, a display control port CRTC2, a display output interface ENCODER2 / CONNECTOR2, and a corresponding display device PANEL2.

[0039] In step 204, the hardware resource assigned to the first system is registered in DRM1 of the first system, and the hardware resource assigned to the second system is registered in DRM2 of the second system. For the first system, the hardware resource of the second system is invisible, because the hardware resource of the second system is not registered in DRM1, and the hardware resource of the second system is not accessed in the normal process.

[0040] In step 206, the upper-layer application in the user space userspace of the first system draws the image to be displayed, and transmits the image data (buffer) and parameter configuration of the image to be displayed to DRM1 through the interface provided by the display driver DRM1 in the kernel kernel. DRM1 updates the corresponding image buffer and parameter configuration to PLANE1, display control port CRTC1, display output interface ENCODER1 / CONNECTOR1, and corresponding display device PANEL1, and completes the display of the image to be displayed. The process does not affect the hardware resource bound with the second system.

[0041] In addition, the upper-layer application in the user space userspace of the second system draws the image to be displayed, and transmits the image data (buffer) and parameter configuration of the image to be displayed to DRM2 through the interface provided by the display driver DRM2 in the kernel kernel. DRM2 updates the corresponding image buffer and parameter configuration to PLANE2, display control port CRTC2, display output interface ENCODER2 / CONNECTOR2, and corresponding display device PANEL2, and completes the display of the image to be displayed. The process does not affect the hardware resource bound with the first system.

[0042] Figure 4 is a schematic diagram showing the data flow according to an embodiment of the present application. Referring to Figure 4 , the display device PLANE is an abstraction of a layer in the display controller, such as the Cluster layer and the Esmart layer in Figure 4 , which is responsible for reading image data from the display driver DDR through the AXI bus, and performing data format conversion, scaling, synthesis, and other processing procedures.

[0043] The display control port CRTC is an abstraction of a display output controller, such as PORT0 / 1 / 2 in Figure 4 , which is responsible for sending the synthesized image to the display output interface.

[0044] The display output interface ENCODER and CONNETOR can use RGB / DP / HDMI / EDP / DSI and the like display interfaces when implemented in the system, and is responsible for converting the parallel data output by CRTC into serial data, and sending the high-speed differential signals to the display device through the wiring on the PCB. The PANEL can use an LCD screen, a display and the like display device when implemented.

[0045] The VOP is a video output processing module, located between the graphics processing unit GPU and the display hardware (such as a display), and the GPU generates video or image data and then sends it to the VOP, which processes the image data (such as scaling, cropping, layer superposition, etc.), and then outputs the processed data to the display through a display interface (such as HDMI, eDP, etc.). The IOMMU is an input / output memory management unit, responsible for converting the virtual address configured by software to the actual physical address of the layer; because the image data accessed by the VOP is stored in DDR (double data rate synchronous dynamic random access memory), the software interacts with the virtual address, and the corresponding real physical address is converted through the IOMMU to realize the acquisition of image data.

[0046] According to another aspect of the present application, Figure 5 is a block diagram showing a display control device 300 based on multiple systems according to an embodiment of the present application. Referring to Figure 5 , the display control device 300 based on multiple systems includes a single display controller 302, which includes a first display driver 304 corresponding to a first system of a plurality of systems and a second display driver 306 corresponding to a second system of the plurality of systems.

[0047] The first display driver 304 is configured to manage a first hardware resource 303 allocated to the first system according to a preset configuration file. The first display driver 304 is configured to have access authority limited to a first register address space of the first hardware resource 303 determined according to the preset configuration file. In addition, the first display driver 304 is configured to receive a first to-be-displayed picture corresponding to the first system and output the first to-be-displayed picture through the first hardware resource 303.

[0048] The second display driver 305 is configured to manage the second hardware resource 305 assigned to the second system according to the preset configuration file. The second display driver 305 is configured to have access authority limited to a second register address space of the second hardware resource 305 determined according to the preset configuration file. In addition, the second display driver 305 is configured to receive a second to-be-displayed picture corresponding to the second system and output the second to-be-displayed picture through the second hardware resource 305.

[0049] In some embodiments, Figure 6 is a block diagram illustrating a first hardware resource 303 and a second hardware resource 305 according to an embodiment of the present application. Refer to Figure 6 The multi-system based display control apparatus can further include the first hardware resource 303 and the second hardware resource 305.

[0050] The first hardware resource 303 includes a first input module 3031, a first video processing module 3032, and a first output module 3033, the first input module 3031 is coupled to the first video processing module 3032, the first video processing module 3032 is coupled to the first output module 3033, and the first output module 3033 is coupled to a first display device 3034.

[0051] The second hardware resource 305 includes a second input module 3051, a second video processing module 3052, and a second output module 3053, the second input module 3053 is coupled to the second video processing module 3052, the second video processing module 3052 is coupled to the second output module 3053, and the second output module 3053 is coupled to a second display device 3054.

[0052] According to still another aspect of the present application, Figure 7 is a schematic diagram illustrating an electronic device 400 according to an embodiment of the present application. Refer to Figure 7 The electronic device 400 includes a memory 402, a processor 404, and a computer program stored on the memory and executable on the processor, the processor implements each step of the multi-system based display control method as described above when executing the computer program.

[0053] According to still another aspect of the present application, a computer readable medium is provided. The computer readable medium has a computer program stored thereon, the computer program is executable by a processor to implement the multi-system based display control method as described above.

[0054] In summary, the display control method and device based on multiple systems, and the electronic equipment provided by the present application bind the hardware resources that can be used for each system by reading the configuration file, and the hardware resources that are not configured to the target system in the configuration file cannot be called by the target system, thereby realizing the isolation of the corresponding hardware resources in different systems. The hardware resources corresponding to each system are independent of each other, and if a system has a communication exception or other problems that cannot normally display, the display of other systems will not be affected. In addition, a display controller does not need to be separately set for each system, and the display process can be completed only by registering the hardware resources on the display driver of the corresponding system, thereby avoiding the waste caused by setting multiple display controllers on the chip.

[0055] The above description is only an embodiment of the present application, and does not limit the patent scope of the present application, and any equivalent transformation or direct or indirect application in the related technical field by using the content of the specification and drawings of the present application is also included in the patent protection scope of the present application.

Claims

1. A display control method based on multiple systems, characterized in that: include: Reading preset configuration files for multiple systems, and determining hardware resources corresponding to each system according to the preset configuration files; determining a register address space of the hardware resource according to the preset configuration file, so as to limit access rights of a system corresponding to the hardware resource to the register address space; as well as The images to be displayed corresponding to the respective systems are received, and the images to be displayed are output respectively through the hardware resources corresponding to the respective systems.

2. The multi-system based display control method according to claim 1, characterized in that: Determining the hardware resources corresponding to each system according to the preset configuration file includes: The display layer, display control port, display output interface and display device corresponding to each system are allocated according to the preset configuration file.

3. The multi-system based display control method according to claim 1, wherein: Also includes: When initializing each system, reading the hardware resources corresponding to each system; as well as The hardware resources are registered respectively in display drivers corresponding to the respective systems of a single display controller.

4. The multi-system based display control method according to claim 1, characterized in that: Outputting the to-be-displayed images respectively by using the hardware resources corresponding to the respective systems includes: When a target system among the plurality of systems accesses a target address space in a register, determining whether the target address space is within a range of the register address space corresponding to the target system; If so, access is allowed; Otherwise, an access failure prompt is returned.

5. The multi-system based display control method according to claim 3, wherein: Receiving the to-be-displayed images corresponding to the respective systems, and outputting the to-be-displayed images respectively through the hardware resources corresponding to the respective systems includes: When a target system among the multiple systems receives a picture to be displayed, accessing the target hardware resources allocated to the target system through a display driver of the target system; and The image to be displayed is outputted through the target hardware resources.

6. The multi-system based display control method according to claim 1, characterized in that: The picture to be displayed includes image data and parameter configuration, wherein receiving the picture to be displayed corresponding to each system respectively, and outputting the picture to be displayed respectively through the hardware resources corresponding to each system respectively includes: The target hardware resources allocated to the target system among the multiple systems process the image data according to the parameter configuration to obtain a target display screen, so as to output the target display screen.

7. The multi-system based display control method according to claim 1, characterized in that: The multiple systems correspond to different user spaces and system kernels.

8. A multi-system based display control device, characterized in that: include: A single display controller, including: a first display driver corresponding to a first system among the plurality of systems, configured to manage a first hardware resource allocated to the first system according to a preset configuration file, having access rights limited to a first register address space of the first hardware resource determined according to the preset configuration file, and receiving a first to-be-displayed picture corresponding to the first system and outputting the first to-be-displayed picture through the first hardware resource; as well as A second display driver corresponding to a second system among the multiple systems is configured to manage a second hardware resource allocated to the second system according to the preset configuration file, has access rights limited to a second register address space of the second hardware resource determined according to the preset configuration file, and receives a second to-be-displayed picture corresponding to the second system and outputs the second to-be-displayed picture through the second hardware resource.

9. The multi-system based display control device according to claim 8, characterized in that: Also includes: The first hardware resource includes a first input module, a first video processing module, and a first output module, wherein the first input module is coupled to the first video processing module, the first video processing module is coupled to the first output module, and the first output module is coupled to a first display device; as well as The second hardware resource includes a second input module, a second video processing module and a second output module, the second input module is coupled to the second video processing module, the second video processing module is coupled to the second output module, and the second output module is coupled to a second display device.

10. An electronic device, characterized in that: include: a memory configured to store an executable program; as well as A processor is configured to execute the program to implement the multi-system based display control method according to any one of claims 1 to 7.

Images