Display switching control device and method, equipment and medium

Abstract

The embodiment of the invention provides a display switching control device and method, equipment and a medium, an intelligent system layer, a hardware description layer, a kernel display driving layer and a hardware layer are arranged, and the kernel display driving layer can combine at least two display interfaces to the same display control processing unit for driving based on display information; limited display control processing units can adapt to more display interfaces corresponding to the display content in number, and the transmission requirement of multiple display contents can be met without additionally increasing the number of the display control processing units. The intelligent system layer instructs the hardware description layer to process the display content into target display content matched with the corresponding display information, it is ensured that the display interface after merging and driving can accurately present the corresponding content, and flexible adaptation between the display control processing unit and the display interface is achieved through the hierarchical collaborative design. The stability and the accuracy of content display in multiple display scenes are guaranteed, so that the adaptation capability and the use flexibility of the multiple display scenes are improved.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and in particular to a display switching control device, method, apparatus and medium. Background Technology

[0002] With the widespread adoption of multi-screen entertainment, multi-screen office, smart cockpits, and other multi-display scenarios, current display devices need to handle multiple display contents simultaneously. Related technologies often employ a one-to-one correspondence between display control processing units and display interfaces, with external monitors connected via these interfaces for content display. However, the number of display control processing units in a display device is limited. When the number of display interfaces exceeds the number of display control processing units, some display interfaces may fail to display content, thus reducing adaptability and flexibility for multi-display scenarios. Summary of the Invention

[0003] The main objective of this disclosure is to provide a display switching control device, method, apparatus, and medium that can improve adaptability and flexibility in use for multiple display scenarios.

[0004] To achieve the above objectives, a first aspect of this disclosure provides a display switching control device, comprising: an intelligent system layer, a hardware description layer, a kernel display driver layer, and a hardware layer, wherein... The intelligent system layer is used to receive multiple display contents; the hardware description layer is connected to the intelligent system layer; the kernel display driver layer is connected to the hardware description layer; the hardware layer includes multiple display control processing units and multiple display interfaces, the number of display control processing units is less than the number of display interfaces, the number of display interfaces corresponds to the number of display contents, and the hardware layer is connected to the kernel display driver layer to drive each of the display control processing units through the kernel display driver layer; The kernel display driver layer is used to send the display information of the display control processing unit and the display interface to the intelligent system layer after passing through the hardware description layer; the intelligent system layer is used to instruct the kernel display driver layer based on the display information to merge at least two of the display interfaces into one of the display control processing units for driving, so as to establish a connection relationship between the multiple display control processing units and the multiple display interfaces; The intelligent system layer is also used to instruct the hardware description layer, based on the display information, to process each display content into the target display content under the corresponding display information and then send it to the content display driver layer to drive the corresponding display control processing unit to perform processing.

[0005] In some embodiments, the kernel display driver layer is used to obtain the interface type of each display interface based on the display information, and to merge at least two display interfaces of the same interface type into one of the display control processing units for driving.

[0006] In some embodiments, the kernel display driver layer is further configured to obtain an importance score for each of the display interfaces based on the display information, and to filter at least two display interfaces of the same interface type according to the order of the importance scores from low to high, and merge them into one of the display control processing units for driving.

[0007] In some embodiments, the kernel display driver layer is further configured to determine the main screen interface among a plurality of display interfaces based on the display information, and to merge at least two display interfaces of the same interface type into one of the display control processing units for driving among the other display interfaces besides the main screen interface.

[0008] In some embodiments, at least two display interfaces that are driven in the same display control processing unit are called target merging interfaces. The hardware description layer is used to merge the display content corresponding to the target merging interface based on the display information to obtain the target display content of the corresponding display control processing unit.

[0009] In some embodiments, the hardware description layer is further configured to determine the target resolution driven by each of the display control processing units based on the display information, and to obtain the initial resolution corresponding to each of the display contents, and to fill each of the display contents from the initial resolution to the target resolution under the corresponding display information to obtain the target display content of each of the display contents under the corresponding display information.

[0010] In some embodiments, a plurality of displays are also included, the number of which is the same as the number of display contents. Each display is connected to a display interface of a corresponding interface type, and each display is used to display the corresponding target display content.

[0011] To achieve the above objectives, a second aspect of this disclosure provides a display switching control method, applied to the display switching control device described in the first aspect embodiment, the display switching control method comprising: The system acquires multiple display contents, as well as display information from multiple display control processing units and multiple display interfaces, wherein the number of display control processing units is less than the number of display interfaces, and the number of display interfaces corresponds to the number of display contents. Based on the display information, at least two of the display interfaces are merged into one of the display control processing units for driving, so that a connection relationship is established between the multiple display control processing units and the multiple display interfaces; After processing each of the display contents into the target display content under the corresponding display information based on the display information, the corresponding display control processing unit is driven to process the target display content.

[0012] To achieve the above objectives, a third aspect of this disclosure provides a display device, the display device including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the display switching control method described in the second aspect of the embodiment.

[0013] To achieve the above objectives, a fourth aspect of this disclosure provides a storage medium, which is a computer-readable storage medium storing a computer program that, when executed by a processor, implements the display switching control method described in the second aspect of the present invention.

[0014] The beneficial effects of the embodiments disclosed herein include: This disclosure embodiment adopts a hierarchical architecture consisting of an intelligent system layer, a hardware description layer, a kernel display driver layer, and a hardware layer. The kernel display driver layer can merge at least two display interfaces into the same display control processing unit based on display information. This allows a limited number of display control processing units to adapt to a larger number of display interfaces corresponding to the number of display contents, meeting the transmission requirements of multiple display contents without increasing the number of display control processing units. The intelligent system layer instructs the hardware description layer to process the display content into target display content adapted to the corresponding display information, ensuring that the merged display interfaces can accurately present the corresponding content. This hierarchical collaborative design achieves flexible adaptation between the display control processing unit and the display interface, ensuring the stability and accuracy of content display in multiple display scenarios, thereby improving the adaptability and flexibility of use in multiple display scenarios. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the structure of the display switching control device provided in the embodiments of this disclosure; Figure 2 This is a schematic diagram of an electronic card table scenario provided in an embodiment of this disclosure; Figure 3 These are the display relationships within different levels provided in the embodiments of this disclosure; Figure 4 This is a flowchart illustrating the display switching control method provided in an embodiment of this disclosure; Figure 5This is a schematic diagram of the hardware structure of the display device provided in the embodiments of this disclosure. Detailed Implementation

[0016] The accompanying drawings in the embodiments clearly and completely describe the technical solutions in the embodiments of this disclosure. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments in this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0017] It is understood that in the specific embodiments of this disclosure, which involve retrieving initial time-series data, initial sample time-series data and related data, when the above embodiments of this disclosure are applied to specific products or technologies, permission or consent from the target is required, and the collection, use and processing of related data must comply with relevant laws, regulations and standards.

[0018] Furthermore, when the embodiments of this disclosure require access to initial timing data, initial sample timing data, and related data, separate permission or consent to the initial timing data, initial sample timing data, and related data will be obtained through pop-up windows or redirection to a confirmation page. After clearly obtaining separate permission or consent to the initial timing data, initial sample timing data, and related data, the necessary initial timing data, initial sample timing data, and related data for enabling the embodiments of this disclosure to operate normally will be obtained.

[0019] In this disclosure, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.

[0020] Please see Figure 1 , Figure 1 This is a schematic diagram of the structure of the display switching control device provided in this embodiment. The display switching control device includes: an intelligent system layer, a hardware description layer, a kernel display driver layer, and a hardware layer, wherein: The intelligent system layer is used to receive multiple display contents; the hardware description layer is connected to the intelligent system layer; the kernel display driver layer is connected to the hardware description layer; the hardware layer includes multiple display control processing units and multiple display interfaces. The number of display control processing units is less than the number of display interfaces. The number of display interfaces corresponds to the number of display contents. The hardware layer is connected to the kernel display driver layer so that each display control processing unit can be driven through the kernel display driver layer. The kernel display driver layer is used to send the display information of the display control processing unit and display interface to the intelligent system layer after passing through the hardware description layer. The intelligent system layer is used to instruct the kernel display driver layer based on the display information to merge at least two display interfaces into one of the display control processing units for driving, so as to establish a connection relationship between multiple display control processing units and multiple display interfaces. The intelligent system layer is also used to instruct the hardware description layer to process each display content into the target display content under the corresponding display information based on the display information, and then send it to the content display driver layer to drive the corresponding display control processing unit to process it.

[0021] In the above embodiments, the intelligent system layer is the core scheduling layer connecting the application (App) and the hardware description layer. For example, the intelligent system layer is used to receive the display content output by multiple applications (App), define the display sequence number for the application to address the display through the sequence number, manage the display information such as the resolution, width, height, width / height start position and end position of each display and provide it to the application; based on the hardware display information fed back by the hardware description layer, it sends the display interface merging instruction to the kernel display driver layer, and at the same time sends the display content processing instruction to the hardware description layer.

[0022] The Hardware Description Layer (HDL), also known as the Hardware Abstraction Layer or Display Hal layer, is an information processing relay station between the Intelligent System Layer and the Kernel Display Driver Layer. Connected to the Intelligent System Layer, the HDL reads hardware display information transmitted by the Kernel Display Driver Layer. Based on the processing instructions from the Intelligent System Layer, it segments or merges multiple display contents, transforming them into target display content adapted to the hardware display parameters before sending them to the Kernel Display Driver Layer. The segmentation process adapts to the resolution differences between the display content and the monitor, while the merging process adapts to the driver requirements of multiple display interfaces and a single display control processing unit.

[0023] The kernel display driver layer is a hardware driver execution layer that connects the hardware description layer and the hardware layer. The kernel display driver layer is connected to both the hardware description layer and the hardware layer. It is used to initialize the display interface driver, display conversion chip driver (including DSI to LVDS chip, HDMI to GVI chip, RGB to LVDS chip, DP to LVDS chip, etc.) and display control processing unit of the hardware layer. Based on the merging instructions of the intelligent system layer, it merges at least two display interfaces of the same type into the same display control processing unit for driving, and establishes the correspondence between the display control processing unit and the display interface. At the same time, it feeds back hardware display information to the hardware description layer.

[0024] The hardware layer is the physical hardware carrier of the display switching control device, including multiple display control processing units and multiple display interfaces (such as HDMI / DP / RGB / DSI, etc.). Furthermore, the hardware layer may also include display conversion chips (DSI to LVDS, HDMI to GVI, etc.) and a monitor, which is the final presentation carrier of the displayed content.

[0025] The display control processing unit is the core module in the hardware layer processor responsible for display processing. It is a core hardware module responsible for driving the display interface and processing display signals. Its number is fixed and less than the number of display interfaces. In the embodiments of this disclosure, the utilization rate can be improved by merging the driving of multiple display interfaces of the same type.

[0026] The display interface is a signal transmission interface (such as HDMI / DP / DSI, etc.) that connects the display conversion chip and the display in the hardware layer. The display interface is a transmission channel for display signals and can be used to connect to the display or other display modules. The number of display interfaces corresponds to the number of display content (number of Apps). For example, the number of display interfaces is the same as the number of display content, or greater than the number of display content. This disclosure embodiment uses the example of the number of display interfaces being the same as the number of display content for illustration.

[0027] In addition, the number of display control processing units is less than the number of display interfaces. The number of display interfaces corresponds one-to-one with the number of display contents. The display control processing unit is used to receive the drive signals of the kernel display driver layer and transmit the target display content to the display for presentation through the display interface and the display conversion chip.

[0028] The display information includes the display serial number for application addressing, hardware interface type (such as HDMI / DP / RGB / DSI, etc.), display resolution, width, height, and start and end positions in the width and height directions (the default start position is 0, and the end position corresponds to the width and height). It also covers key information such as the display conversion chip associated with the adapted hardware and the buffer size of the display content after processing by the hardware description layer, providing basic data support for the scheduling, adaptation, and driving of display content between different layers.

[0029] It should be noted that the embodiments disclosed herein adopt a four-level architecture consisting of an intelligent system layer, a hardware description layer, a kernel display driver layer, and a hardware layer. This architecture enables the division of labor and collaboration among software scheduling, information processing, hardware driving, and content display, avoiding overload of a single layer and addressing the issues of insufficient display control processing units and mismatch between display content and hardware parameters. Each layer is sequentially connected to form a closed-loop transmission path, ensuring unidirectional transmission and bidirectional feedback of display information and control commands. Specifically, the intelligent system layer is connected to the hardware description layer to enable the issuance of display requests and the uploading of hardware information, allowing software scheduling to accurately match hardware capabilities. The hardware description layer is connected to the kernel display driver layer to complete the adaptation processing of display content and the transmission of driver commands, resolving parameter mismatch issues. The kernel display driver layer is connected to the hardware layer to accurately drive the processed display signals to the corresponding display interfaces, achieving multi-screen synchronous display.

[0030] By merging display interface drivers and adapting display content, this embodiment of the present disclosure enables limited hardware resources to adapt to more display interfaces and display content without increasing the number of display control processing units, thereby improving the adaptability and flexibility of multiple display scenarios, while ensuring the accuracy and stability of the display content.

[0031] Therefore, this embodiment does not require an additional number of display control processing units. By merging the display interface drivers in the kernel display driver layer, it achieves adaptation of limited hardware resources to more display interfaces, reducing hardware costs. Furthermore, the hardware description layer can perform segmentation and merging processing, solving the problem of mismatch between display content and monitor resolution and aspect ratio, ensuring accurate presentation of display content without distortion or incomplete display. In addition, the intelligent system layer's display sequence management and information coordination support multiple applications to control independent displays, achieving synchronous and stable presentation of multiple display contents, improving the flexibility of use in multi-display scenarios. Therefore, the four-level hierarchical architecture has clear division of labor and efficient collaboration, ensuring the smoothness of display command transmission and content processing, and improving the stability and reliability of multi-screen display.

[0032] In addition, the display switching control device in this embodiment also includes an application layer, which is connected to the intelligent system layer. The application layer contains multiple applications, the number of which corresponds to the number of display interfaces. For example, the number of applications is the same as the number of display interfaces. Figure 1The application layer shown includes five applications: main app, app1, app2, app3, and app4. The display interfaces include five ports: DSI1, DSI2, HDMI, RGB, and DP. Each application corresponds to one piece of content to be displayed, and the application generates this content. Alternatively, if the number of applications exceeds the number of display interfaces, the application's display content is scheduled by the intelligent system layer and then adapted to multiple display interfaces by the display Hal layer. This allows for flexible display of content from a small number of applications through multiple display interfaces, adapting to scenarios where multiple users share the same application content or the same application is presented in a split-screen format.

[0033] Based on this, the display switching control device in this embodiment of the present disclosure, through setting a hierarchical architecture of intelligent system layer, hardware description layer, kernel display driver layer and hardware layer, allows the kernel display driver layer to merge at least two display interfaces into the same display control processing unit based on display information. This enables a limited number of display control processing units to adapt to a larger number of display interfaces corresponding to the number of display contents, without increasing the number of display control processing units to meet the transmission requirements of multiple display contents. The intelligent system layer instructs the hardware description layer to process the display content into target display content adapted to the corresponding display information, ensuring that the merged display interface can accurately present the corresponding content. This hierarchical collaborative design realizes flexible adaptation between display control processing units and display interfaces, ensuring the stability and accuracy of content display in multiple display scenarios, thereby improving the adaptability and flexibility of use in multiple display scenarios.

[0034] Furthermore, in this embodiment of the kernel display driver layer, the interface type of each display interface is obtained based on the display information, and at least two display interfaces of the same interface type are merged into one of the display control processing units for driving.

[0035] Specifically, the display information may include the hardware interface type of each display interface (such as HDMI, DP, RGB, DSI, etc.). The kernel display driver layer first parses the specific type of each display interface from the display information transmitted by the hardware description layer and completes the classification and identification of the interface type. Then, for the same type of display interface, the kernel display driver layer will execute the merged driver logic, that is, select a display control processing unit and associate at least two display interfaces of the same type with the unit. The single display control processing unit will uniformly undertake the driving tasks of these multiple interfaces of the same type, and establish a one-to-many driving relationship between the single display control processing unit and these merged multiple interfaces of the same type.

[0036] For example, in electronic card table (such as electronic mahjong table) applications, the hardware layer includes two display interfaces of the same type, DSI1 and DSI2. However, the number of display control processing units is limited. The kernel display driver layer recognizes that both are DSI interface types and merges them into the same display control processing unit for driving. Similarly, if there are two interfaces of the same type, HDMI0 and HDMI1, they can also be merged into a single display control processing unit using the same logic. The core advantage of this design is that it eliminates the need to increase the number of display control processing units. By simply merging and scheduling similar interfaces at the software level, a limited number of display control processing units can adapt to more display interfaces, significantly improving hardware resource utilization. Simultaneously, it ensures that each merged display interface can synchronously receive the drive signals output by the display control processing unit, which, after processing by the display conversion chip, accurately drive the corresponding display to present content.

[0037] Therefore, the embodiments disclosed herein avoid the problem of some display interfaces being unusable due to insufficient display control processing units, and do not require additional hardware costs. Through the intensive use of hardware resources, flexible adaptation between display control processing units and display interfaces is achieved, further improving the adaptability and flexibility of use in multiple display scenarios.

[0038] Furthermore, the kernel display driver layer in this embodiment is also used to obtain the importance score of each display interface based on the display information, and to filter at least two display interfaces of the same interface type according to the ranking of importance scores from low to high, and merge them into one of the display control processing units for driving.

[0039] Specifically, the display information can include priority-related data for each display interface (such as display serial number, resolution specification, function positioning identifier, interaction frequency parameters, etc.). This data is the core basis for importance scoring. The kernel display driver layer first extracts the above key parameters from the display information transmitted from the hardware description layer. Through preset scoring rules, such as the main screen identifier having the highest weight, the core interactive screen scoring higher than the auxiliary display, and the high-resolution interface scoring higher than the low-resolution interface, the importance score of each display interface is calculated, thus completing the priority quantification and differentiation of each interface. Subsequently, all display interfaces are sorted from low to high according to their importance scores, clarifying the scope of low-priority interfaces. Finally, among the sorted low-priority interfaces, at least two display interfaces of the same type are selected and merged into the same display control processing unit for unified driving, while high-importance interfaces retain independent display control processing units to avoid performance loss caused by merging.

[0040] For example, in electronic card table (such as electronic mahjong table) application scenarios, the HDMI interface (square screen, 1856x1856 resolution) corresponding to display information display serial number 0 is a high-importance interface with the highest score; the bar screens corresponding to display serial numbers 1 (DP interface) and 2 (RGB interface) are medium-importance interfaces; the bar screens corresponding to display serial numbers 3 and 4 (both DSI interfaces) are auxiliary displays with low interaction frequency and low functional priority, and the lowest importance score. After sorting the kernel display driver layer from low to high scores, it selects displays 3 and 4 corresponding to the same type of DSI interface and merges them into the same display control processing unit driver; the high-scoring HDMI interface, the medium-scoring DP interface, and the RGB interface are each independently assigned to a display control processing unit, ultimately achieving the requirement of 4 display control processing units adapting to 5 display interfaces, while the display stability of the core interactive screen is not affected.

[0041] This disclosure implements a priority distinction for display interfaces through an importance scoring system. High-importance interfaces (such as the core interactive screen and the main screen) are given priority access to independent display control processing units, ensuring their display response speed and stability, and avoiding latency or stuttering caused by merging drivers. Furthermore, the merging of drivers for low-importance interfaces of the same type continues the logic of adapting more interfaces to limited hardware resources. This can meet the needs of multiple screens without increasing the number of display control processing units, reducing hardware costs. The introduction of the scoring mechanism makes resource scheduling more flexible and can adapt to multiple display scenarios with different priority requirements, greatly improving the scenario adaptation range of the device, realizing differentiated management of display interfaces, and balancing the stability of multi-screen display with resource utilization. This is especially suitable for multi-display devices with clear priority distinctions.

[0042] Furthermore, the kernel display driver layer in this embodiment is also used to determine the main screen interface among multiple display interfaces based on display information, and to merge at least two display interfaces of the same interface type into one of the display control processing units for driving among the other display interfaces besides the main screen interface.

[0043] Specifically, the display information may include functional positioning identifiers for each display interface (such as display serial number, core functional attributes, etc.). The kernel display driver layer first parses the key data used to distinguish the master and slave display roles from the display information transmitted by the hardware description layer. For example, based on information such as display serial number priority, resolution specifications, and interface type importance, it determines one of the display interfaces as the master screen interface. The master screen interface usually corresponds to the core display scenario, and its display content is mostly core interactive information. It is necessary to prioritize the stability and response speed of the independent driver. Therefore, the kernel display driver layer will allocate a separate display control processing unit for it to avoid performance loss caused by merging with other auxiliary interfaces.

[0044] After determining the main screen interface and completing the independent driver configuration, the kernel display driver layer will focus on other display interfaces besides the main screen interface. First, it will identify the types of these auxiliary interfaces, filter out at least two display interfaces of the same type, and then merge them into the same display control processing unit for unified driving.

[0045] This embodiment of the disclosure ensures the transmission efficiency and stability of core display content through independent driving of the main screen interface, avoiding the impact of interface merging on core interactive scenarios. The master-slave differentiation driving strategy makes display resource scheduling more targeted. Based on the original merging and driving of similar interfaces, this function adds a priority identification and independent driving mechanism for the main screen interface, which not only solves the core problem of insufficient display control processing units, but also takes into account the performance requirements of core display scenarios, further improving the adaptability and display stability of multiple display scenarios.

[0046] Furthermore, in this embodiment of the present disclosure, at least two display interfaces that are merged into the same display control processing unit for driving are called target merging interfaces. The hardware description layer is used to merge the display content corresponding to the target merging interface based on the display information to obtain the target display content of the corresponding display control processing unit.

[0047] Specifically, the target merging interface is determined by the kernel display driver layer according to the instructions of the intelligent system layer, which specifies at least two display interfaces of the same type (such as the DSI1 and DSI2 interfaces in the above embodiment) that need to be merged into the same display control processing unit for driving. The display information may include the core parameters corresponding to the target merging interface, including the resolution, width and height of the display content associated with each interface, the start and end positions of the width and height directions, the interface type matching relationship, etc. These parameters provide a precise basis for the merging process of the hardware description layer.

[0048] The hardware description layer can receive the original display content corresponding to each target merging interface from the intelligent system layer (such as the 1920x200 resolution display content corresponding to 3 and 4 in an electronic card table). Then, based on the position and size parameters in the display information, it determines the merging rules, such as splicing in the width direction or the height direction. In this embodiment, the width direction connection is taken as an example. Then, according to the merging rules, multiple original display contents are integrated and spliced ​​at the software level to form a single continuous merged display content (such as horizontally splicing two 1920x200 contents into a 3840x200 merged content). Finally, combined with the hardware display parameters fed back by the kernel display driver layer (such as the driver resolution of 3840x1080 corresponding to the target display control processing unit), the target display content adapted to the driver requirements of the display control processing unit is generated and sent to the kernel display driver layer.

[0049] This disclosure embodiment, through the merging of display content, allows multiple independent display needs to be adapted to the driving logic of a single display control processing unit. This resolves the contradiction of insufficient display control processing units but the need for independent content presentation by display interfaces. Based on the precise merging of display information, the continuity and integrity of the target display content after merging are ensured, avoiding splicing misalignment or content loss. Through content integration at the software level, limited hardware resources can be adapted to more display interfaces, reducing hardware costs while ensuring the independence and stability of multi-screen displays.

[0050] Furthermore, the hardware description layer in this embodiment is also used to determine the target resolution driven by each display control processing unit based on the display information, and to obtain the initial resolution corresponding to each display content, and to fill each display content from the initial resolution to the target resolution under the corresponding display information to obtain the target display content of each display content under the corresponding display information.

[0051] Specifically, the display information can contain several key parameters: first, the target resolution, which is the hardware-adapted resolution driven by each display control processing unit; and second, the initial resolution, which is the original resolution of the display content transmitted by the intelligent system layer, generated by the application program, corresponding to the original size of the display content. The hardware description layer can accurately parse the target resolution of each display control processing unit based on the display information. Then, when receiving display content from the intelligent system layer, it synchronously obtains the initial resolution of each display content. Subsequently, it uses software padding technology to adapt the buffer data (content buffer) of the display content, including keeping the core effective area of ​​the display content unchanged, adding blanks or adaptive padding content to the buffer data, and stretching or expanding the size of the display content from the initial resolution to the target resolution. Finally, it generates target display content that meets the requirements of the display control processing unit driver and sends it to the kernel display driver layer.

[0052] For example, in an electronic card table application scenario, the application corresponding to display 0 outputs square screen content with an initial resolution of 1856x1856, while the target resolution of its associated display control processing unit is 3840x2160 (the hardware driver resolution corresponding to the HDMI interface). After receiving the display content, the hardware description layer fills the content buffer, retaining the core content of 1856x1856 and supplementing the remaining areas with adaptation data, so that the overall buffer size reaches 3840x2160. As another example, the initial resolution of the merged display 3 and 4 is 3840x200, and the target resolution of the corresponding display control processing unit is 3840x1080 (the hardware driver resolution corresponding to the DSI interface). The hardware description layer then fills the merged 3840x200 content with adaptation data along the height direction, expanding the buffer size to 3840x1080, ensuring that the display control processing unit can receive and drive the display normally.

[0053] This embodiment of the disclosure achieves software adaptation to hardware through resolution padding. It can solve the problem of mismatch between the displayed content and the hardware resolution and aspect ratio without modifying the hardware driver or application logic, ensuring the integrity and distortion-free display content. Furthermore, the padding process works in synergy with the merging and segmentation of the displayed content, enabling the hardware description layer to have full-scene content adaptation capabilities, adapting to different combinations of display requirements and hardware parameters, and further improving the device's flexibility and reliability in adapting to multiple display scenarios.

[0054] Furthermore, this embodiment of the present disclosure also includes multiple displays, the number of which is the same as the number of displayed contents. Each display is connected to a display interface of a corresponding interface type, and each display is used to display the corresponding target display content.

[0055] Specifically, the monitor, as the final visual terminal of the display switching control device, is a hardware-level presentation component. The number of monitors is consistent with the number of display contents generated by the application. Each display content can correspond to a dedicated presentation carrier, avoiding screen congestion or content conflicts caused by multiple display contents sharing a single monitor.

[0056] Secondly, the connection between the monitor and the display interface follows the principle of interface type adaptation. Each monitor establishes a connection with the corresponding display interface type in the hardware layer according to its own hardware specifications. For example, a monitor with an HDMI interface connects to the HDMI display interface in the hardware layer, a monitor with a DSI interface connects to the DSI display interface, a monitor with a DP interface connects to the DP display interface, and a monitor with an RGB interface connects to the RGB display interface. This adaptive connection ensures the compatibility and stability of display signal transmission, avoiding problems such as signal loss, display delay, or inability to display due to interface type incompatibility.

[0057] For example, please refer to Figure 2 , Figure 2 This is a schematic diagram of an electronic card table scenario provided in this embodiment. This embodiment is only used as an example in a multi-screen entertainment scenario. Specifically, the electronic card table, while satisfying the requirements of this embodiment, can also be applied to multi-screen office, smart cockpit, and other multi-screen display scenarios. This embodiment does not impose specific limitations on these applications. Specifically, the electronic card table has 5 displays, each corresponding to one display interface, including 1 main display (square screen) and 4 strip screens. The display parameters of each screen are shown in Table 1 below: Table 1, Multi-screen parameter table:

[0058] The hardware description layer can obtain the following table by reading the display information from each display control processing unit: Table 2, Display Information Table for Each Display Control Processing Unit:

[0059] Among them, display unit 1, display unit 2, display unit 3 and display unit 4 represent the serial numbers of each display control processing unit.

[0060] Next, please refer to Figure 3 , Figure 3 This is a display relationship diagram within different levels provided in this embodiment. In this embodiment, the intelligent system layer defines display content sequence numbers (e.g., display 1 to display 5), allowing applications to address displays through these sequence numbers and manage information for each display, including display resolution, display width and height, start and end positions in the width direction, and start and end positions in the height direction, which are then provided to the application. For ease of application design, the start position in the width direction is 0, and the end position is equal to the width; the start position in the height direction is 0, and the end position in the height direction is equal to the height.

[0061] The kernel display driver layer needs to initialize the drivers for each display interface, including the display conversion chip drivers (DSI to LVDS, HDMI to GVI, RGB to LVDS, DP to LVDS, etc.) and the display control processing unit. Displays with the same interface type can be controlled by the same display control unit. For example, if there are two interfaces, DSI0 (display interface 4) and DSI1 (display interface 5) (corresponding to displays 4 and 5 before the display merging relationship), these two displays can be merged into a single DSI display (driven by display unit 4) and handled by a single display control processing unit. Conversely, if there are two interfaces, HDMI0 and HDMI1, they can be merged into a single HDMI display and handled by a single display control processing unit. The kernel display driver layer provides the display information shown in Table 2 to the hardware description layer.

[0062] In this embodiment, the hardware description layer segments the aforementioned display information into individual display information pieces and provides them to the intelligent system layer. The intelligent system layer specifies which display content to display. After processing by the hardware description layer, the content is sent to the kernel display driver layer for further processing. In this embodiment, display 1 contains 1856x1856 content at the intelligent system layer, but the driver layer's resolution is 3840x2160. Therefore, the hardware description layer receives the content of display 1, fills the content buffer to a size of 3840x2160, and then sends it to the kernel display driver layer. Displays 4 and 5 both contain 1920x200 content. The hardware description layer connects the content of display 4 and display 5 along the width direction, resulting in 3840x200 content, then fills the content buffer to a size of 3840x1080, and then sends it to the kernel display driver layer.

[0063] Finally, the kernel display driver layer processes the target display content from the hardware description layer through the display control processing unit and sends it to each display for display. For example, the content of display 1 corresponding to the main program will be displayed on the corresponding square screen through display unit 1 driving display interface 1; the content of display 2 corresponding to program 1 will be displayed on the corresponding bar screen 1 through display unit 2 driving display interface 2; the content of display 3 corresponding to program 2 will be displayed on the corresponding bar screen 2 through display unit 3 driving display interface 3; and the content of display 4 and display 5 corresponding to programs 3 and 4 will be displayed on the corresponding bar screens 3 and 4 through display unit 4 driving display interface 4 and display interface 5.

[0064] It should be noted that the above Figures 1 to 3 The schematic diagram of the implementation environment shown is merely an example. The scenarios described in this disclosure are intended to more clearly illustrate the technical solutions of this disclosure and do not constitute a limitation on the technical solutions provided in this disclosure. As those skilled in the art will know, with the evolution of technology and the emergence of new business scenarios, the technical solutions provided in this disclosure are also applicable to similar technical problems.

[0065] Please see Figure 4 , Figure 4 This is a flowchart illustrating the display switching control method provided in an embodiment of this disclosure. This display switching control method can be applied to the display switching control device in the above embodiments, and the display switching control method includes steps S101 to S103: Step S101: Obtain multiple display contents, and obtain display information of multiple display control processing units and multiple display interfaces, wherein the number of display control processing units is less than the number of display interfaces, and the number of display interfaces corresponds to the number of display contents; Step S102: Based on the display information, at least two display interfaces are merged into one of the display control processing units for driving, so as to establish a connection relationship between the multiple display control processing units and the multiple display interfaces; Step S103: After processing each display content into the target display content under the corresponding display information based on the display information, drive the corresponding display control processing unit to process the target display content.

[0066] Regarding step S101 above, this embodiment of the disclosure can obtain display content and display information, collect two types of key data required for subsequent adaptation and driving, lay the foundation for establishing display logic association, and ensure that subsequent steps accurately match hardware capabilities and display requirements.

[0067] Specifically, the first type of content to be acquired consists of multiple display contents. These contents can be generated by multiple applications at the application layer (such as MainApp, App1~App4), each application corresponding to an independent display requirement (such as the core game interface of the main program in an electronic card table, and the player's hand interface of each sub-program). The display contents can also be intelligently generated by the system or obtained from other channels, without specific restrictions. The number of display control processing units is less than the number of display interfaces, and the number of display contents is consistent with the final number of screens to be presented. The second type of information to be acquired consists of display information. This information comes from the display control processing units and display interfaces at the hardware layer. It is collected by the kernel display driver layer and transmitted through the hardware description layer, covering core parameters, such as the number of display control processing units, the type of display interface (HDMI / DP / RGB / DSI, etc.), the target resolution corresponding to each interface, the display sequence number, and the start and end positions of width and height.

[0068] Regarding step S102 above, the embodiments of this disclosure can establish a connection relationship between the display interface and the display control processing unit, achieve efficient utilization of limited hardware resources through interface merging logic, and establish a driver connection relationship that adapts to multiple display requirements.

[0069] Specifically, in this embodiment, the intelligent system layer issues a merging command, and the kernel display driver layer executes the merging operation. Based on the acquired display information, the kernel display driver layer first identifies each display interface, selects at least two display interfaces, and merges them into the same display control processing unit for unified driving. This ultimately establishes a one-to-many driving relationship between a single display control processing unit and multiple similar display interfaces. For example, in an electronic card table scenario, if the display information shows two similar interfaces, DSI1 and DSI2, the kernel display driver layer merges them into the same display control processing unit. This allows four display control units to successfully adapt to five display interfaces (HDMI, DP, RGB, and the merged DSI interface), solving the problem of some interfaces being undriveable due to a smaller number of control units than interfaces. Without increasing the hardware cost of the display control processing unit, limited hardware resources can be adapted to more display interfaces simply through software-level merging and scheduling of similar interfaces, providing a driving foundation for multi-screen displays.

[0070] Regarding step S103 above, this embodiment of the disclosure can process the display content and drive the display, perform adaptation processing through the display content, and drive the hardware to complete the visualization presentation.

[0071] Specifically, in this embodiment of the disclosure, the hardware description layer can, based on the acquired display information, process the display content to adapt to the target display content that matches the hardware parameters if the initial resolution of a single display content does not match the target resolution of the corresponding display interface, through software cutting or resolution filling technology; for the merged display interface, the corresponding two display contents are first merged in the width / height direction, and then filled to the target resolution to ensure that they are adapted to the driving requirements of the merged display control processing unit.

[0072] Subsequently, the hardware description layer sends the processed target display content to the kernel display driver layer. The kernel display driver layer drives the corresponding display control processing unit, which transmits the target display content to the corresponding monitor through the display interface and display conversion chip (such as DSI to LVDS, HDMI to GVI chip). This ultimately achieves independent and accurate presentation of each display content, ensuring the synchronization and stability of multi-screen displays, and ultimately enabling multiple applications to control the independent monitors separately.

[0073] In summary, the display switching control method in steps S101 to S103 of this disclosure can be applied to the display switching control device in the above embodiments. By setting a hierarchical architecture of intelligent system layer, hardware description layer, kernel display driver layer and hardware layer, the kernel display driver layer can merge at least two display interfaces into the same display control processing unit based on display information. This allows a limited number of display control processing units to adapt to a larger number of display interfaces corresponding to the number of display contents. The transmission requirements of multiple display contents can be met without increasing the number of display control processing units. The intelligent system layer instructs the hardware description layer to process the display content into target display content adapted to the corresponding display information, ensuring that the merged display interface can accurately present the corresponding content. This hierarchical collaborative design realizes flexible adaptation between display control processing units and display interfaces, ensuring the stability and accuracy of content display in multiple display scenarios, thereby improving the adaptability and flexibility of use in multiple display scenarios.

[0074] This disclosure also provides a display device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the above-described display switching control method. This display device can be any smart terminal, including tablet computers, in-vehicle computers, etc.

[0075] Please see Figure 5 , Figure 5 The hardware structure of a display device according to another embodiment is illustrated. The display device includes: The processor 501 can be implemented using a general-purpose CPU (Central Processing Unit), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this disclosure. The memory 502 can be implemented as a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 502 can store operating devices and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 502 and is called and executed by the processor 501 to execute the display switching control method of the embodiments of this disclosure. The input / output interface 503 is used to implement information input and output; The communication interface 504 is used to enable communication and interaction between this device and other devices. Communication can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.). Bus 505 transmits information between various components of the device (e.g., processor 501, memory 502, input / output interface 503, and communication interface 504); The processor 501, memory 502, input / output interface 503, and communication interface 504 are connected to each other within the device via bus 505.

[0076] This disclosure also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described display switching control method.

[0077] Memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs. Furthermore, memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory may optionally include memory remotely located relative to the processor, and these remote memories can be connected to the processor via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0078] The embodiments described in this disclosure are for the purpose of more clearly illustrating the technical solutions of this disclosure and do not constitute a limitation on the technical solutions provided by this disclosure. As those skilled in the art will know, with the evolution of technology and the emergence of new application scenarios, the technical solutions provided by this disclosure are also applicable to similar technical problems.

[0079] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of this disclosure, and may include more or fewer steps than shown, or combine certain steps, or different steps.

[0080] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0081] Those skilled in the art will understand that all or some of the steps, apparatuses, or functional modules / units in the methods disclosed above can be implemented as software, firmware, hardware, or suitable combinations thereof.

[0082] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in this disclosure and the foregoing drawings are used to distinguish similar objects and are not necessarily used to describe a particular order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, apparatus, product, or device that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.

[0083] It should be understood that in this disclosure, "at least one item" means one or more, and "more than one" means two or more. "And / or" is used to describe the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: only A exists, only B exists, and both A and B exist simultaneously, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, and c can be single or multiple.

[0084] In the several embodiments provided in this disclosure, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0085] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0086] Furthermore, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0087] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes multiple instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing programs, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0088] The preferred embodiments of the present disclosure have been described above with reference to the accompanying drawings, but this does not limit the scope of the claims of the present disclosure. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and spirit of the present disclosure shall be within the scope of the claims of the present disclosure.

Claims

1. A display switching control device, characterized in that, include: The system consists of an intelligent system layer, a hardware description layer, a kernel display driver layer, and a hardware layer. The intelligent system layer is used to receive multiple display contents; the hardware description layer is connected to the intelligent system layer; the kernel display driver layer is connected to the hardware description layer; the hardware layer includes multiple display control processing units and multiple display interfaces, the number of display control processing units is less than the number of display interfaces, the number of display interfaces corresponds to the number of display contents, and the hardware layer is connected to the kernel display driver layer to drive each of the display control processing units through the kernel display driver layer; The kernel display driver layer is used to send the display information of the display control processing unit and the display interface to the intelligent system layer after passing through the hardware description layer; the intelligent system layer is used to instruct the kernel display driver layer based on the display information to merge at least two of the display interfaces into one of the display control processing units for driving, so as to establish a connection relationship between the multiple display control processing units and the multiple display interfaces; The intelligent system layer is also used to instruct the hardware description layer, based on the display information, to process each display content into the target display content under the corresponding display information and then send it to the content display driver layer to drive the corresponding display control processing unit to perform processing.

2. The display switching control device according to claim 1, characterized in that, The kernel display driver layer is used to obtain the interface type of each display interface based on the display information, and to merge at least two display interfaces with the same interface type into one of the display control processing units for driving.

3. The display switching control device according to claim 2, characterized in that, The kernel display driver layer is also used to obtain an importance score for each display interface based on the display information, and to filter at least two display interfaces of the same interface type according to the ranking of the importance scores from low to high, and merge them into one of the display control processing units for driving.

4. The display switching control device according to claim 2, characterized in that, The kernel display driver layer is also used to determine the main screen interface among the multiple display interfaces based on the display information, and to merge at least two display interfaces of the same interface type into one of the display control processing units for driving among the other display interfaces besides the main screen interface.

5. The display switching control device according to claim 1, characterized in that, At least two display interfaces that are merged into the same display control processing unit are called target merging interfaces. The hardware description layer is used to merge the display content corresponding to the target merging interface based on the display information to obtain the target display content of the corresponding display control processing unit.

6. The display switching control device according to claim 1 or 5, characterized in that, The hardware description layer is also used to determine the target resolution driven by each of the display control processing units based on the display information, and to obtain the initial resolution corresponding to each of the display contents, and to fill each of the display contents from the initial resolution to the target resolution under the corresponding display information to obtain the target display content of each of the display contents under the corresponding display information.

7. The display switching control device according to claim 1, characterized in that, It also includes multiple displays, the number of which is the same as the number of display contents. Each display is connected to a display interface of a corresponding interface type, and each display is used to display the corresponding target display content.

8. A display switching control method, characterized in that, Applied in the display switching control device according to any one of claims 1 to 7, the display switching control method includes: The system acquires multiple display contents, as well as display information from multiple display control processing units and multiple display interfaces, wherein the number of display control processing units is less than the number of display interfaces, and the number of display interfaces corresponds to the number of display contents. Based on the display information, at least two of the display interfaces are merged into one of the display control processing units for driving, so that a connection relationship is established between the multiple display control processing units and the multiple display interfaces; After processing each of the display contents into the target display contents under the corresponding display information based on the display information, the corresponding display control processing unit is driven to process the target display contents.

9. A display device, characterized in that, The display device includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the display switching control method of claim 8.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the display switching control method of claim 8.

Images