Driving system, method, and device for display screen, display system, and vehicle

Abstract

A driving system (20), method, and device for a display screen (10), a display system, and a vehicle. The display screen (10) comprises a plurality of display areas, the driving system (20) comprises a system-on-chip (22) and a logic chip (23), and an operating system (21) runs on the system-on-chip (22). The operating system (21) is configured to: obtain first contents (10a) to be displayed of the plurality of display areas; store said first contents (10a) of the plurality of display areas into a plurality of first frame buffers; and store a second content (22a) to be displayed into a second frame buffer, wherein said second content (22a) comprises said first contents (10a) of the plurality of display areas obtained from the plurality of first frame buffers, the resolution of said first contents (10a) is less than the resolution of said second content (22a), and the resolution of said second content (22a) is different from the resolution of the display screen (10). The system-on-chip (22) is configured to output said second content (22a) obtained from the second frame buffer. The logic chip (23) is configured to output said first contents (10a) of the plurality of display areas in said second content (22a) to the display screen (10) for display.

Description

Display screen driving system, method and device, display system and vehicle Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a driving system, method and device for a display screen, a display system, and a vehicle. Background Art

[0002] In some scenarios, a display screen requires multiple independent display areas for displaying different contents.

[0003] In one method of related art, multiple display areas of a display screen can be driven separately by multiple systems on a chip (SoC).

[0004] Summary of the Invention

[0005] According to a first aspect of an embodiment of the present disclosure, a driving system for a display screen is provided, wherein the display screen has multiple display areas, and the driving system includes a system on chip and a logic chip, wherein the system on chip runs an operating system. The operating system is configured to: obtain first content to be displayed for each of the multiple display areas; store the first content to be displayed for the multiple display areas in multiple first frame buffers; and store second content to be displayed in a second frame buffer, wherein the second content to be displayed includes the first content to be displayed for the multiple display areas obtained from the multiple first frame buffers, the resolution of the first content to be displayed is lower than the resolution of the second content to be displayed, and the resolution of the second content to be displayed is different from the resolution of the display screen. The system on chip is configured to output the second content to be displayed obtained from the second frame buffer. The logic chip is configured to output the first content to be displayed for the multiple display areas in the second content to be displayed to the display screen for display.

[0006] In some embodiments, the operating system is configured to superimpose video content and user interface content of at least one display area to obtain the first content to be displayed in the at least one display area.

[0007] In some embodiments, the at least one display area includes at least two display areas, and the operating system is configured to, for each of the at least two display areas, respectively: store the video content and the user interface content in a cache queue; obtain the video content and the user interface content from the cache queue using a service process; and superimpose the video content and the user interface content obtained from the cache queue to obtain the first content to be displayed; wherein the cache queues of the at least two display areas are different.

[0008] In some embodiments, the service process is a surface manager.

[0009] In some embodiments, the operating system includes: a package management service process, configured to: parse the installation file of a first application specified by the user to be installed in one of the multiple display areas to obtain class information of the first application, the class information of the first application carries the identifier of any one of the display areas, and store the class information of the first application in a storage path corresponding to any one of the display areas, wherein different display areas correspond to different storage paths; and an activation management service process, configured to: obtain the class information of the first application from the package management service process, create a component of the first application according to the class information of the first application and start the component, thereby starting the first application, and determine that the content of the first application needs to be displayed in the one display area according to the identifier of the one display area carried by the class information of the first application.

[0010] In some embodiments, the operating system is further configured to: determine the coordinates corresponding to the touch operation performed on the display screen in the display interface based on a mapping relationship between the coordinates of each display area in the first coordinate system and the coordinates of the display interface corresponding to the second content to be displayed in the second coordinate system; and perform touch control corresponding to the touch operation based on the coordinates corresponding to the touch operation in the display interface.

[0011] In some embodiments, the operating system is configured to establish the mapping relationship as follows: determine one or more areas in the display interface, wherein each area includes at least one mapping area mapped to at least one display area, the size of each area in the first direction is the same as the size of the display interface in the first direction, and the size of each area in the second direction is the maximum size of the at least one mapping area in the second direction, and the second direction is perpendicular to the first direction; and determine the mapping relationship based on the position of the at least one display area in the display screen and the position of the at least one mapping area in the display interface.

[0012] In some embodiments, the at least one area further includes a blank area that is not mapped to the multiple display areas, and the blank area and the at least one mapping area are arranged in the first direction.

[0013] In some embodiments, the operating system is further configured to: in response to detecting a sliding action from one of the two display areas to the other display area, determine whether the two display areas are mapped to different block areas; if the two display areas are mapped to different block areas, map the sliding action into a first sliding action and a second sliding action, wherein the first sliding action is sliding from the mapping area of ​​the one display area to the blank area, and the second sliding action is sliding within the mapping area of ​​the other display area.

[0014] In some embodiments, the blank area includes a first blank area and a second blank area, and the at least one mapping area is located between the first blank area and the second blank area.

[0015] In some embodiments, the second content to be displayed corresponds to a display interface, and the first content to be displayed in the multiple display areas corresponds to multiple virtual display areas in the display interface; the logic chip is configured to obtain the first content to be displayed in the multiple display areas from the multiple virtual display areas according to the pre-stored coordinates of the multiple virtual display areas in the display interface, and output the obtained first content to be displayed in the multiple display areas to the display screen for display.

[0016] In some embodiments, the logic chip includes a field programmable gate array.

[0017] In some embodiments, the system on chip is configured to be connected to the logic chip via a high-definition multimedia interface, and the logic chip is configured to output the second content to be displayed via an embedded display interface.

[0018] In some embodiments, the display screen is a vehicle-mounted display screen.

[0019] According to a second aspect of an embodiment of the present disclosure, a method for driving a display screen is provided, wherein the display screen has multiple display areas, and the driving method includes: obtaining first content to be displayed in each of the multiple display areas; storing the first content to be displayed in the multiple display areas in multiple first frame buffers; and storing second content to be displayed, which includes the first content to be displayed in the multiple display areas obtained from the multiple first frame buffers, in a second frame buffer, so that the first content to be displayed in the multiple display areas is output to the display screen for display, wherein a resolution of the first content to be displayed is smaller than a resolution of the second content to be displayed, and a resolution of the second content to be displayed is different from a resolution of the display screen.

[0020] In some embodiments, obtaining the first content to be displayed in each of the multiple display areas includes: superimposing video content and user interface content of at least one display area to obtain the first content to be displayed in the at least one display area.

[0021] In some embodiments, the at least one display area includes at least two display areas, and superimposing the video content and user interface content of the at least one display area to obtain the first content to be displayed of the at least one display area includes: storing the video content and the user interface content in a cache queue for each of the at least two display areas respectively; obtaining the video content and the user interface content from the cache queue using a service process; and superimposing the video content and the user interface content obtained from the cache queue to obtain the first content to be displayed; wherein the cache queues of the at least two display areas are different.

[0022] In some embodiments, the service process is a surface manager.

[0023] In some embodiments, the driving method also includes: parsing the installation file of the first application specified by the user to be installed in one of the multiple display areas to obtain the class information of the first application, the class information of the first application carries the identifier of any one of the display areas; storing the class information of the first application in the storage path corresponding to the one display area, wherein different display areas correspond to different storage paths; obtaining the class information of the first application from the storage path corresponding to the one display area; creating a component of the first application according to the class information of the first application and starting the component, thereby starting the first application; and determining that the content of the first application needs to be displayed in the one display area according to the identifier of the one display area carried by the class information of the first application.

[0024] In some embodiments, the driving method further includes: determining the coordinates corresponding to the touch operation performed on the display screen in the display interface based on a mapping relationship between the coordinates of each display area in the first coordinate system and the coordinates of the display interface corresponding to the second content to be displayed in the second coordinate system; and performing touch control corresponding to the touch operation based on the coordinates corresponding to the touch operation in the display interface.

[0025] In some embodiments, the mapping relationship is established as follows: one or more areas are determined in the display interface, wherein each area includes at least one mapping area mapped to at least one display area, the size of each area in the first direction is the same as the size of the display interface in the first direction, and the size of each area in the second direction is the maximum size of the at least one mapping area in the second direction, and the second direction is perpendicular to the first direction; and the mapping relationship is determined based on the position of the at least one display area in the display screen and the position of the at least one mapping area in the display interface.

[0026] In some embodiments, the at least one area further includes a blank area that is not mapped to the multiple display areas, and the blank area and the at least one mapping area are arranged in the first direction.

[0027] In some embodiments, the driving method further includes: in response to detecting a sliding action from one display area to the other display area of ​​the two display areas, determining whether the two display areas are mapped to different block areas; if the two display areas are mapped to different block areas, mapping the sliding action into a first sliding action and a second sliding action, wherein the first sliding action is sliding from the mapping area of ​​the one display area to the blank area, and the second sliding action is sliding within the mapping area of ​​the other display area.

[0028] In some embodiments, the blank area includes a first blank area and a second blank area, and the at least one mapping area is located between the first blank area and the second blank area.

[0029] In some embodiments, the second content to be displayed corresponds to a display interface, and the first content to be displayed in the multiple display areas corresponds to multiple virtual display areas in the display interface; the method also includes: obtaining the first content to be displayed in the multiple display areas from the multiple virtual display areas according to the pre-stored coordinates of the multiple virtual display areas in the display interface, and outputting the obtained first content to be displayed in the multiple display areas to the display screen for display.

[0030] In some embodiments, the display screen is a vehicle-mounted display screen.

[0031] According to a third aspect of an embodiment of the present disclosure, a driving device for a display screen is provided, wherein the display screen has multiple display areas, and the driving device includes: an acquisition module configured to acquire first content to be displayed in each of the multiple display areas; a first storage module configured to store the first content to be displayed in the multiple display areas in multiple first frame buffers; and a second storage module configured to store second content to be displayed, which includes the first content to be displayed in the multiple display areas acquired from the multiple first frame buffers, in a second frame buffer, so that the first content to be displayed in the multiple display areas is output to the display screen for display, wherein a resolution of the first content to be displayed is smaller than a resolution of the second content to be displayed, and a resolution of the second content to be displayed is different from a resolution of the display screen.

[0032] According to a fourth aspect of an embodiment of the present disclosure, a driving device for a display screen is provided, wherein the display screen has multiple display areas, and the driving device includes: a memory; and a processor coupled to the memory, configured to execute the driving method described in any one of the above embodiments based on instructions stored in the memory.

[0033] According to a fifth aspect of the embodiments of the present disclosure, a display system is provided, comprising: a driving system for the display screen described in any one of the above embodiments, or a driving device for the display screen described in any one of the above embodiments; and the display screen.

[0034] According to a sixth aspect of an embodiment of the present disclosure, a vehicle is provided, comprising the display system described in any one of the above embodiments.

[0035] According to a seventh aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, comprising computer program instructions, wherein the computer program instructions, when executed by a processor, implement the driving method described in any one of the above embodiments.

[0036] According to an eighth aspect of an embodiment of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the driving method described in any one of the above embodiments is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0038] The present disclosure can be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0039] FIG1 is a schematic structural diagram of a driving system for a display screen according to some embodiments of the present disclosure;

[0040] FIG2 is a schematic diagram of a process of obtaining first content to be displayed according to some embodiments of the present disclosure;

[0041] FIG3 is a schematic diagram of a process of installing and starting an application according to some embodiments of the present disclosure;

[0042] FIG4 is a schematic diagram of a mapping relationship between a display screen and a display interface according to some embodiments of the present disclosure;

[0043] FIG5 is a schematic diagram of a process of mapping a display screen to a display interface according to some embodiments of the present disclosure;

[0044] FIG6A is a schematic diagram illustrating mapping of a sliding action across a display area in a display interface according to some embodiments of the present disclosure;

[0045] FIG6B is a schematic diagram illustrating mapping of a sliding action across a display area in a display interface according to other embodiments of the present disclosure;

[0046] FIG7 is a schematic diagram of the architecture of a display system according to some embodiments of the present disclosure;

[0047] FIG8A is a schematic flow chart of a method for driving a display screen according to some embodiments of the present disclosure;

[0048] FIG8B is a schematic diagram of a process of obtaining first content to be displayed according to some embodiments of the present disclosure;

[0049] FIG9 is a schematic diagram of a process of starting an application according to some disclosed embodiments;

[0050] FIG10 is a schematic structural diagram of a driving device for a display screen according to some embodiments of the present disclosure;

[0051] FIG11 is a schematic structural diagram of a driving device for a display screen according to other embodiments of the present disclosure.

[0052] It should be understood that the same or similar reference numerals denote the same or similar components. DETAILED DESCRIPTION

[0053] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. The description of the exemplary embodiments is merely illustrative and is in no way intended to limit the present disclosure, its application, or use. The present disclosure can be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are provided to make the present disclosure thorough and complete and to fully convey the scope of the present disclosure to those skilled in the art. It should be noted that unless otherwise specifically stated, the relative arrangement of parts and steps, the composition of materials, numerical expressions, and numerical values ​​set forth in these embodiments should be interpreted as being merely exemplary and not as limiting.

[0054] The terms "first," "second," and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish between different parts. Terms such as "include" or "comprises" mean that the elements preceding the term encompass the elements listed after the term, and do not exclude the possibility of also encompassing other elements. Terms such as "upper," "lower," and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0055] In the present disclosure, when a specific component is described as being located between a first component and a second component, there may or may not be an intervening component between the specific component and the first component or the second component. When a specific component is described as being connected to another component, the specific component may be directly connected to the other component without an intervening component, or may not be directly connected to the other component but have an intervening component.

[0056] All terms (including technical or scientific terms) used in this disclosure have the same meaning as those understood by one of ordinary skill in the art to which this disclosure belongs, unless otherwise specifically defined. It should also be understood that terms defined in, for example, general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or highly formal sense, unless explicitly defined herein.

[0057] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0058] When multiple SoCs are used to drive multiple display areas of a display screen, the cost of the chip will be very high.

[0059] In order to reduce costs, in another related technical approach, a system on a chip can be used to virtualize multiple operating systems through virtualization technology, and each operating system is used to drive a display area of ​​the display screen.

[0060] Virtualization technology uses virtual machines to simulate multiple independent virtual execution environments on the physical machine's hardware platform, each identical to the underlying hardware. Each virtual execution environment can run an operating system, known as a guest operating system (OS). The guest OS accesses and operates physical resources through the abstraction layer provided by the virtual machine monitor (HVM).

[0061] A virtual machine monitor (HVM) is an abstraction layer between computer hardware and client operating systems. It abstracts underlying hardware resources and makes them available to multiple virtual machines running on top. It also provides these virtual machines with multiple, isolated virtual execution environments. A HVM can consolidate operating systems and applications running on different virtual machines onto the same physical machine.

[0062] The inventors noticed that when using virtualization technology to drive multiple display areas of a display screen, on the one hand, a virtual machine and a virtual machine monitor are required, and the display screen driving system is complex and costly; on the other hand, the display effect of driving the display screen through a virtualized operating system is poor.

[0063] In view of this, the embodiments of the present disclosure propose the following technical solutions.

[0064] Fig. 1 is a schematic diagram of a structure of a driving system of a display screen according to some embodiments of the present disclosure. It should be noted that, for greater clarity, Fig. 1 also shows a display screen 10.

[0065] As shown in FIG. 1 , a display screen 10 has multiple display areas, for example, a first display area 11 , a second display area 12 , and a third display area 13 .

[0066] In some embodiments, the display screen 10 is an in-vehicle display screen. In some implementations, the display screen 10 is a long strip screen, i.e., a rectangular display screen. The shapes of the multiple display areas are, for example, rectangular. For example, the multiple display areas respectively display the content of different applications. In some implementations, the first display area 11 is used to display the content of the dashboard application, the second display area 12 is used to display the content of the desktop launcher application (e.g., the Launcher for installing the operating system), and the third display area 13 is used to display the content of the entertainment application.

[0067] The driver system 20 includes a system on chip 22 and a logic chip 23. An operating system 21 runs on the system on chip 22. In some implementations, the operating system 21 is an Android operating system. In some embodiments, the system on chip 22 and the logic chip 23 can be connected via a High Definition Multimedia Interface (HDMI).

[0068] The operating system 21 is configured to obtain first content 10a to be displayed for each of the multiple display areas. In some embodiments, the operating system 21 is configured to determine the first content 10a to be displayed based on the user interface (UI) content of the display area. In other embodiments, the operating system 21 is configured to determine the first content 10a to be displayed based on the video content and UI content of the display area. In some implementations, the operating system 21 is configured to superimpose the video content and UI content of at least one display area to obtain the first content 10a to be displayed.

[0069] It should be understood that for each display area, the operating system 21 is configured to obtain the corresponding first content to be displayed 10a. In some implementations, the first content to be displayed 10a in different display areas corresponds to the first content to be displayed 10a of different applications. For example, the first content to be displayed 10a in the first display area 11 is the content to be displayed by application 1, the first content to be displayed 10a in the second display area 12 is the content to be displayed by application 2, and the first content to be displayed 10a in the third display area 13 is the content to be displayed by application 3.

[0070] The operating system 21 is further configured to, after obtaining the first content to be displayed 10a for the multiple display areas, store the first content to be displayed 10a for the multiple display areas in multiple first frame buffers. In some embodiments, the first content to be displayed 10a for the multiple display areas is stored in the multiple first frame buffers in a one-to-one correspondence. In other words, the first content to be displayed 10a for different display areas is stored in different first frame buffers. It will be understood that the frame buffer is a memory area of ​​the memory of the system on chip 22, which can also be called video memory. The multiple first frame buffers correspond to multiple memory areas of the memory of the system on chip 22.

[0071] The operating system 21 is further configured to obtain the first to-be-displayed content 10a of the plurality of display areas from the plurality of first frame buffers and store the second to-be-displayed content 22a in the second frame buffer. Here, the second frame buffer is another frame buffer different from the plurality of first frame buffers.

[0072] The second content to be displayed 22a includes the first content to be displayed 10a in multiple display areas obtained from multiple first frame buffers. The resolution of the first content to be displayed 10a is lower than the resolution of the second content to be displayed 22a, and the resolution of the second content to be displayed 22a is different from the resolution of the display screen 10. In other words, the width of the resolution of the first content to be displayed 10a is smaller than the width of the resolution of the second content to be displayed 22a, and the height of the resolution of the first content to be displayed 10a is smaller than the height of the resolution of the second content to be displayed 22a; at least one of the width and height of the resolution of the second content to be displayed 22a is different from that of the display screen 10.

[0073] The system on chip 22 is configured to output the second to-be-displayed content 22 a obtained from the second frame buffer to the logic chip 23 .

[0074] The resolution of the second to-be-displayed content 22a output by the system-on-chip 22 depends on the resolution supported by the system-on-chip 22. Typically, the resolution supported by the system-on-chip 22 is a standard resolution.

[0075] In some embodiments, the resolution of the display screen 10 is 10496 pixels × 1040 pixels, and the resolution of the second content to be displayed 22a output by the on-chip system 22 is 2560 pixels × 1440 pixels (i.e., 2k resolution), 3840 pixels × 2160 pixels (i.e., 4k resolution), 7680 pixels × 4320 pixels (i.e., 8k resolution) or 7680 pixels × 3840 pixels.

[0076] If the second content to be displayed 22a output by the system on chip 22 corresponds to a display interface DE, the display interface DE can be considered to include multiple independent virtual display areas corresponding to the first content to be displayed 10a in multiple display areas, and the multiple virtual display areas correspond one-to-one to the multiple display areas.

[0077] The logic chip 23 is configured to output the first content to be displayed 10a in the plurality of display areas of the second content to be displayed 22a to the display screen 10 for display. In some embodiments, the logic chip 23 is a field programmable gate array (FPGA). For example, the logic chip 23 is configured to output the second content to be displayed via an embedded display port (eDP).

[0078] In some embodiments, the coordinates of the multiple virtual display areas in the display interface DE may be pre-stored in the logic chip 23. The logic chip 23 may know in advance which area or areas of the display interface DE to obtain the first content 10a to be displayed. In some implementations, the logic chip 23 is configured to obtain the first content 10a to be displayed for the multiple display areas from the multiple virtual display areas based on the pre-stored coordinates of the multiple virtual display areas in the display interface DE, and output the obtained first content 10a to be displayed for the multiple display areas to the display screen for display.

[0079] It should be understood that the logic chip 23 maps the first content to be displayed 10a to the corresponding display area for display. For example, different display areas have different identifiers. Based on the identifier of the display area carried by the first content to be displayed 10a, the first content to be displayed 10a in different display areas can be distinguished, so that the first content to be displayed 10a can be mapped to the corresponding display area for display.

[0080] In some embodiments, the second content to be displayed 22a also includes other content in addition to the first content to be displayed 10a. In this case, the logic chip 23 only outputs the first content to be displayed 10a of the multiple display areas to the display screen for display, and does not output other content to the display screen for display.

[0081] In some implementations, the logic chip 23 may stitch the first to-be-displayed contents 10a of the multiple display areas into an image of the same size as the display screen 10, and evenly divide the stitched image into multiple images and output them through multiple interfaces, such as embedded display interfaces.

[0082] In the above embodiment, the operating system stores the first content to be displayed 10a of the multiple display areas into the multiple first frame buffers, and then forms the second content to be displayed 22a to be output by the subsequent on-chip system 22 based on the first content to be displayed 10a obtained from the multiple first frame buffers. Then, the logic chip 23 selects the first content to be displayed 10a of the multiple display areas from the second content to be displayed 22a and outputs it to the display screen 10 for display.

[0083] In this manner, by changing the method for obtaining the content to be displayed, a single system-on-chip (SoC) 22 and an operating system 21 can be used to drive the multiple display areas of the display screen 10 for display. Compared to virtualization technology, this approach eliminates the need for a virtual machine and virtual machine monitor, reducing the complexity and cost of the driver system. Furthermore, the multiple display areas of the display screen 10 are driven by the operating system 21 running on the SoC 22, rather than a virtualized operating system, improving the display quality of the display screen 10.

[0084] Next, the process of the operating system 21 obtaining the first content to be displayed 10a will be described with reference to FIG. 2 .

[0085] FIG2 is a schematic diagram of a process of obtaining first content to be displayed according to some embodiments of the present disclosure.

[0086] The operating system 21 is configured to perform the following first to third operations for each of at least two display areas (for example, the first display area 11, the second display area 12 and the third display area 13) among the multiple display areas of the display screen 10, thereby obtaining the first content 10a to be displayed in each display area.

[0087] First, the first operation is introduced.

[0088] In the first operation, the video content is stored in a buffer queue (Buffer Queue), and the UI content is stored in the buffer queue. Here, the video content corresponds to the video layer, and the UI content corresponds to the UI layer.

[0089] The video content and UI content of the same display area can be stored in the same cache queue or in different cache queues.

[0090] Different display areas correspond to different cache queues. For example, the first display area 11 corresponds to the first cache queue, the second display area 12 corresponds to the second cache queue, and the third display area 12 corresponds to the third cache queue.

[0091] For example, a buffer (i.e., a graphics buffer) is dequeued from the buffer queue, and the video content obtained after being decoded by the decoder is stored in the dequeued buffer. The buffer containing the video content is then requeued to the buffer queue, and a service process is notified to consume it. For example, the service process is the surface manager (SurfaceFlinger).

[0092] Similarly, a block of cache is dequeued from the cache queue, the drawn UI content is stored in the dequeued block of cache, and then the block of cache storing the UI content is re-queued into the cache queue, and the service process is notified to consume.

[0093] For example, a buffer is dequeued by calling the dequeue function, and a buffer is enqueued by calling the queue function.

[0094] In some embodiments, when the UI content involves multiple UI layers, the multiple UI contents can be drawn separately and consumed by the service process. Afterwards, the service process stores the multiple UI contents in a cache dequeued from the cache queue.

[0095] Next, the second operation is introduced.

[0096] In the second operation, the service process is used to obtain the video content and the UI content from the cache queue.

[0097] After a service process acquires video content from a cache block in the cache queue, it can release that cache block. Similarly, after a service process acquires UI content from a cache block in the cache queue, it can release that cache block. For example, you can use the acquire function to acquire video content or UI content and call the release function to release the cache.

[0098] In the third operation, the video content and UI content obtained from the cache queue are superimposed to obtain the first content to be displayed 10a. Here, superposition can also be understood as a synthesis process.

[0099] For example, both the video content and the UI content carry an identifier of the display area. The video content and the UI content with the same identifier correspond to the same cache queue, and the video content and the UI content with different identifiers correspond to different cache queues.

[0100] In the above embodiment, by modifying the display framework in the operating system, different cache queues are used to process the video content and UI content respectively in different display areas in the first to third operations. In this way, the first to-be-displayed content 10a of multiple display areas can be obtained in parallel.

[0101] In order to display the display content of different applications in different display areas, the embodiment of the present disclosure proposes the following technical solution.

[0102] FIG3 is a schematic diagram of a process of installing and launching an application according to some embodiments of the present disclosure.

[0103] In some embodiments, the operating system 21 includes a package manager service (PackageManagerService, PMS) process and an activation manager service (ActivityManagerService, AMS) process.

[0104] The PMS process is configured to parse the installation file of an application (referred to as a first application) specified by the user to be installed in one of the multiple display areas to obtain class information of the first application, where the class information carries an identifier of the arbitrary display area.

[0105] The PMS process is further configured to store the class information of the first application in a storage path corresponding to the one display area, where different display areas correspond to different storage paths. For example, the first display area 11 corresponds to storage path 1, the second display area 12 corresponds to storage path 2, and the third display area 13 corresponds to storage path 3.

[0106] For example, each application corresponds to a package, and different class information can be stored in different sets of the package.

[0107] When a user wants to install a first application in a certain display area, the installation file of the first application will be loaded into the corresponding installation path. Different display areas can correspond to different installation paths. For example, different hardware interfaces correspond to different display areas, and the user selects the display area in which to install the application by selecting the hardware interface. For another example, when installing an application, the user is prompted to select the display area in which the application is to be installed. Based on the user's selection, the user can know the display area in which the application is to be installed.

[0108] The PMS process can determine the display area in which the first application is installed based on the installation path of the first application, and further determine the identifier of the display area carried by the parsed class information. The parsed class information includes, for example, activities information, services information, broadcast receivers information, and content providers information.

[0109] The AMS process is configured to obtain class information of the first application from the PMS process; and to create a component of the first application based on the class information of the first application and start the component, thereby starting the first application. For example, in response to the first application being clicked, the AMS process obtains the class information of the first application from the PMS process.

[0110] After the first application is clicked, the AMS process can distinguish which display area the first application corresponds to based on the class information obtained from the PMS process. Accordingly, it can be determined that after the first application is started, the video content and UI content of the first application should carry the identifier of which display area. Therefore, when the user specifies that the first application be installed in any of the display areas, the AMS process determines that the content of the first application needs to be displayed in the display area based on the identifier of a display area carried by the class information of the first application. In other words, the first content to be displayed in the display area includes the content of the first application.

[0111] The components of the first application may include, for example, four major components of the Android system, such as an activity component, a service component, a content receiver component, and a content provider component.

[0112] In some embodiments, the component to be displayed is located according to the class information and intent information of the first application, the component of the first application is created and started, thereby starting the first application.

[0113] In the above embodiment, the PMS process stores the class information of applications in different display regions in separate storage paths. This class information also carries the identifier of the display region where the application is installed. After the AMS process launches an application based on the class information, subsequent display content of the application can carry the identifier of the display region where the application is installed, allowing it to be displayed in the installed display region. This allows the content of different applications to be displayed independently in different display regions.

[0114] In addition, no special processing is required for the application, and conventional applications can be normally installed in multiple display areas of the display screen 10.

[0115] In some embodiments, the operating system 21 is further configured to: determine the coordinates corresponding to a touch operation performed on the display screen 10 in the display interface DE based on a mapping relationship between the coordinates of each display area in the first coordinate system and the coordinates of the display interface DE corresponding to the second to-be-displayed content 22a in the second coordinate system; and perform touch control corresponding to the touch operation based on the coordinates corresponding to the touch operation in the display interface DE. For example, if the touch operation is clicking to play a video, the touch control is used to achieve video playback through control.

[0116] In this way, not only can each display area be independently displayed, but also each display area can be independently touched.

[0117] In some embodiments, if a touch operation is applied to a touch-prohibited display area, the touch operation is ignored. For example, if the display area where the dashboard application is located is touch-prohibited, the driver in the operating system kernel does not report the location corresponding to the touch operation on the display area. In this case, the corresponding coordinate operation in the display interface DE may not be determined, and the touch control corresponding to the touch operation is not subsequently executed.

[0118] In some embodiments, the operating system 21 is configured to establish a mapping relationship as follows.

[0119] First, one or more regions are determined in the display interface DE corresponding to the second content to be displayed 22a, wherein each region includes at least one mapping region mapped to at least one display region.

[0120] FIG4 is a schematic diagram of a mapping relationship between a display screen and a display interface according to some embodiments of the present disclosure.

[0121] As shown in Figure 4, the display interface DE includes three areas, namely the first area BA1, the second area BA2, and the third area BA2. The first area BA1 includes the mapping area BA11 and the mapping area BA11, the second area BA2 includes the mapping area BA21, the mapping area BA22, and the mapping area BA23, and the third area BA3 includes the mapping area BA31.

[0122] The size of each area in the first direction is the same as the size of the display interface DE in the first direction, and the size of each area in the second direction is the maximum size of at least one mapping area in each area in the second direction, and the second direction is perpendicular to the first direction.

[0123] In some embodiments, as shown in FIG4 , within each area, the size of the mapping area in the second direction at different locations is the same fixed size. In this case, the maximum size of the mapping area in the second direction is the fixed size. For example, the sizes of mapping area BA11 and mapping area BA12 in the second direction are the same fixed size, and this fixed size is the same as the size of the first area BA1 in the second direction.

[0124] It should be noted that although each mapping area shown in FIG4 is rectangular, this is not restrictive. In some embodiments, the mapping area can be of any shape. For example, a block area includes multiple mapping areas, some of which can have different shapes, and some of which can have different maximum sizes in the second direction.

[0125] Then, according to the position of at least one display area in the display screen 10 and the position of at least one mapping area in the display interface DE, a mapping relationship between the coordinates of each display area in the first coordinate system and the coordinates of the display interface DE in the second coordinate system is determined.

[0126] According to the position of each display area in the display screen 10, the coordinates of the display area in the first coordinate system can be determined; according to the position of each mapping area in the display interface DE, the coordinates of each mapping area in the second coordinate system can be determined; and further, the mapping relationship between the coordinates of each display area in the first coordinate system and the display interface DE in the second coordinate system can be determined.

[0127] In the above embodiment, a mapping area mapped to the display area is determined in the display interface DE corresponding to the second content to be displayed 22a output by the on-chip system 22, and a mapping relationship between the coordinates of the display area in the first coordinate system and the display interface DE in the second coordinate system can be determined according to the position of the display area in the display screen 10 and the position of the mapping area in the display interface DE.

[0128] Next, an example is used to illustrate the process of determining the mapping relationship.

[0129] In this example, the display screen 10 is assumed to be a long strip screen and includes n display areas.

[0130] The width and height of the n display areas are {(W1, H1), (W2, H2)…(Wn, Hn)}, respectively. The total width and height of the n display areas are represented by (Wt, Ht). The coordinates of the upper left corner of the display screen are the origin (0, 0) of the first coordinate system. The coordinates of a point in the first coordinate system are represented by (x, y).

[0131] The width and height of the display interface DE supported by the system on chip 22 are represented by (Wi, Hi), the coordinates of the upper left corner of the display interface DE are the origin (0, 0) of the second coordinate system, and the coordinate points in the second coordinate system are represented by (X, Y).

[0132] The following description will be made taking n=6 as an example.

[0133] FIG5 is a schematic diagram of a process of mapping a display screen to a display interface according to some embodiments of the present disclosure.

[0134] First, as shown in (1) in FIG. 5 , the first row area, ie, the first block area BA1 is mapped.

[0135] Determine whether the height H1 of the first display area 11 is less than the height Hi of the display interface DE; if the judgment result is yes, continue to determine whether the width W1 of the first display area 11 is less than the width Wi of the display interface DE; if the judgment result is still yes, continue to determine whether the sum W1+W2 of the width of the first display area 11 and the width of the second display area 12 is less than the width Wi of the display interface DE; if the judgment result is still yes, continue to determine whether the sum W1+W2+W3 of the width of the first display area 11, the width of the second display area 12, and the width of the third display area 13 is less than the width Wi of the display interface DE; if the judgment result is no, therefore, the first row area of ​​the display interface DE can only map two display areas, namely, the first display area 11 and the second display area 12.

[0136] After mapping, the mapping relationship between the coordinates (x, y) of the first display area 11 and the second display area 12 in the display screen 10 and the coordinates (X, Y) of the display interface DE is (x, y) = (X, Y). The first block area BA1 includes the mapping area BA11 of the first display area 11 and the mapping area BA12 of the second display area 12. The remaining area of ​​the first block area BA1 has a size of (Wi - W1 - W2, H1).

[0137] Next, as shown in (2) in FIG. 5 , the second row area, ie, the second block area BA2 is mapped.

[0138] Determine whether the sum H1+H3 of the height of the first display area 11 and the height of the third display area 13 is less than the width Hi of the display interface DE; if the judgment result is yes, continue to determine whether the width of the third display area 13 is less than the width Wi of the display interface DE; if the judgment result is still yes, continue to determine whether the sum W3+W4 of the width of the third display area 13 and the width of the fourth display area 14 is less than the width Wi of the display interface DE; if the judgment result is still yes, continue to determine whether the sum W3+W4+W5 of the width of the third display area 13, the width of the fourth display area 14, and the width of the fifth display area 15 is less than the width Wi of the display interface DE; if the judgment result is no, therefore, the second row area of ​​the display interface DE can also only map two display areas, namely, the third display area 13 and the fourth display area 14.

[0139] After mapping, the mapping relationship between the coordinates (x, y) of the third display area 13 and the fourth display area 14 in the display screen 10 and the coordinates (X, Y) of the display interface DE is (x-W1-W2, y+H1)=(X, Y). The second area BA2 includes the mapping area BA21 of the third display area 13 and the mapping area BA22 of the fourth display area 14. The remaining area of ​​the second area BA2 has a size of (Wi-W3-W4, H1).

[0140] Next, as shown in (3) in FIG. 5 , the third row area, ie, the third block area BA3 is mapped.

[0141] Determine whether the sum H1+H3+H5 of the height of the first display area 11, the height of the third display area 13, and the height of the fifth display area 15 is less than the width Hi of the display interface DE; if the judgment result is yes, continue to determine whether the width of the fifth display area 15 is less than the width Wi of the display interface DE; if the judgment result is still yes, continue to determine whether the sum W5+W6 of the width of the fifth display area 15 and the width of the sixth display area 16 is less than the width Wi of the display interface DE; if the judgment result is no, therefore, the third row area of ​​the display interface DE can only map one display area, namely, the fifth display area 15.

[0142] After mapping, the mapping relationship between the coordinates (x, y) of the fifth display area 15 in the display screen 10 and the coordinates (X, Y) of the display interface DE is (x - W1 - W2 - W3 - W4, y + H1 + H2) = (X, Y). The third block area BA3 includes the mapped area BA31 of the fifth display area 15. The remaining area of ​​the third block area BA3 has a size of (Wi - W5, H1).

[0143] Finally, as shown in (4) of FIG5 , for the sixth display area 16, for example, the area with the largest width among the remaining areas in the display interface DE is preferentially found, namely, the remaining area (Wi-W3-W4, H1) in the second block area BA2. A determination is made as to whether Wi-W3-W4 is greater than or equal to W6; if the determination is yes, the sixth display area 16 is mapped to the second block area BA2. Therefore, the final second block area BA2 includes the mapping area BA21 of the third display area 13, the mapping area BA22 of the fourth display area 14, and the mapping area BA23 of the sixth display area 16.

[0144] After mapping, the mapping relationship between the coordinates (x, y) of the sixth display area 16 in the display screen 10 and the coordinates (X, Y) of the display interface DE is (x-W1-W2-W5, y+H1)=(X, Y).

[0145] In some embodiments, the sixth display area 16 may also be mapped to the remaining area of ​​other block areas, as long as the width of the remaining area is greater than or equal to W6. In this way, the space of the display interface DE can be effectively utilized.

[0146] In addition, the above process of determining the mapping relationship is described using a one-to-one correspondence between points and pixels on the touch screen as an example. If the correspondence is not one-to-one, a coefficient can be multiplied according to the ratio during mapping. For example, if the display interface DE is not large enough to map a certain display area or areas, the coordinates (x, y) of the display area can be multiplied by a coefficient less than 1 before mapping.

[0147] Taking the sixth display area 16 in the display screen as an example, assuming that the sizes of the remaining areas are not sufficient to map the sixth display area 16, the mapping relationship between the coordinates (x, y) of the sixth display area 16 and the coordinates (X, Y) of the display interface DE can be adjusted to m(x-W1-W2-W5, y+H1)=(X, Y), where m is a coefficient less than 1.

[0148] In some embodiments, referring to (4) in FIG. 4 and FIG. 5 , at least one area in the display interface DE further includes a blank area that is not mapped to the multiple display areas, and the blank area and the at least one mapped area are arranged in the first direction. Here, the blank area is an area in the display interface DE that is not mapped to any display area in the display screen 10. The provision of the blank area facilitates the normal implementation of the sliding action in certain scenarios.

[0149] In some embodiments, the blank area includes a first blank area and a second blank area, and the at least one mapping area is located between the first blank area and the second blank area. For example, in a first direction, the first blank area, the at least one mapping area, and the second blank area are arranged in sequence.

[0150] As some implementations, each area in the display interface DE includes a blank area that is not mapped to the multiple display areas.

[0151] For example, the first block area BA1 includes a blank area BA13, which is arranged in the first direction with the mapping areas BA11 and BA12 in the first block area BA1. In some embodiments, another blank area may be located to the left of the mapping area BA11.

[0152] For another example, the second block area BA2 includes a blank area BA24, which is arranged in the first direction with the mapping areas BA21, BA22, and BA23 in the second block area BA2. In some embodiments, another blank area may be located to the left of the mapping area BA21.

[0153] For another example, the third block area BA3 includes a blank area BA32, which is arranged in the first direction with the mapping area BA31 in the third block area BA3. In some embodiments, another blank area may be located to the left of the mapping area BA31.

[0154] The inventors have noticed that in some scenarios, the user may slide across the display area. This will be explained below with reference to FIG6A .

[0155] FIG6A is a schematic diagram illustrating mapping of a sliding action across a display area in a display interface according to some embodiments of the present disclosure.

[0156] As shown in Figure 6A, a user swipes from point A in one display area (e.g., the second display area 12) to point B in another display area (e.g., the third display area 13). According to the mapping relationship described above, when the starting point A and the end point B of the swipe action are mapped to the display interface DE, the swipe needs to be made from the first area BA1 in one row to the second area BA2 in another row.

[0157] As shown by the arrow in FIG6A , when the operating system calculates the sliding trajectory based on all the touch points of the sliding action, it will interpret the sliding action as first sliding to the right, then sliding to the left, and then sliding to the right again. If control is executed according to this sliding trajectory, the display screen 10 will not be able to slide from point A to point B according to the expected sliding trajectory.

[0158] In view of this, the embodiment of the present disclosure proposes the following solution, which will be described below with reference to FIG6B .

[0159] FIG6B is a schematic diagram illustrating mapping of a sliding action across a display area in a display interface according to some other embodiments of the present disclosure.

[0160] In some embodiments, the operating system 21 is further configured to determine whether the two display areas are mapped to different block areas in response to detecting a sliding action from one of the two display areas to the other display area.

[0161] As shown in FIG6B , when two display areas are mapped to different block areas, the operating system 21 maps the sliding action into a first sliding action and a second sliding action. Here, the first sliding action is sliding from the mapped area of ​​the display area where the sliding action starts (i.e., one display area) to the blank area, and the second sliding action is sliding within the mapped area of ​​the display area where the sliding action ends (i.e., the other display area).

[0162] For example, the display area where the sliding action starts is the second display area 12, and the display area where the sliding action ends is the third display area 13. The second display area 12 is mapped to the mapping area BA12 in the first block area BA1, and the third display area 13 is mapped to the mapping area BA21 in the second block area BA2. The operating system 21 maps the sliding action into a first sliding action from the mapping area BA12 of the second display area 12 to the blank area BA13, and a second sliding action within the mapping area BA21 of the third display area 13. It should be understood that the second sliding action slides from the boundary of the mapping area BA21 to the inside of the mapping area BA21.

[0163] For example, the first sliding action will be reported to the application corresponding to the second display area 12, and the second sliding action will be reported to the application corresponding to the third display area 13. The application corresponding to the second display area 12 will believe that the user has only slid from the mapping area BA12 to the blank area BA13, with only one sliding action to the right. The application corresponding to the third display area 13 will believe that the user has only slid within the mapping area BA21, with only one sliding action to the right. Therefore, the display screen 10 shows the content corresponding to the sliding trajectory from point A to point B. For example, the playback frame of a video slides from point A to point B.

[0164] In the above embodiment, for sliding across the display area, the unmapped blank area is utilized to decompose the sliding action into two sliding actions. This can reduce the possibility of the operating system making mistakes when calculating the sliding trajectory, so that when sliding in a certain direction on the display screen 10, the expected sliding trajectory can be displayed normally.

[0165] It is understood that when the blank area includes the first blank area and the second blank area, whether swiping to the left or swiping to the right, the sliding action can be decomposed into two sliding actions. This can further reduce the possibility of the operating system miscalculating the sliding trajectory, so that when swiping in opposite directions on the display screen, the expected sliding trajectory can be displayed normally.

[0166] In some embodiments, the mapping of touch operations can be implemented by a driver of the touch screen. For example, the driver is located in the kernel of the operating system (such as the Linux kernel).

[0167] FIG. 7 is a schematic diagram of the architecture of a display system according to some embodiments of the present disclosure.

[0168] In FIG7 , the tactile actuator is connected to the system on chip 22 via a USB interface, the touch chip is connected to the system on chip 22 via an I2C interface, and the system on chip 22 and the logic chip 23 are connected via an HDMI interface (e.g., an HDMI 1.0 interface).

[0169] In some embodiments, the vehicle display system may further include other display screens, such as a rearview mirror display screen. The logic chip 23 may output the content to be displayed to the other display screens via a low voltage differential signaling (LVDS) interface.

[0170] In some embodiments, the refresh rate of the display screen 10 is 60 Hz. In this case, the system on chip 22 transmits the second content to be displayed to the logic chip 23 at the 60 Hz refresh rate, and the logic chip 23 transmits the first content to be displayed in multiple display areas to the display screen 10 at the 60 Hz refresh rate.

[0171] Next, the processing flow of the touch operation is described with reference to FIG. 7 .

[0172] The kernel driver enters interrupt wait mode, awaiting an interrupt. If a touch operation occurs, the touch chip reports the touch information to the kernel via the interrupt pin (INT). The kernel's interrupt handler determines whether it is a press or lift operation based on the interrupt type. If it is a press operation, the touch point coordinates (x, y) on the display screen 10 are calculated through digital-to-analog conversion. Coordinate mapping is performed based on the touch point coordinates (x, y) and the mapping algorithm described above, resulting in the coordinates (X, Y) on the display interface DE. When determining whether a press operation is a press operation, filtering can be used to eliminate interfering operations.

[0173] Each embodiment in this specification is described in a progressive manner. Each embodiment focuses on the differences from other embodiments. For the same or similar parts between the various embodiments, reference can be made to each other. For the method embodiments, since they basically correspond to the system embodiments, the description is relatively simple. For relevant parts, refer to the partial description of the method embodiments.

[0174] FIG8A is a flow chart of a method for driving a display screen according to some embodiments of the present disclosure. The display screen has multiple display areas. For example, the display screen is a vehicle-mounted display screen.

[0175] As shown in FIG8A , the driving method includes steps 802 to 806 .

[0176] At step 802, first content to be displayed in each of the plurality of display areas is obtained. In some embodiments, the video content and the user interface content of at least one display area are superimposed to obtain the first content to be displayed in the at least one display area.

[0177] In step 804 , first to-be-displayed contents of the plurality of display areas are stored in a plurality of first frame buffers.

[0178] At step 806, second content to be displayed, including the first content to be displayed in the plurality of display areas obtained from the plurality of first frame buffers, is stored in the second frame buffer so that the first content to be displayed in the plurality of display areas is output to the display screen for display. Here, the resolution of the first content to be displayed is lower than the resolution of the second content to be displayed, and the resolution of the second content to be displayed is different from the resolution of the display screen.

[0179] For example, the system on chip obtains the second content to be displayed from the second frame buffer and outputs it to the logic chip, and the logic chip outputs the first content to be displayed in the multiple display areas to the display screen for display.

[0180] In the above embodiment, the first content to be displayed in the multiple display areas is stored in the multiple first frame buffers, and then the second content to be displayed is generated based on the first content to be displayed obtained from the multiple first frame buffers. In this way, by changing the method of obtaining the content to be displayed, a single system on chip and a single operating system can be used to drive the multiple display areas of the display screen to display separately.

[0181] FIG8B is a schematic diagram of a process of obtaining first content to be displayed according to some embodiments of the present disclosure.

[0182] At step 812 , the video content and the user interface content are stored in a cache queue.

[0183] In step 814 , the service process is used to obtain the video content and the user interface content from the cache queue.

[0184] In step 816 , the video content obtained from the cache queue and the user interface content are superimposed to obtain first content to be displayed.

[0185] 8B , the first content to be displayed in each of the at least two display areas can be obtained. During the execution of steps 812 to 816, the cache queues of the at least two display areas are different.

[0186] In the above embodiment, for at least two different display areas, different buffer queues are used to process the video content and the UI content respectively in the first to third operations, so that the first to-be-displayed content of the multiple display areas can be obtained in parallel.

[0187] FIG9 is a schematic diagram of a process of starting an application according to some disclosed embodiments.

[0188] In step 902, the installation file of the first application specified by the user to be installed in one of the multiple display areas is parsed to obtain class information of the first application. Here, the class information of the first application carries the identifier of the one display area.

[0189] In step 904 , the class information of the first application is stored in a storage path corresponding to the one display area, wherein different display areas correspond to different storage paths.

[0190] At step 906, the class information of the first application is obtained from the storage path corresponding to the one display area. For example, the class information of the first application is obtained in response to the first application being clicked.

[0191] In step 908 , a component of the first application is created according to the class information of the first application and the component is started, thereby starting the first application.

[0192] In step 910 , based on an identifier of a display area carried in the class information of the first application, it is determined that the content of the first application needs to be displayed in the display area.

[0193] After the first application is started, the first content to be displayed in the one display area includes the content of the first application, such as UI content, or video content and UI content.

[0194] In some embodiments, steps 902 and 904 are performed by a PMS process, and steps 906 to 910 are performed by an AMS process.

[0195] In the above embodiment, the class information for applications in different display regions is stored in separate storage paths, and the class information carries the identifier of the display region in which the application is installed. After a process launches an application based on the class information, the subsequent display content of the application can carry the identifier of the display region in which the application is installed, and thus can ultimately be displayed in the installed display region. In this way, the content of different applications can be displayed independently in different display regions.

[0196] In some embodiments, the driving method further includes: determining coordinates corresponding to a touch operation performed on the display screen in the display interface based on a mapping relationship between the coordinates of each display area in the first coordinate system and the coordinates of the display interface corresponding to the second content to be displayed in the second coordinate system; and performing touch control corresponding to the touch operation based on the coordinates corresponding to the touch operation in the display interface. In this way, not only can each display area be independently displayed, but also each display area can be independently touched.

[0197] In some embodiments, a mapping relationship is established as follows: one or more areas are determined in a display interface, wherein each area includes at least one mapping area mapped to at least one display area, a size of each area in a first direction is the same as a size of the display interface in the first direction, a size of each area in a second direction is a maximum size of at least one mapping area in the second direction, and the second direction is perpendicular to the first direction; and a mapping relationship is determined based on a position of at least one display area in the display screen and a position of at least one mapping area in the display interface.

[0198] In some embodiments, the driving method further includes: in response to detecting a sliding action from one display area to another display area of ​​the two display areas, determining whether the two display areas are mapped to different block areas; in the case where the two display areas are mapped to different block areas, mapping the sliding action into a first sliding action and a second sliding action, wherein the first sliding action is sliding from the mapping area of ​​one display area to the blank area, and the second sliding action is sliding within the mapping area of ​​the other display area.

[0199] In the above embodiment, for sliding across the display area, the unmapped blank area is utilized to decompose the sliding action into two sliding actions. This can reduce the possibility of the operating system making mistakes when calculating the sliding trajectory, so that when sliding in a certain direction on the display screen, the expected sliding trajectory can be displayed normally.

[0200] An embodiment of the present disclosure further provides a display screen driving device, comprising a module configured to execute the display screen driving method of any one of the above embodiments.

[0201] Figure 10 is a schematic diagram of the structure of a driving device of a display screen according to some embodiments of the present disclosure. The display screen has multiple display areas.

[0202] As shown in FIG10 , the driving device of the display screen includes an acquisition module 1001 , a first storage module 1002 and a second storage module 1003 .

[0203] The acquisition module 1001 is configured to acquire first content to be displayed in each display area of ​​the plurality of display areas.

[0204] The first storage module 1002 is configured to store first to-be-displayed contents of a plurality of display areas in a plurality of first frame buffers.

[0205] The second storage module 1003 is configured to store the second content to be displayed, including the first content to be displayed in the multiple display areas obtained from the multiple first frame buffers, in the second frame buffer, so that the first content to be displayed in the multiple display areas is output to the display screen for display. Here, the resolution of the first content to be displayed is lower than the resolution of the second content to be displayed, and the resolution of the second content to be displayed is different from the resolution of the display screen.

[0206] FIG11 is a schematic structural diagram of a driving device for a display screen according to other embodiments of the present disclosure.

[0207] As shown in FIG11 , the driving device 1100 includes a memory 1101 and a processor 1102 coupled to the memory 1101 . The processor 1102 is configured to execute the display screen driving method of any of the aforementioned embodiments based on instructions stored in the memory 1101 .

[0208] The memory 1101 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application program, a boot loader, and other programs.

[0209] In some embodiments, the drive device 1100 may further include an input / output interface 1103, a network interface 1104, a storage interface 1105, and the like. These interfaces 1103, 1104, and 1105, as well as the memory 1101 and the processor 1102, may be connected, for example, via a bus 1106. The input / output interface 1103 provides a connection interface for input / output devices such as a display, mouse, keyboard, and touch screen. The network interface 1104 provides a connection interface for various networked devices. The storage interface 1105 provides a connection interface for external storage devices such as SD cards and USB flash drives.

[0210] Some embodiments of the present disclosure provide a display system, comprising: a display screen drive system according to any one of the above embodiments and a display screen 10. The display system is, for example, a vehicle-mounted display system.

[0211] Other embodiments of the present disclosure provide a display system comprising: a display screen driver according to any of the aforementioned embodiments (e.g., the display screen driver according to the embodiment shown in FIG. 9 or FIG. 10 ) and a display screen 10. For example, the display screen driver is provided in a system-on-chip 22. In some embodiments, the display system may further include a logic chip 23.

[0212] Some embodiments of the present disclosure provide a vehicle, including a display system according to any one of the above embodiments. In some implementations, the vehicle is an automobile, such as a new energy automobile.

[0213] Some embodiments of the present disclosure further provide a computer-readable storage medium including computer program instructions, which, when executed by a processor, implement the method for driving a display screen according to any one of the above embodiments.

[0214] Some embodiments of the present disclosure further provide a computer program product, including a computer program, which, when executed by a processor, implements the method for driving a display screen of any of the above embodiments.

[0215] Thus far, various embodiments of the present disclosure have been described in detail. To avoid obscuring the concept of the present disclosure, some details known in the art have not been described. Based on the above description, those skilled in the art can fully understand how to implement the technical solutions disclosed herein.

[0216] Those skilled in the art will appreciate that embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0217] The present disclosure is described with reference to the flowcharts and / or block diagrams of the methods, apparatus, and computer program products according to the embodiments of the present disclosure. It should be understood that the functions specified in one or more processes in the flowchart and / or one or more blocks in the block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more processes in the flowchart and / or one or more blocks in the block diagram.

[0218] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0219] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0220] Although some specific embodiments of the present disclosure have been described in detail through examples, those skilled in the art will understand that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. Those skilled in the art will understand that the above embodiments may be modified or some technical features may be replaced with equivalents without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A driving system for a display screen, the display screen having a plurality of display areas, the driving system including a system-on-chip and a logic chip, the system-on-chip running an operating system, wherein: The operating system is configured to: Obtain first content to be displayed for each of the plurality of display areas, Store the first content to be displayed of the plurality of display areas in a plurality of first frame buffers, and Store second content to be displayed in a second frame buffer, the second content to be displayed including the first content to be displayed of the plurality of display areas obtained from the plurality of first frame buffers, the resolution of the first content to be displayed being less than the resolution of the second content to be displayed, and the resolution of the second content to be displayed being different from the resolution of the display screen; The system-on-chip is configured to output the second content to be displayed obtained from the second frame buffer; And The logic chip is configured to output the first content to be displayed of the plurality of display areas in the second content to be displayed to the display screen for display.

2. The drive system according to claim 1, wherein The operating system is configured to superimpose video content and user interface content of at least one display area to obtain the first content to be displayed of the at least one display area.

3. The drive system according to claim 2, wherein, The at least one display area includes at least two display areas, and the operating system is configured to, for each of the at least two display areas respectively: Store the video content and the user interface content in a cache queue; Use a service process to obtain the video content and the user interface content from the cache queue; And Superimpose the video content and the user interface content obtained from the cache queue to obtain the first content to be displayed; Wherein, the cache queues of the at least two display areas are different.

4. The drive system according to claim 3, wherein, The service process is a surface manager.

5. The drive system according to any one of claims 1-4, wherein, The operating system includes: A package management service process, configured to: Parse an installation file of a first application specified by a user to be installed in one of the plurality of display areas to obtain class information of the first application, the class information of the first application carrying an identifier of any one of the display areas, and Store the class information of the first application in a storage path corresponding to any one of the display areas, wherein different display areas correspond to different storage paths; and An activation management service process, configured to: Obtain the class information of the first application from the package management service process, Create a component of the first application according to the class information of the first application and start the component, thereby starting the first application, and Determine that the content of the first application needs to be displayed in the one display area according to the identifier of the one display area carried by the class information of the first application.

6. The drive system according to any one of claims 1-5, wherein, The operating system is further configured to: Determine coordinates corresponding to a touch operation performed on the display screen in the display interface according to a mapping relationship between coordinates of each display area in a first coordinate system and coordinates of a display interface corresponding to the second content to be displayed in a second coordinate system; And Perform touch control corresponding to the touch operation according to the coordinates corresponding to the touch operation in the display interface.

7. The drive system according to claim 6, wherein, The operating system is configured to establish the mapping relationship in the following manner: Determine one or more regions in the display interface, where each region includes at least one mapping region mapped to at least one display region. The size of each region in the first direction is the same as the size of the display interface in the first direction, and the size of each region in the second direction is the maximum size of the at least one mapping region in the second direction, and the second direction is perpendicular to the first direction; and According to the position of the at least one display region in the display screen and the position of the at least one mapping region in the display interface, determine the mapping relationship.

8. The drive system according to claim 7, wherein, At least one region further includes a blank region not mapped to the multiple display regions, and the blank region is arranged with the at least one mapping region in the first direction.

9. The drive system according to claim 8, wherein, The operating system is further configured to: In response to detecting a sliding action from one display region to another display region among two display regions, determine whether the two display regions are mapped to different regions; In the case where the two display regions are mapped to different regions, map the sliding action to a first sliding action and a second sliding action, where the first sliding action is sliding from the mapping region of the one display region to the blank region, and the second sliding action is sliding within the mapping region of the other display region.

10. The drive system according to claim 8 or 9, wherein, The blank region includes a first blank region and a second blank region, and the at least one mapping region is located between the first blank region and the second blank region.

11. The drive system according to any one of claims 1-10, wherein, The second content to be displayed corresponds to the display interface, and the first content to be displayed of the multiple display regions corresponds to multiple virtual display regions in the display interface; The logic chip is configured to obtain the first content to be displayed of the multiple display regions from the multiple virtual display regions according to the coordinates of the multiple virtual display regions pre-stored in the display interface, and output the obtained first content to be displayed of the multiple display regions to the display screen for display.

12. The drive system according to any one of claims 1-11, wherein, The logic chip includes a field programmable gate array.

13. The drive system according to any one of claims 1-12, wherein, The system on chip is configured to be connected to the logic chip through a high-definition multimedia interface, and the logic chip is configured to output the second content to be displayed through an embedded display interface.

14. The drive system according to any one of claims 1 to 13, wherein, The display screen is an in-vehicle display screen.

15. A driving method for a display screen, the display screen having multiple display regions, the driving method including: Obtain the first content to be displayed of each display region in the multiple display regions; Store the first content to be displayed of the multiple display regions in multiple first frame buffers; Store second content to be displayed including the first content to be displayed of the multiple display areas obtained from the multiple first frame buffers in a second frame buffer, so that the first content to be displayed of the multiple display areas is output to the display screen for display, the resolution of the first content to be displayed is less than the resolution of the second content to be displayed, and the resolution of the second content to be displayed is different from the resolution of the display screen.

16. The driving method according to claim 15, wherein, The obtaining the first content to be displayed of each display area in the multiple display areas includes: Overlay the video content and the user interface content of at least one display area to obtain the first content to be displayed of the at least one display area.

17. The driving method according to claim 16, wherein, The at least one display area includes at least two display areas, and the overlaying the video content and the user interface content of the at least one display area to obtain the first content to be displayed of the at least one display area includes: For each of the at least two display areas respectively: Store the video content and the user interface content in a cache queue; Use a service process to obtain the video content and the user interface content from the cache queue; and Overlay the video content and the user interface content obtained from the cache queue to obtain the first content to be displayed; wherein, the cache queues of the at least two display areas are different.

18. The driving method according to claim 17, wherein The service process is a surface manager.

19. The driving method according to any one of claims 15-18 further includes: Parse an installation file of a first application specified by a user to be installed in one display area of the multiple display areas to obtain class information of the first application, and the class information of the first application carries an identifier of any one of the display areas; Store the class information of the first application in a storage path corresponding to the one display area, wherein different display areas correspond to different storage paths; Obtain the class information of the first application from the storage path corresponding to the one display area; Create a component of the first application according to the class information of the first application and start the component, thereby starting the first application; and Determine that the content of the first application needs to be displayed in the one display area according to the identifier of the one display area carried by the class information of the first application.

20. The driving method according to any one of claims 15-19 further includes: Determine coordinates corresponding to a touch operation performed on the display screen in the display interface according to a mapping relationship between coordinates of each display area in a first coordinate system and coordinates of a display interface corresponding to the second content to be displayed in a second coordinate system; and Perform touch control corresponding to the touch operation according to the coordinates corresponding to the touch operation in the display interface.

21. The driving method according to claim 20, wherein, Establish the mapping relationship according to the following method: Determine one or more regions in the display interface, where each region includes at least one mapped region mapped to at least one display region, the size of each region in the first direction is the same as the size of the display interface in the first direction, and the size of each region in the second direction is the maximum size of the at least one mapped region in the second direction, and the second direction is perpendicular to the first direction; and Determine the mapping relationship according to the position of the at least one display region in the display screen and the position of the at least one mapped region in the display interface.

22. The driving method according to claim 21, wherein, At least one region further includes a blank region not mapped to the plurality of display regions, and the blank region is arranged with the at least one mapped region in the first direction.

23. The driving method according to claim 22, further comprising: In response to detecting a sliding action from one display region to another display region among two display regions, determine whether the two display regions are mapped to different regions; In the case where the two display regions are mapped to different regions, map the sliding action to a first sliding action and a second sliding action, where the first sliding action is sliding from the mapped region of the one display region to the blank region, and the second sliding action is sliding within the mapped region of the other display region.

24. The driving method according to claim 22 or 23, wherein, The blank region includes a first blank region and a second blank region, and the at least one mapped region is located between the first blank region and the second blank region.

25. The driving method according to any one of claims 15-24, wherein, The second content to be displayed corresponds to the display interface, and the first content to be displayed of the plurality of display regions corresponds to a plurality of virtual display regions in the display interface; The method further comprises: According to the coordinates of the plurality of virtual display regions in the display interface stored in advance, obtain the first content to be displayed of the plurality of display regions from the plurality of virtual display regions, and output the obtained first content to be displayed of the plurality of display regions to the display screen for display.

26. The driving method according to any one of claims 15-25, wherein, The display screen is an in-vehicle display screen.

27. A driving device for a display screen, the display screen having a plurality of display regions, the driving device comprising: An acquisition module configured to acquire the first content to be displayed of each display region in the plurality of display regions; A first storage module configured to store the first content to be displayed of the plurality of display regions in a plurality of first frame buffers; And A second storage module configured to store a second content to be displayed including the first content to be displayed of the plurality of display regions acquired from the plurality of first frame buffers in a second frame buffer, so that the first content to be displayed of the plurality of display regions is output to the display screen for display, and the resolution of the first content to be displayed Is less than the resolution of the second content to be displayed, and the resolution of the second content to be displayed is different from the resolution of the display screen.

28. A driving device for a display screen, the display screen having a plurality of display regions, the driving device comprising: A memory; And A processor coupled to the memory, configured to execute the driving method according to any one of claims 15-27 based on instructions stored in the memory.

29. A display system, comprising: A driving system for a display screen according to any one of claims 1-14, or a driving device for a display screen according to any one of claims 27-28; And The display screen.

30. A vehicle, comprising the display system according to claim 29.

31. A computer-readable storage medium, comprising computer program instructions, wherein, When the computer program instructions are executed by a processor, the driving method according to any one of claims 15-26 is implemented.

32. A computer program product comprising a computer program, wherein, When the computer program is executed by a processor, the driving method according to any one of claims 15-26 is implemented.

Images