USB multi-screen display method and device based on Android and medium
By developing USB-DRM display driver module and USB display device management service module in Android system, dynamically create and manage display devices, pre-apply for cache space, and support local layer updates, the performance of USB multi-screen display in the existing technology has been solved. Problem, efficient image transmission and low CPU usage are achieved, and users can plug and play.
Patent Information
- Application Number
- CN202411084738.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-08
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2044-08-08
AI Technical Summary
The USB multi-screen display solution under the existing Android system does not support dynamic creation of display layers, high CPU occupancy, slow image transmission speed, low display frame rate, and requires preset or installation of applications to transmit image data.
Develop USB-DRM display driver module at the kernel layer of the Android system, develop USB display device management service module on the Android superposition layer, monitor external USB device access through multiple USB interfaces of the USB-DRM display driver module, and dynamically create DRM display Devices and USB display devices, pre-apply for USB display cache space, and support local layer updates to reduce the number of data copies and resource usage.
It realizes multi-screen recognition hot plug-in, reduces data transmission and CPU usage, improves display frame rate, and uses plug and play for users without preinstalling applications.
Smart Images

Figure CN118939218A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to an Android-based USB multi-screen display method, device and medium. Background Art
[0002] The Android system usually includes the Android user space layer, the Android framework layer, the Android overlay layer, the kernel layer and the physical layer. The existing USB display device under the Android system usually displays images by using screen recording, upper layer image overlay acquisition and other solutions, as follows:
[0003] Option 1: If Figure 1 As shown, the Android user space layer is used to store application screens, the Android framework layer is used to implement screen management services, the Android overlay layer is used to implement main screen overlay management services, the kernel layer is used to implement conventional display drivers, and the physical layer is used to implement main screen display. The data interaction process of the main screen display is: the application screen is screen managed, the main screen overlay layer is managed, and the display driver is processed before entering the main screen for display. On this basis, a virtual screen is developed on the Android framework layer. After the application screen is managed, the screen can be recorded through the virtual screen and then displayed on the physical extended screen through the USB middleware.
[0004] Option 2: If Figure 2 As shown, the Android user space layer is used to store application screens, the Android framework layer is used to implement display management services, the Android overlay layer is used to implement main screen management services, the kernel layer is used to implement conventional display drivers, and the physical layer is used to implement main screen display. The data interaction process of the main screen display is as follows: the application screen is sequentially managed by the display, the main screen, and the display driver, and then enters the main screen for display. On this basis, a virtual screen is developed on the Android overlay layer. After the application screen is managed by the display, it can be recorded on the virtual screen and then displayed on the physical extended screen through the USB middleware.
[0005] Both of the above solutions use screen recording to achieve multi-screen display, but there are the following problems: no support for dynamic creation of display layers, high CPU usage, slow image transmission speed, low display frame rate, and most solutions require pre-setting or installation of applications for image data transmission. Summary of the invention
[0006] In view of this, the purpose of the present invention is to propose a USB multi-screen display method based on Android, which adopts a newly added USB-DRM display driver module and a USB display device management service module. It does not require the installation of additional applications, and can solve multi-screen display, improve display frame rate, reduce CPU occupancy, and users can plug and play.
[0007] In order to achieve the above technical objectives, the technical solution adopted by the present invention is:
[0008] The present invention provides an Android-based USB multi-screen display method, comprising the following steps:
[0009] Step 1: When the terminal detects that at least one external USB device with a physical display screen is connected, the terminal obtains device information corresponding to the external USB device and creates a corresponding DRM display device according to the device information;
[0010] Step 2: The DRM display device establishes a connection with the physical display screen, and creates a corresponding USB display device according to the device information;
[0011] Step 3, the USB display device pre-applies for a USB display cache space, and sends a storage space address storing layer data in the USB display cache space to the DRM display device;
[0012] Step 4: When the application screen changes, the terminal writes the updated partial layer data or complete layer data into the USB display buffer space of the USB display device;
[0013] Step 5: The DRM display device obtains updated partial layer data or complete layer data through the storage space address of the layer data, and sends it to the physical display screen for display.
[0014] Furthermore, before step 1, the step further includes:
[0015] Step 01, develop a USB-DRM display driver module in the kernel layer of the Android system, and develop a USB display device management service module on the Android overlay layer of the Android system;
[0016] Step 02, the USB-DRM display driver module is provided with a plurality of USB interfaces, and the plurality of USB interfaces are used to respectively access a plurality of external USB devices having physical display screens;
[0017] Step 03, the terminal of the Android system determines whether an external USB device with a physical display screen is connected by detecting multiple USB interfaces of the USB-DRM display driver module; if so, proceed to step 1; if not, continue detecting.
[0018] Furthermore, the step 1 specifically includes:
[0019] Step 11: When the terminal detects that an external USB device is connected through the USB-DRM display driver module, the USB-DRM display driver module obtains device information corresponding to the external USB device;
[0020] Step 12, the USB-DRM display driver module creates a unique corresponding DRM display device according to the device information;
[0021] Step 13: Load multiple device protocols that match the DRM display device.
[0022] Furthermore, the step 2 specifically includes:
[0023] Step 21, the DRM display device attempts to establish a connection with the physical display screen through a certain device protocol, and determines whether the connection is successful. If so, proceed to step 22; if not, use the next device protocol to connect until all device protocols are executed;
[0024] Step 22: reporting the device information to the USB display device management service module;
[0025] Step 23: The USB display device management service module creates a unique corresponding USB display device according to the device information.
[0026] Furthermore, the step 3 specifically includes:
[0027] Step 31, the USB display device obtains a corresponding resolution list according to the resolution supported by the DRM display device;
[0028] Step 32: Select a resolution from the resolution list as the resolution mode of the USB display device;
[0029] Step 33, the USB display device pre-applies for a USB display buffer space for storing a complete USB communication protocol data packet;
[0030] Step 34, setting a layer position for storing layer data in the USB display buffer space;
[0031] Step 35: Determine the storage space address of the layer data according to the layer position where the layer data is stored, send it to the DRM display device, and map it to the corresponding DRM display cache space.
[0032] Furthermore, the step 4 specifically includes:
[0033] Step 41, when the application screen changes, the terminal writes the updated partial layer data or complete layer data into the USB display device management service module;
[0034] Step 42, the USB display device management service module determines whether the updated partial layer data or complete layer data needs encoding conversion; if so, proceed to step 43; if not, proceed to step 44;
[0035] Step 43: The updated partial layer data or complete layer data is converted by a code conversion module and then written into the layer position of the corresponding USB display device, and the process proceeds to step 5;
[0036] Step 44: directly write the updated partial layer data or complete layer data into the layer position of the corresponding USB display device, and proceed to step 5.
[0037] Furthermore, after step 5, the following steps are further included:
[0038] Step 61: The terminal detects the removal status of the external USB device through multiple USB interfaces of the USB-DRM display driver module. If it is detected that the external USB device is removed, the USB-DRM display driver module obtains device information corresponding to the removed external USB device.
[0039] Step 62: The USB-DRM display driver module destroys the corresponding DRM display device and layer data according to the device information;
[0040] Step 63: The USB-DRM display driver module sends the device information and removal status corresponding to the removed external USB device to the USB display device management service module;
[0041] Step 64: The USB display device management service module destroys the corresponding USB display device and layer data according to the device information and removal status.
[0042] Furthermore, the device information includes a USB port number, a serial number, and a unique identification number of a physical display screen.
[0043] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, an Android-based USB multi-screen display method as described above is implemented.
[0044] The present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the Android-based USB multi-screen display method as described above.
[0045] By adopting the above technical solution, the present invention has the following beneficial effects compared with the prior art:
[0046] 1. Dynamically create DRM display devices and USB display devices: Develop a USB-DRM display driver module in the kernel layer of the Android system, and develop a USB display device management service module on the Android overlay layer of the Android system; monitor the access of external USB devices through multiple USB interfaces of the USB-DRM display driver module and obtain the device information of the external USB devices, dynamically create a corresponding DRM display device on the kernel layer for each external USB device connected according to the USB-DRM display driver module, and dynamically create a corresponding USB display device on the Android overlay layer for each external USB device connected according to the USB display device management service module. The Android overlay layer is used to directly display images without the need for screen recording or upper-layer image overlay, thereby reducing the burden on the CPU.
[0047] 2. Apply for and map USB display cache space in advance: When an external USB device is connected, the USB display device applies for a USB display cache space in advance and maps the storage space address of its image data directly to the DRM display cache space of the DRM display device. In this way, when the external USB device is removed, the corresponding Android overlay USB display device, the kernel layer DRM display device and cached image data can be destroyed synchronously, further reducing resource usage.
[0048] 3. Reduce the number of data copies: By synchronously mapping the USB display cache space to the corresponding DRM display cache space, the number of data copies in the memory is reduced, thereby improving the image transmission speed.
[0049] 4. Support for local layer updates: The present invention supports the update of independent layer blocks of the Android overlay, allowing only the local area in the cache to be updated instead of the entire layer. This can significantly reduce the time required to write layer data to the cache and further improve the frame rate.
[0050] In summary, the overall system solution of the present invention achieves the goals of multi-screen recognition hot plug, reducing data transmission, reducing CPU usage and improving display frame rate through dynamic, pre-applying for cache, cache mapping video memory and transmission protocol, supporting independent layer update and other technical means. This solution involves the transformation of only the Android overlay layer and kernel layer, and does not require pre-installation of any application program, reducing the user's usage cost, and plug-and-play BRIEF DESCRIPTION OF THE DRAWINGS
[0051] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0052] Figure 1 It is a structural block diagram of solution 1 in the prior art.
[0053] Figure 2 It is a structural block diagram of solution 2 in the prior art.
[0054] Figure 3 It is an execution flow chart of an Android-based USB multi-screen display method provided by an embodiment of the present invention.
[0055] Figure 4 It is a structural block diagram of the Android system of the present invention.
[0056] Figure 5 It is a schematic diagram of an electronic device provided by an embodiment of the present invention.
[0057] Figure 6 It is a schematic diagram of a computer-readable storage medium provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0058] The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. It is particularly noted that the following examples are only used to illustrate the present invention, but are not intended to limit the scope of the present invention. Similarly, the following examples are only partial embodiments of the present invention rather than all embodiments, and all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of the present invention.
[0059] See also Figure 3 , a USB multi-screen display method based on Android of the present invention comprises the following steps:
[0060] Step 1. When the terminal detects that at least one external USB device with a physical display screen is connected, the terminal obtains the device information corresponding to the external USB device and creates a corresponding DRM display device according to the device information; the device information is the ID of the interface descriptor, including the USB port number, serial number and unique identification number of the physical display screen. An external USB device uniquely corresponds to an interface descriptor ID, and a unique DRM display device and USB display device can be created according to the ID of the interface descriptor; the access and removal of the corresponding external USB device can be better managed through the unique DRM display device and USB display device. When multiple external USB devices are connected at the same time, it can be ensured that the management of multiple external USB devices is independent and does not interfere with each other.
[0061] In this embodiment, before step 1, the following steps are also included:
[0062] like Figure 4As shown, step 01, develop a USB-DRM display driver module in the kernel layer of the Android system, and develop a USB display device management service module on the Android overlay layer of the Android system; the functions of the USB-DRM display driver module: it has multiple USB interfaces, realizes the detection of external USB devices, the loading of device protocols, and the creation of DRM display devices; actively reports the access and removal of external USB devices, and the subsequent processes are called by the USB display device management service. The functions of the USB display device management service module: management module / middleware module; realizes data interaction management, layer data management and device management; calls the USB-DRM display driver module and the application layer display screen. With the newly added USB-DRM display driver module and USB display device management service module, there is no need to install additional applications for same-screen display, and the use of a safe standard interface to realize different-screen display can solve multi-screen display, improve display frame rate, reduce CPU occupancy, and users can plug and play.
[0063] Step 02, the USB-DRM display driver module is provided with multiple USB interfaces, and the multiple USB interfaces are used to respectively access multiple external USB devices with physical display screens; the multiple USB interfaces can simultaneously access multiple external USB devices to realize the display of multiple physical display screens.
[0064] Step 03, the terminal of the Android system determines whether an external USB device with a physical display screen is connected by detecting multiple USB interfaces of the USB-DRM display driver module; if so, go to step 1; if not, continue to detect. By dynamically detecting the ID of the external USB device, pre-creating a mapping, and destroying the corresponding ID image data block to the USB display device of the Android overlay layer, dynamic plug-in and dynamic identification of multiple screens can be realized; by pre-detecting and judging whether an external USB device is connected, it provides a basis for subsequent steps.
[0065] In this embodiment, the step 1 specifically includes:
[0066] Step 11: When the terminal detects that an external USB device is connected through the USB-DRM display driver module, the USB-DRM display driver module obtains device information corresponding to the external USB device;
[0067] Step 12, the USB-DRM display driver module creates a unique corresponding DRM display device according to the device information;
[0068] Step 13: Load multiple device protocols that match the DRM display device, where the device protocols are used to establish a connection between the DRM display device and the physical display screen.
[0069] Step 2: The DRM display device establishes a connection with the physical display screen, and creates a corresponding USB display device according to the device information;
[0070] In this embodiment, step 2 specifically includes:
[0071] Step 21, the DRM display device attempts to establish a connection with the physical display screen through a certain device protocol, and determines whether the connection is successful. If so, proceed to step 22; if not, use the next device protocol to connect until all device protocols are executed; ensure that the DRM display device and the physical display screen can be successfully connected to achieve data transmission and display;
[0072] Step 22: reporting the device information to the USB display device management service module; specifically, the USB-DRM display driver module transmits the connection status between the DRM display device and the physical display screen and the device information to the USB display device management service module;
[0073] Step 23, the USB display device management service module first determines that the DRM display device and the physical display screen are successfully connected according to the connection status, which can ensure the normal transmission and display of subsequent data; then, the USB display device management service module creates a unique corresponding USB display device according to the device information.
[0074] Develop a USB-DRM display driver module in the kernel layer of the Android system, and develop a USB display device management service module on the Android overlay layer of the Android system; monitor the access of external USB devices through multiple USB interfaces of the USB-DRM display driver module and obtain the device information of the external USB devices, dynamically create a corresponding DRM display device on the kernel layer for each external USB device connected according to the USB-DRM display driver module, and dynamically create a corresponding USB display device on the Android overlay layer for each external USB device connected according to the USB display device management service module. The Android overlay layer is used to directly display images without the need for screen recording or upper image overlay, thereby reducing the burden on the CPU.
[0075] Step 3, the USB display device pre-applies for a USB display cache space, and sends a storage space address storing layer data in the USB display cache space to the DRM display device;
[0076] In this embodiment, step 3 specifically includes:
[0077] Step 31, the USB display device obtains a corresponding resolution list according to the resolution supported by the DRM display device;
[0078] Step 32, select a resolution from the resolution list as the resolution mode of the USB display device; the operations of steps 31 and 32 are to ensure that the size of the adopted resolution can meet the requirements of both the DRM display device and the USB display device, thereby ensuring that data can be transmitted smoothly.
[0079] Step 33, the USB display device pre-applies for a USB display cache space for storing a complete USB communication protocol data packet; the complete USB communication protocol data packet includes layer data and non-layer data, and both the layer data and the non-layer data are stored in the USB display cache space, but the storage location is set; the image data block of the complete USB communication protocol data packet is pre-applied for mapping in the DRM display device of the USB-DRM display driver module; the number of memory copies is reduced, and compared with the solutions on the market, the data copy is reduced by at least one copy, and the overall performance is improved by 50%;
[0080] Step 34, setting a layer position for storing layer data in the USB display cache space to facilitate acquisition of layer data;
[0081] Step 35, determine the storage space address of the layer data according to the layer position where the layer data is stored, send it to the DRM display device, and map it to the corresponding DRM display cache space; wherein, the storage space address of the layer data is mapped to a layer of a DRM display cache space, or the storage space address of the layer data is divided and mapped to multiple layers of DRM display cache spaces, which can support the writing of single or multiple layer data to complete the local update of the image; under normal circumstances, the CPU occupancy rate is greatly reduced to ensure the smoothness of other applications; and the image transmission speed is improved. By synchronously mapping the USB display cache space to the corresponding DRM display cache space, the number of times the data is copied in the memory is reduced, thereby improving the image transmission speed.
[0082] When an external USB device is connected, the USB display device pre-applies for a USB display cache space and maps the storage space address of its image data directly to the DRM display cache space of the DRM display device. In this way, when the external USB device is removed, the corresponding Android overlay USB display device, the kernel layer DRM display device and cached image data can be destroyed synchronously, further reducing resource usage.
[0083] Step 4: When the application screen of the terminal changes, the updated partial layer data or complete layer data is written into the USB display cache space of the USB display device; the present invention supports the update of independent layer blocks of the Android overlay layer, allowing only the partial area in the cache to be updated instead of the entire layer. This can significantly reduce the time required to write the layer data into the cache and further improve the frame rate.
[0084] In this embodiment, step 4 specifically includes:
[0085] Step 41: When the application screen changes, the terminal writes the updated partial layer data or complete layer data into the USB display device management service module; specifically, the steps include:
[0086] The entire application screen includes multiple layers of data;
[0087] The layer data includes coordinates, levels or layer IDs;
[0088] Update local layer data, and only write the updated local layer data to the USB display device management service module to realize the change of the application screen;
[0089] Update the complete layer data, write the updated complete layer data into the USB display device management service module, and realize the change of the application screen;
[0090] Step 42, the USB display device management service module determines whether the updated partial layer data or complete layer data needs encoding conversion, including layer data compression and layer data transcoding; if so, proceed to step 43; if not, proceed to step 44;
[0091] Step 43: The updated partial layer data or complete layer data is converted by a code conversion module and then written into the layer position of the corresponding USB display device, and the process proceeds to step 5;
[0092] Step 44: directly write the updated partial layer data or complete layer data into the layer position of the corresponding USB display device, and proceed to step 5.
[0093] Step 5: The DRM display device obtains updated partial layer data or complete layer data through the storage space address of the layer data, and sends it to the physical display screen for display. Specifically, when updated layer data is written to the layer of the USB display device, a DRM display device update event will be triggered; when the USB-DRM display driver module is triggered by the DRM display device update event, the data is directly sent to the physical display screen through the data transmission module to realize USB multi-screen display of the Android system;
[0094] In this embodiment, after step 5, the following steps are further included:
[0095] Step 61: The terminal detects the removal status of the external USB device through multiple USB interfaces of the USB-DRM display driver module. If it is detected that the external USB device is removed, the USB-DRM display driver module obtains device information corresponding to the removed external USB device.
[0096] Step 62: The USB-DRM display driver module destroys the corresponding DRM display device and layer data according to the device information;
[0097] Step 63: The USB-DRM display driver module sends the device information and removal status corresponding to the removed external USB device to the USB display device management service module;
[0098] Step 64: The USB display device management service module destroys the corresponding USB display device and layer data according to the device information and removal status.
[0099] The terminal of the present invention includes dynamically detecting the access and removal of external USB devices; if an external USB device is accessed, a corresponding DRM display device is created, and a corresponding USB display device is created in an Android overlay layer, a corresponding USB display cache space is pre-applied and mapped to the DRM display cache space, and when the application screen changes, the updated local layer data or complete layer data is directly written into the USB display cache space of the USB display device, and then the layer data is written into the DRM display cache space, and then submitted to the external USB device, and the USB to HDMI is directly displayed and output by the physical display screen; if the external USB device is removed, the corresponding USB display device of the Android overlay layer is destroyed, and the DRM display device of the kernel layer is removed. The method of the present invention can be realized as follows: a USB-DRM display driver module is developed in the kernel layer of an Android system, and a USB display device management service module is developed on the Android overlay layer of the Android system; a USB display device of an Android overlay layer and a DRM display device of a kernel layer are dynamically created or destroyed under the Android system, and the USB-DRM display driver module is provided with a plurality of USB interfaces, can support a plurality of external USB devices, and each physical display screen can support hot plugging; the method is adopted to directly use the layer data of the Android overlay layer, and pre-apply for a USB display cache space for storing a complete USB communication protocol data packet, thereby reducing the consumption of data transmission time, reducing the CPU utilization rate, and improving the display frame rate. The scheme of the present invention only transforms the Android overlay layer and the kernel layer, and does not need to install any application.
[0100] like Figure 5 As shown, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the above-mentioned Android-based USB multi-screen display method is implemented.
[0101] like Figure 6As shown, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-mentioned Android-based USB multi-screen display method.
[0102] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0103] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.
[0104] The above descriptions are only some embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any equivalent device or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A USB multi-screen display method based on Android, characterized in that: The steps include: Step 1: When the terminal detects that at least one external USB device with a physical display screen is connected, the terminal obtains device information corresponding to the external USB device and creates a corresponding DRM display device according to the device information; Step 2: The DRM display device establishes a connection with the physical display screen, and creates a corresponding USB display device according to the device information; Step 3, the USB display device pre-applies for a USB display cache space, and sends a storage space address storing layer data in the USB display cache space to the DRM display device; Step 4: When the application screen changes, the terminal writes the updated partial layer data or complete layer data into the USB display buffer space of the USB display device; Step 5: The DRM display device obtains updated partial layer data or complete layer data through the storage space address of the layer data, and sends it to the physical display screen for display.
2. The Android-based USB multi-screen display method according to claim 1, characterized in that: The step 1 also includes: Step 01, develop a USB-DRM display driver module in the kernel layer of the Android system, and develop a USB display device management service module on the Android overlay layer of the Android system; Step 02, the USB-DRM display driver module is provided with a plurality of USB interfaces, and the plurality of USB interfaces are used to respectively access a plurality of external USB devices having physical display screens; Step 03, the terminal of the Android system determines whether an external USB device with a physical display screen is connected by detecting multiple USB interfaces of the USB-DRM display driver module; if so, proceed to step 1; if not, continue detecting.
3. The Android-based USB multi-screen display method as described in claim 2, characterized in that: The step 1 specifically includes: Step 11: When the terminal detects that an external USB device is connected through the USB-DRM display driver module, the USB-DRM display driver module obtains device information corresponding to the external USB device; Step 12, the USB-DRM display driver module creates a unique corresponding DRM display device according to the device information; Step 13: Load multiple device protocols that match the DRM display device.
4. The Android-based USB multi-screen display method as described in claim 3, characterized in that: The step 2 specifically includes: Step 21, the DRM display device attempts to establish a connection with the physical display screen through a certain device protocol, and determines whether the connection is successful. If so, proceed to step 22; if not, use the next device protocol to connect until all device protocols are executed; Step 22: reporting the device information to the USB display device management service module; Step 23: The USB display device management service module creates a unique corresponding USB display device according to the device information.
5. The Android-based USB multi-screen display method as described in claim 4, characterized in that: The step 3 specifically includes: Step 31, the USB display device obtains a corresponding resolution list according to the resolution supported by the DRM display device; Step 32: Select a resolution from the resolution list as the resolution mode of the USB display device; Step 33, the USB display device pre-applies for a USB display buffer space for storing a complete USB communication protocol data packet; Step 34, setting a layer position for storing layer data in the USB display buffer space; Step 35: Determine the storage space address of the layer data according to the layer position where the layer data is stored, send it to the DRM display device, and map it to the corresponding DRM display cache space.
6. The Android-based USB multi-screen display method as claimed in claim 5, characterized in that: The step 4 specifically includes: Step 41, when the application screen changes, the terminal writes the updated partial layer data or complete layer data into the USB display device management service module; Step 42, the USB display device management service module determines whether the updated partial layer data or complete layer data needs encoding conversion; if so, proceed to step 43; if not, proceed to step 44; Step 43: The updated partial layer data or complete layer data is converted by a code conversion module and then written into the layer position of the corresponding USB display device, and the process proceeds to step 5; Step 44: directly write the updated partial layer data or complete layer data into the layer position of the corresponding USB display device, and proceed to step 5.
7. The Android-based USB multi-screen display method according to claim 6, characterized in that: After step 5, the following steps are also included: Step 61: The terminal detects the removal status of the external USB device through multiple USB interfaces of the USB-DRM display driver module. If it is detected that the external USB device is removed, the USB-DRM display driver module obtains device information corresponding to the removed external USB device. Step 62: The USB-DRM display driver module destroys the corresponding DRM display device and layer data according to the device information; Step 63: The USB-DRM display driver module sends the device information and removal status corresponding to the removed external USB device to the USB display device management service module; Step 64: The USB display device management service module destroys the corresponding USB display device and layer data according to the device information and removal status.
8. The Android-based USB multi-screen display method according to claim 1, characterized in that: The device information includes a USB port number, a serial number, and a unique identification number of a physical display screen.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, an Android-based USB multi-screen display method is implemented as described in any one of claims 1 to 8.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, an Android-based USB multi-screen display method as described in any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Method for updating program list of DRM (Digital Rights Management) receiver
CN102820939A
Panoramic image display method, computer storage medium and electronic equipment
CN112988357A
Display method and system
CN116841490A
Double-screen display control method and device based on DRM
CN118151876A
File display method, device and system, mobile terminal, and display terminal
WO2020025068A1
