Screen projection processing method, device, electronic device and readable medium for image data

Abstract

The present disclosure belongs to the field of data processing technology, and specifically discloses a method, device, equipment and medium for screen projection processing of image data. The method includes: creating a virtual display screen in a first image device through a display driver module, and configuring the screen attribute parameters of the virtual display screen so that the virtual display screen realizes the image display function according to the screen attribute parameters; converting and processing the first image data displayed in the virtual display screen acquired by the display driver module through a display processing module to obtain second image data, and transmitting the second image data to a second image device, so that the second image device can project the second image data for display. This method can realize the adaptation processing between the second image device and the first image device, thereby facilitating the flexible implementation of the screen projection function between different types of image devices.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a method, device, electronic device and readable medium for screen projection processing of image data. Background Art

[0002] The screen projection processing of image data mainly involves the process of transferring the image from the source device to the target device for display. The specific processing method is as follows: First, you need to ensure that the source device (such as a mobile phone, computer) and the target device (such as a TV, projector) support the screen projection function, and check whether the two are in the same network environment. Then, you can choose wireless screen projection or wired screen projection according to the support of the device.

[0003] In the related art, screen projection can only be performed between devices that support the same screen projection function and screen projection processing method. Once the two devices support different screen projection functions or screen projection processing methods, screen projection processing cannot be achieved. Summary of the invention

[0004] To this end, the present disclosure provides a method, device, electronic device and readable medium for screen projection processing of image data to solve the problem in the prior art that screen projection processing cannot be implemented when the screen projection functions or screen projection processing methods supported by two devices are different.

[0005] In order to achieve the above-mentioned object, the present disclosure provides a method for screen projection processing of image data in a first aspect, the method comprising:

[0006] Creating a virtual display screen in the first image device through a display driver module, and configuring screen attribute parameters of the virtual display screen so that the virtual display screen implements an image display function according to the screen attribute parameters;

[0007] The display processing module converts the first image data displayed in the virtual display screen acquired by the display driving module to obtain second image data, and transmits the second image data to the second image device so that the second image device can project and display the second image data;

[0008] The virtual display screen in the first image device is created based on the Windows graphics subsystem, and the second image device receives the second image data based on a USB chip; and the display driver module is implemented by an indirect display driver and an indirect display driver class extension program.

[0009] In an optional implementation, the display processing module converts the first image data displayed in the virtual display screen acquired by the display driving module to obtain the second image data, which includes:

[0010] When the display driver module detects that the screen display state of the virtual display screen has changed, the display processing module performs state conversion processing on the first image data so that the second image data obtained after the conversion processing matches the changed screen display state;

[0011] Furthermore, a conversion instruction is sent to the USB chip in the second image device to instruct the USB chip to adjust the screen display state corresponding to the second image device so that the screen display state corresponding to the second image device matches the changed screen display state in the first image device.

[0012] In an optional implementation, the screen display state includes: screen resolution, and / or screen display mode;

[0013] The screen display mode includes at least one of the following: a single-screen display mode, a multi-screen display mode, an extended-screen display mode, and a duplicate-screen display mode.

[0014] In an optional implementation, before creating a virtual display screen in the first image device and configuring screen attribute parameters of the virtual display screen, the method further includes:

[0015] Acquiring device attribute parameters corresponding to the second image device, and configuring screen attribute parameters of the virtual display screen according to the device attribute parameters; and

[0016] A chip control instruction is sent to the USB chip on which the second imaging device is based, so that the chip state of the USB chip is switched from a power-on state to a working state.

[0017] In an optional implementation, the converting and processing the first image data displayed in the virtual display screen acquired by the display driver module to obtain the second image data includes:

[0018] determining a format conversion method according to a comparison result between a device attribute parameter corresponding to the second image device and the screen attribute parameter;

[0019] According to the format conversion method, the first image data displayed in the virtual display screen acquired by the display driving module is format converted to obtain second image data.

[0020] In an optional implementation, after creating the virtual display screen in the first image device, the method further includes:

[0021] monitoring interface status information of a preset interface in the first image device, and re-performing the step of creating a virtual display screen in the first image device when it is determined according to the interface status information that an abnormality exists in the preset interface in the first image device;

[0022] The preset interface includes: a callback interface, and the callback interface is used to call back the display driver module to realize image data transmission between the first image device and the display driver module.

[0023] A second aspect of the present disclosure provides a screen projection processing device for image data, the device comprising:

[0024] A display driver module, used for creating a virtual display screen in the first image device, and configuring screen attribute parameters of the virtual display screen, so that the virtual display screen realizes an image display function according to the screen attribute parameters;

[0025] A display processing module, configured to convert the first image data displayed in the virtual display screen acquired by the display driving module to obtain second image data, and transmit the second image data to a second image device so that the second image device can project and display the second image data;

[0026] The virtual display screen in the first image device is created based on the Windows graphics subsystem, and the second image device receives the second image data based on a USB chip; and the display driver module is implemented by an indirect display driver and an indirect display driver class extension program.

[0027] A third aspect of the present disclosure provides an electronic device, including:

[0028] one or more processors;

[0029] A storage device having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the above-mentioned method for processing screen projection of image data;

[0030] One or more I / O interfaces are connected between the processor and the memory and are configured to implement information interaction between the processor and the memory.

[0031] A fourth aspect of the present disclosure provides a computer-readable medium having a computer program stored thereon, which implements the above-mentioned method for processing screen projection of image data when the program is executed by a processor.

[0032] According to another aspect of the present disclosure, a computer program product is provided, characterized in that it includes a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code, and when the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the screen projection processing method as described above.

[0033] The present disclosure has at least the following advantages:

[0034] In the disclosed embodiment, a virtual display screen can be created in the first image device through the display driver module, and the screen attribute parameters of the virtual display screen can be flexibly configured so as to adapt the virtual display screen to the second image device. In addition, the first image data acquired by the display driver module is converted and processed through the display processing module to obtain the second image data for display by the second image device. With the help of the conversion processing operation, the adaptation processing between the second image device and the first image device can be realized, so as to facilitate the flexible implementation of the screen projection function between different types of image devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings are used to provide further understanding of the present disclosure and constitute a part of the specification. They are used to explain the present disclosure together with the following detailed description, but do not constitute a limitation of the present disclosure.

[0036] Figure 1 A flowchart of a method for screen projection processing of image data provided by an embodiment of the present disclosure;

[0037] Figure 2 A schematic diagram of the structure of a screen projection processing system in an example of the present disclosure is shown;

[0038] Figure 3 A schematic diagram showing a flow chart of a method for screen projection processing of image data provided by an example of the present disclosure;

[0039] Figure 4 A block diagram of a screen projection processing device for image data provided by an embodiment of the present disclosure;

[0040] Figure 5 A block diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0041] The specific implementation of the present disclosure is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described herein is only used to illustrate and explain the present disclosure, and is not used to limit the present disclosure.

[0042] As used in this disclosure, the term "and / or" includes any and all combinations of one or more of the associated listed items.

[0043] The terms used in the present disclosure are only used to describe specific embodiments and are not intended to limit the present disclosure.As used in the present disclosure, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

[0044] When the terms “comprising” and / or “made of…” are used in the present disclosure, it specifies the existence of the stated features, integers, steps, operations, elements and / or components, but does not exclude the existence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0045] The embodiments described in the present disclosure may be described with reference to plan views and / or cross-sectional views by way of ideal schematic diagrams of the present disclosure. Therefore, the exemplary illustrations may be modified according to manufacturing techniques and / or tolerances.

[0046] Unless otherwise defined, all terms (including technical and scientific terms) used in this disclosure have the same meaning as those commonly understood by those of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this disclosure, and will not be interpreted as having an idealized or overly formal meaning unless explicitly defined in this disclosure.

[0047] In the related art, screen projection can only be performed between devices that support the same screen projection function and screen projection processing method. Once the two devices support different screen projection functions or screen projection processing methods, screen projection processing cannot be implemented. In view of this, the embodiments of the present disclosure provide a screen projection processing method, device, electronic device and readable medium for image data. With the help of conversion processing operations, adaptation processing between the second image device and the first image device can be achieved, thereby facilitating the flexible implementation of the screen projection function between different types of image devices.

[0048] In a first aspect, an embodiment of the present disclosure provides a method for processing screen projection of image data.

[0049] Figure 1 A flowchart of a method for processing screen projection of image data provided by an embodiment of the present disclosure, referring to Figure 1 , the method comprising:

[0050] Step S110: creating a virtual display screen in the first image device through the display driver module, and configuring screen attribute parameters of the virtual display screen, so that the virtual display screen realizes an image display function according to the screen attribute parameters.

[0051] Among them, the display driver module is used to implement the drive processing function, which can be specifically various types of drive processing modules for performing display-related functions. In this application, the display driver module is implemented by an indirect display driver (Indirect Display Driver, IDD) and an indirect display driver class extension (Indirect Display Driver ClasseXtension, IddCx). Accordingly, IDD can request the Windows graphics subsystem to create one or more virtual display screens through the indirect display driver class extension. These virtual display screens can have different resolutions, refresh rates and other properties to meet the needs of screen projection.

[0052] Among them, the virtual display screen is realized through a special display method. It is different from the traditional physical display screen. It is a display area simulated by software or hardware technology. Specifically, based on computer graphics technology, one or more display screens can be simulated in the computer system through specific software or hardware devices. These virtual display screens can display various contents such as application windows, icons, texts and images like real physical screens.

[0053] In order to achieve the adaptation between the virtual display screen and the image device, in this step, the screen attribute parameters of the virtual display screen need to be configured so that the virtual display screen can realize the image display function according to the screen attribute parameters. The screen attribute parameters may include various contents such as resolution and refresh rate.

[0054] Step S120: The display processing module converts the first image data displayed in the virtual display screen acquired by the display driving module to obtain second image data, and transmits the second image data to the second image device so that the second image device can project and display the second image data.

[0055] In the present application, the virtual display screen in the first image device is created based on the Windows graphics subsystem, and the second image device receives the second image data based on the USB chip. Since the screen projection functions or screen projection processing methods supported by the first image device and the second image device may be different, in order to achieve adaptation between the two devices, in this step, it is necessary to convert the first image data obtained by the display driver module to obtain the second image data. Among them, the specific method of the conversion process can be flexibly configured according to the differences between the first image device and the second image device, and this application does not limit this. For example, the conversion process may include various types such as format conversion processing, display mode conversion processing, and data volume conversion processing.

[0056] In the embodiment of the present application, a virtual display screen can be created in the first image device through the display driver module, and the screen attribute parameters of the virtual display screen can be flexibly configured so as to adapt the virtual display screen to the second image device. In addition, the first image data acquired by the display driver module is converted and processed through the display processing module to obtain the second image data for display by the second image device. With the help of the conversion processing operation, the adaptation processing between the second image device and the first image device can be realized, so as to facilitate the flexible implementation of the screen projection function between different types of image devices.

[0057] In addition, those skilled in the art may also make various modifications and variations to the method disclosed herein:

[0058] In an optional implementation, considering that the display state of the virtual display screen may change dynamically due to reasons such as receiving user interaction instructions, in order to facilitate dynamic adaptation of the current state of the virtual display screen, the display driver module can dynamically monitor the screen display state of the virtual display screen so as to timely discover the changes in the screen display state. Accordingly, when the display processing module converts the first image data displayed in the virtual display screen acquired by the display driver module to obtain the second image data, it can be implemented in the following way: when the display driver module monitors that the screen display state of the virtual display screen has changed, the display processing module performs state conversion processing on the first image data so that the second image data obtained after the conversion processing matches the changed screen display state. It can be seen that under the premise that the display driver module continuously monitors the screen display state of the virtual display screen, the display processing module can dynamically determine the conversion mode of the conversion processing according to the detected state change type, thereby realizing the real-time adaptation of the second image data to the first image data. In addition, the display processing module further sends a conversion instruction to the USB chip in the second image device. The conversion instruction is used to instruct the USB chip to adjust the screen display state corresponding to the second image device so that the screen display state corresponding to the second image device matches the changed screen display state in the first image device.

[0059] Optionally, the screen display state may include: screen resolution, and / or screen display mode. For example, when it is detected that the screen resolution of the virtual display screen in the first image device is changed from the first resolution to the second resolution, a resolution conversion instruction may be sent to the USB chip in the second image device, so that the resolution of the image data displayed by the second image device is also converted from the first resolution to the second resolution.

[0060] In addition, the screen display mode may include at least one of the following: a single-screen display mode, a multi-screen display mode, an extended screen display mode, and a duplicate screen display mode. Accordingly, when it is detected that the screen display mode of the virtual display screen in the first image device is changed from the first display mode to the second display mode, a display mode conversion instruction may be sent to the USB chip in the second image device, so that the display mode of the image data displayed by the second image device is also converted from the first display mode to the second display mode. The first display mode may be any one of a single-screen display mode, a multi-screen display mode, an extended screen display mode, and a duplicate screen display mode, and the second display mode is different from the first display mode.

[0061] In addition, the display state of the virtual display screen can also flexibly include various information related to the display situation, and the present application does not limit the specific connotation of the display state. In short, by continuously monitoring the display state of the virtual display screen, the display processing module can send the corresponding conversion instruction in time, so that the second image device and the first image device can adapt to each other in real time.

[0062] In an optional implementation, in order to facilitate the control of the working state of the second image device, before creating a virtual display screen in the first image device and configuring the screen attribute parameters of the virtual display screen, the following operations may be further performed: obtaining the device attribute parameters corresponding to the second image device, and correspondingly, the screen attribute parameters of the virtual display screen may be configured according to the device attribute parameters; and sending a chip control instruction to the USB chip on which the second image device is based, so that the chip state of the USB chip is switched from the power-on state to the working state. Specifically, the USB chip will enter the power-on state in the initial stage, and cannot work normally in the power-on state. Therefore, it is necessary to switch to the working state according to the received chip control instruction, that is, the state in which it can work and display normally. It can be seen from this that the chip control instruction can also be called a state switching instruction, which is used to configure the current state of the USB chip. Of course, in the case where the working state of the USB chip is further divided into multiple sub-states, the chip control instruction can also be divided into multiple instructions for controlling the switching between sub-states. In this way, the state of the USB chip can be switched timely and accurately, so as to facilitate the screen projection process.

[0063] In an optional implementation, considering that the data formats supported by the first image device and the second image device may be different, in order to facilitate the format adaptation processing between the two, the display processing module can perform format conversion processing. Accordingly, when the first image data displayed in the virtual display screen acquired by the display driver module is converted to obtain the second image data, it can be implemented in the following way: according to the comparison result between the device attribute parameters corresponding to the second image device and the screen attribute parameters, the format conversion method is determined; according to the format conversion method, the first image data displayed in the virtual display screen acquired by the display driver module is format converted to obtain the second image data. It can be seen that this method can automatically determine the specific implementation method of the format conversion processing according to the difference between the second image device and the first image device, thereby automatically realizing format adaptation.

[0064] In an optional implementation, in order to improve the compatibility between devices and avoid abnormal situations caused by accidental factors, it is also possible to dynamically monitor whether the operation of the first image device is normal by monitoring the preset interface, and intervene in time when an abnormality is detected, thereby improving the robustness of the system. Accordingly, after creating a virtual display screen in the first image device, the following operations are further performed: monitor the interface status information of the preset interface in the first image device, and when it is determined that there is an abnormality in the preset interface in the first image device according to the interface status information, re-execute the step of creating a virtual display screen in the first image device. Among them, the preset interface can be various interfaces for realizing key functions in the screen projection process, and accordingly, the interface status information of the preset interface can be various types of information that can characterize the operation status of the preset interface, such as the operation record information corresponding to the preset interface. Specifically, the interface status information can be obtained by various methods such as setting a hook function or a callback function at the preset interface.

[0065] For example, in a specific example, the preset interface is a callback interface, which is used to call back the display driver module to realize the image data transmission between the first image device and the display driver module. In actual situations, after the display driver module creates a virtual display screen in the first image device, it is necessary to perform callback processing on the display driver module through the callback interface in the first image device, so as to realize the image data transmission between the first image device and the display driver module according to the callback result. Once the callback interface does not generate a callback or the callback is not successful due to various reasons, the created virtual display screen cannot be used normally. In the traditional way, since it is impossible to monitor the preset interface, it will lead to endless waiting or error exception reporting, etc., and the present application can effectively avoid display abnormalities by monitoring the preset interface and recreating the virtual display screen when an abnormality is detected. In specific implementation, monitoring functions can be configured in advance for various preset interfaces required by the virtual display screen during operation, so as to continuously monitor each processing node to improve the robustness of the system.

[0066] To facilitate understanding, an example is used below to introduce the implementation of the above embodiment. Figure 2 A schematic diagram of the structure of the screen projection processing system in this example is shown. Figure 2 As shown, the screen projection processing system includes: a Windows graphics subsystem located in the first image device, a USB chip corresponding to the second image device, and a screen projection processing device including an IDD framework and a USB processing module. The first image device can be an electronic device such as a mobile phone or a tablet, and the second image device can be various electronic devices such as a notebook, a display, and a projector. Usually, the device screen size of the second image device is larger than the device screen size of the first image device. Figure 2 The screen projection processing device in the figure is MSUsbDisplay, which is a USB screen projection chip. The USB screen projection chip communicates with the USB chip through USB transmission.

[0067] Among them, the IDD framework in the projection processing device is a specific implementation form of the display driver module mentioned above. The USB processing in the projection processing device is also called the USB processing module, which is a specific implementation form of the display processing module mentioned above. Figure 2 As shown, with the help of the IDD framework, the screen data from the Windows graphics subsystem can be transferred to the USB processing module. In addition, the IDD framework can also realize the creation and configuration functions of the virtual display screen, as well as the screen change management and other functions.

[0068] In this example, MSUsbDisplay can be a USB device screen projection driver based on the MS9132 series chip developed with the indirect display driver (IDD) technology as the infrastructure. This driver uses the IDD model of the Windows platform to create and manage the virtual display screen, obtain the virtual screen desktop data, and interact with the USB chip through the USB link. It can realize the transmission and display of screen content between one-to-one and one-to-many devices, support functions such as screen copying or expansion, and can provide users with low-latency, high-frame rate, smooth, stable and efficient screen projection solutions.

[0069] Among them, the inventors found in the process of implementing the solution in this example that in some related technologies, the USB screen projection function is usually implemented in the form of a combination of Windows applications and drivers. In this type of technology, the driver only provides a basic functional interface, and operations such as functional logic processing and obtaining virtual screen desktop data need to be implemented in the Windows application. In other words, the functional body is mainly a Windows application. However, the above implementation method has at least the following shortcomings: (1) The DXGI screen capture technology of the virtual screen desktop data of the application has scene restrictions, and there are defects such as HDCP video capture black screen and screen capture failure in the Windows system lock screen state: HDCP (High-bandwidth Digital Content Protection) is a technology for protecting the copyright of digital content. When HDCP is enabled, unauthorized devices or software may not be able to access video content, resulting in a black screen phenomenon. In addition, Windows will restrict access to screen content in the lock screen state to protect user privacy and security. Therefore, conventional applications may not be able to capture screen content in this case. (2) There are many files that need to be installed, and both the driver and the Windows application must be installed, which makes the installation operation cumbersome and time-consuming.

[0070] In order to solve the above problems, this example abandons the combination of Windows application and driver, and is implemented in the form of Windows driver, thereby avoiding the above shortcomings and occupying less CPU and memory.

[0071] It can be seen that the MSUsbDisplay in this example is based on the indirect display driver model, and implements the Windows USB screen projection function of creating and managing the virtual display screen, obtaining desktop image data, and sending image data via USB in the user-mode driver layer, making the screen projection effect more stable and smooth, with fewer restrictions and better applicability.

[0072] The basic principles of this example are as follows: The indirect display driver (IDD) model itself does not directly implement the transmission and display of screen projection content, but it provides an infrastructure for the implementation of the screen projection function. IDD is a third-party UMDF (User-Mode Driver Framework) driver for the device, which can be developed based on IddCx (Indirect Display Driver Class eXtension). Through IddCx (Indirect Display Driver Class Extension), it interacts with the Windows graphics subsystem to implement the creation, management and data capture of the virtual display screen.

[0073] In addition, since IDD is a UMDF driver, the driver can also implement all UMDF functions, for example, USB device plug-in detection, transmission control interaction functions, etc. can all be implemented in the IDD framework. In other words, this example can dynamically detect USB plug-in operations, and can also perform various functions such as transmission control interaction.

[0074] In summary, this example uses the Indirect Display Driver (IDD) model as the infrastructure to implement USB screen projection, which reduces the processing flow of desktop data, reduces latency and power consumption. This method can at least solve the following technical problems and achieve the following beneficial effects accordingly: (1) Solve the screen capture scene limitation problem of DXGI screen capture technology at the Windows application layer. (2) Reduce the screen data processing process, make the latency lower, and make the screen projection effect smoother.

[0075] Figure 3 A schematic diagram of the process of the screen projection processing method of the image data provided by this example is shown as follows: Figure 3 As shown, the method comprises the following steps:

[0076] Step S301: creating a virtual display screen in a first image device through an IDD framework, and configuring screen attribute parameters of the virtual display screen.

[0077] Step S302: monitor the interface status information of the preset interface in the first imaging device, and determine whether there is an abnormality in the preset interface in the first imaging device according to the interface status information.

[0078] If the judgment result is yes, step S301 is re-executed, and if the judgment result is no, the subsequent step S303 is continued to be executed. Specifically, the preset interface is usually the callback interface mentioned above.

[0079] Step S303: Send a chip control instruction to the USB chip on which the second image device is based, so as to switch the chip state of the USB chip from the power-on state to the working state.

[0080] Step S304: The first image data acquired by the IDD framework is converted by the UBS processing module to obtain second image data.

[0081] The conversion process includes various types such as format conversion and state conversion mentioned above. For example, when the display state of the virtual display screen is detected to have changed, the state conversion process is performed on the first image data so that the second image data obtained after the conversion process matches the changed display state of the screen.

[0082] Step S305: Send the second image data to the second image device through the display processing module.

[0083] It can be seen that this example is implemented in two parts: the IDD framework and the USB processing module. The IDD framework is the functional main body, which can interact with the Windows graphics subsystem through the IddCx class extension, and realize the creation, management and virtual display screen data capture functions. The USB processing part can interact with the MS9132 series USB chip devices for transmission, and realizes the processing and transmission of virtual screen data, control interaction of USB devices and other functions. In the IDD framework part, after the virtual display screen is created, it interacts with the Windows graphics subsystem to manage the virtual screen, and obtains and passes the virtual screen data to the USB processing module. Correspondingly, in the USB processing part, the USB control transmission is first used to interact with the USB device to configure the transmission mode, and then the screen data is transferred to the USB device in batches through USB for conversion and display.

[0084] The step division of the above methods is only for the purpose of clear description. When implemented, they can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent; adding insignificant modifications to the algorithm or process or introducing insignificant designs without changing the core design of the algorithm and process are all within the scope of protection of this patent.

[0085] In a second aspect, an embodiment of the present disclosure provides a screen projection processing device for image data. Figure 4 A block diagram of a screen projection processing device for image data provided by an embodiment of the present disclosure, referring to Figure 4 , the device comprises:

[0086] A display driver module 41 is used to create a virtual display screen in the first image device and configure screen attribute parameters of the virtual display screen so that the virtual display screen can realize an image display function according to the screen attribute parameters;

[0087] The display processing module 42 is used to convert the first image data displayed in the virtual display screen acquired by the display driving module to obtain second image data, and transmit the second image data to the second image device so that the second image device can project and display the second image data;

[0088] The virtual display screen in the first image device is created based on the Windows graphics subsystem, and the second image device receives the second image data based on a USB chip; and the display driver module is implemented by an indirect display driver and an indirect display driver class extension program.

[0089] In an optional implementation, the display processing module is specifically used to:

[0090] When the display driver module detects that the screen display state of the virtual display screen has changed, performing state conversion processing on the first image data so that the second image data obtained after the conversion processing matches the changed screen display state;

[0091] Furthermore, a conversion instruction is sent to the USB chip in the second image device to instruct the USB chip to adjust the screen display state corresponding to the second image device so that the screen display state corresponding to the second image device matches the changed screen display state in the first image device.

[0092] In an optional implementation, the screen display state includes: screen resolution, and / or screen display mode;

[0093] The screen display mode includes at least one of the following: a single-screen display mode, a multi-screen display mode, an extended-screen display mode, and a duplicate-screen display mode.

[0094] In an optional implementation, the display driver module is further used for:

[0095] Acquiring device attribute parameters corresponding to the second image device, and configuring screen attribute parameters of the virtual display screen according to the device attribute parameters; and

[0096] A chip control instruction is sent to the USB chip on which the second imaging device is based, so that the chip state of the USB chip is switched from a power-on state to a working state.

[0097] In an optional implementation, the display processing module is specifically used to:

[0098] determining a format conversion method according to a comparison result between a device attribute parameter corresponding to the second image device and the screen attribute parameter;

[0099] According to the format conversion method, the first image data displayed in the virtual display screen acquired by the display driving module is format converted to obtain second image data.

[0100] In an optional implementation, the display driver module is further used for:

[0101] monitoring interface status information of a preset interface in the first image device, and re-performing the step of creating a virtual display screen in the first image device when it is determined according to the interface status information that an abnormality exists in the preset interface in the first image device;

[0102] The preset interface includes: a callback interface, and the callback interface is used to call back the display driver module to realize image data transmission between the first image device and the display driver module.

[0103] The functions or modules included in the device provided in the embodiments of the present disclosure can be used to execute the method described in the first aspect of the method embodiment above. Its specific implementation and technical effects can be referred to the description of the method embodiment above. For the sake of brevity, they will not be repeated here.

[0104] It should be noted that all modules involved in this embodiment are logic modules. In practical applications, a logic unit may be a physical unit, or a part of a physical unit, or may be implemented as a combination of multiple physical units. In addition, in order to highlight the innovative part of the present disclosure, this embodiment does not introduce units that are not closely related to solving the technical problems proposed by the present disclosure, but this does not mean that there are no other units in this embodiment.

[0105] Reference Figure 5 , an embodiment of the present disclosure provides an electronic device, comprising:

[0106] One or more processors 601;

[0107] A memory 602, on which one or more programs are stored, and when the one or more programs are executed by one or more processors, the one or more processors implement any one of the above-mentioned methods for processing screen projection of image data;

[0108] One or more I / O interfaces 603 are connected between the processor and the memory and are configured to implement information exchange between the processor and the memory.

[0109] Among them, the processor 601 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 602 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory (FLASH); the I / O interface (read-write interface) 603 is connected between the processor 601 and the memory 602, and can realize information interaction between the processor 601 and the memory 602, including but not limited to a data bus (Bus), etc.

[0110] In some embodiments, the processor 601 , the memory 602 , and the I / O interface 603 are connected to each other through a bus, and further connected to other components of the computing device.

[0111] This embodiment also provides a computer-readable medium on which a computer program is stored. When the program is executed by a processor, the screen projection processing method of the image data provided by this embodiment is implemented. To avoid repeated description, the specific steps of the screen projection processing method of the image data are not repeated here.

[0112] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the invented method described above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some physical components or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0113] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0114] Those skilled in the art will understand that although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features from different embodiments is meant to be within the scope of the present embodiment and to form different embodiments.

[0115] It is to be understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of the present disclosure, but the present disclosure is not limited thereto. For those of ordinary skill in the art, various modifications and improvements can be made without departing from the spirit and substance of the present disclosure, and these modifications and improvements are also considered to be within the scope of protection of the present disclosure.

Claims

1. A method for processing screen projection of image data, characterized in that: The method comprises: Creating a virtual display screen in the first image device through a display driver module, and configuring screen attribute parameters of the virtual display screen so that the virtual display screen implements an image display function according to the screen attribute parameters; The display processing module converts the first image data displayed in the virtual display screen acquired by the display driving module to obtain second image data, and transmits the second image data to the second image device so that the second image device can project and display the second image data; The virtual display screen in the first image device is created based on the Windows graphics subsystem, and the second image device receives the second image data based on a USB chip; and the display driver module is implemented by an indirect display driver and an indirect display driver class extension program.

2. The method according to claim 1, characterized in that The step of converting the first image data displayed on the virtual display screen acquired by the display driving module through the display processing module to obtain the second image data comprises: When the display driver module detects that the screen display state of the virtual display screen has changed, the display processing module performs state conversion processing on the first image data so that the second image data obtained after the conversion processing matches the changed screen display state; Furthermore, a conversion instruction is sent to the USB chip in the second image device to instruct the USB chip to adjust the screen display state corresponding to the second image device so that the screen display state corresponding to the second image device matches the changed screen display state in the first image device.

3. The method according to claim 2, characterized in that The screen display status includes: screen resolution, and / or screen display mode; The screen display mode includes at least one of the following: a single-screen display mode, a multi-screen display mode, an extended-screen display mode, and a duplicate-screen display mode.

4. The method according to claim 1, characterized in that Before creating a virtual display screen in the first image device and configuring screen attribute parameters of the virtual display screen, the method further includes: Acquiring device attribute parameters corresponding to the second image device, and configuring screen attribute parameters of the virtual display screen according to the device attribute parameters; and A chip control instruction is sent to the USB chip on which the second image device is based, so that the chip state of the USB chip is switched from a power-on state to a working state.

5. The method according to claim 4, characterized in that The converting and processing the first image data displayed in the virtual display screen acquired by the display driving module to obtain the second image data comprises: determining a format conversion method according to a comparison result between a device attribute parameter corresponding to the second image device and the screen attribute parameter; According to the format conversion method, the first image data displayed in the virtual display screen acquired by the display driving module is format converted to obtain second image data.

6. The method according to any one of claims 1 to 5, characterized in that: After creating the virtual display screen in the first image device, the method further includes: monitoring interface status information of a preset interface in the first image device, and re-performing the step of creating a virtual display screen in the first image device when it is determined according to the interface status information that an abnormality exists in the preset interface in the first image device; The preset interface includes: a callback interface, and the callback interface is used to call back the display driver module to realize image data transmission between the first image device and the display driver module.

7. A screen projection processing device for image data, characterized in that: The device comprises: A display driver module, used for creating a virtual display screen in the first image device, and configuring screen attribute parameters of the virtual display screen, so that the virtual display screen realizes an image display function according to the screen attribute parameters; A display processing module, configured to convert the first image data displayed in the virtual display screen acquired by the display driving module to obtain second image data, and transmit the second image data to a second image device so that the second image device can project and display the second image data; The virtual display screen in the first image device is created based on the Windows graphics subsystem, and the second image device receives the second image data based on a USB chip; and the display driver module is implemented by an indirect display driver and an indirect display driver class extension program.

8. An electronic device, characterized in that: include: one or more processors; A storage device having one or more programs stored thereon, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the screen projection processing method for image data according to any one of claims 1 to 6; One or more I / O interfaces are connected between the processor and the memory and are configured to implement information interaction between the processor and the memory.

9. A computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method for processing screen projection of image data according to any one of claims 1 to 6 is implemented.

10. A computer program product, characterized in that It includes a computer-readable code, or a non-volatile computer-readable storage medium carrying a computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the screen projection processing method of image data as described in any one of claims 1-6.

Images