Information display method and device, computer readable storage medium and electronic equipment

Abstract

The invention relates to an information display method and device, a computer readable storage medium and electronic equipment, and relates to the technical field of naked eye 3D display, and the method comprises the steps: creating a virtual display and a global container corresponding to terminal equipment; performing image splitting processing on a to-be-displayed resource based on the naked eye 3D film pasting parameters of the virtual display to obtain left and right eye views with a naked eye 3D effect; performing image interleaving processing on the left-eye view and the right-eye view to obtain a current vector texture corresponding to the to-be-displayed resource; and pushing the current vector texture to a global container, and outputting the current vector texture to the virtual display based on the global container so as to render the current vector texture through the virtual display. According to the invention, the adaptability between the current vector texture and the virtual display is improved.

Description

Information display method and device, computer-readable storage medium, and electronic device Technical Field

[0001] The embodiments of the present disclosure relate to the field of naked-eye 3D display technology, and more particularly, to an information display method, an information display device, a computer-readable storage medium, and an electronic device. Background Art

[0002] In existing information display methods, resources to be displayed can be processed using hard interleaving to obtain and display resources with a naked-eye 3D display effect. Furthermore, in the specific implementation of hard interleaving, hardware devices are first installed and used to intercept video resource signals. The hardware devices then process the intercepted video resource signals to obtain resources with a naked-eye 3D display effect.

[0003] However, the above solution has the following disadvantages: since the processing of the video resource signal is completely dependent on the hardware device, the video resource signal cannot be processed directly based on the parameters of the display device, thereby reducing the adaptability between the naked eye 3D resource and the display device.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to ordinary technicians in this field.

[0005] Summary of the Invention

[0006] The purpose of the present disclosure is to provide an information display method, an information display device, a computer-readable storage medium, and an electronic device, thereby overcoming, at least to a certain extent, the problem of low compatibility between naked-eye 3D resources and display devices due to the limitations and defects of related technologies.

[0007] According to one aspect of the present disclosure, there is provided an information display method, configured in a terminal device, the information display method comprising:

[0008] Creating a virtual display and a global container corresponding to the terminal device;

[0009] Performing image splitting processing on the display resource based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with naked-eye 3D effects;

[0010] Performing image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed;

[0011] The current vector texture is pushed to a global container, and the current vector texture is output to the virtual display based on the global container, so as to render the current vector texture through the virtual display.

[0012] In an exemplary embodiment of the present disclosure, creating a virtual display corresponding to the terminal device includes:

[0013] Loading a graphics driver model in the terminal device;

[0014] The video rendering network function in the graphics driver model is called, and the virtual display is created through the video program network function.

[0015] In an exemplary embodiment of the present disclosure, the information display method further includes:

[0016] Obtaining extended display identification data of the main display of the terminal device;

[0017] Determining, based on the extended display identification data, an original screen resolution and an original screen refresh rate of the main display and an original number of viewpoints that the main display can support;

[0018] The naked-eye 3D film parameters of the virtual display are generated according to the original screen resolution, the original screen refresh rate and the original number of viewpoints.

[0019] In an exemplary embodiment of the present disclosure, creating a global container corresponding to the display terminal includes:

[0020] Based on the multimedia programming interface in the terminal device, the integrated graphics card in the terminal device is called, and a global container corresponding to the display terminal is created through the integrated graphics card; wherein the global container is a modal container, and the background of the global container is a transparent background.

[0021] In an exemplary embodiment of the present disclosure, image splitting processing is performed on a resource to be displayed based on naked-eye 3D film parameters of the virtual display to obtain left and right eye views with naked-eye 3D effects, including:

[0022] Intercepting resources to be displayed based on a graphics driver model, and establishing a path between the graphics driver model and an integrated graphics card based on a multimedia programming interface in the terminal device;

[0023] Based on the path between the graphics driver model and the integrated graphics card, the resources to be displayed are transmitted to the integrated graphics card, and based on the multimedia programming interface, the resources to be displayed in the integrated graphics card are cached in a memory processor;

[0024] In the memory processor, image splitting processing is performed on the display resource based on the naked-eye 3D film parameters of the virtual display to obtain left and right eye views with naked-eye 3D effects.

[0025] In an exemplary embodiment of the present disclosure, image splitting processing is performed on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left and right eye views with naked-eye 3D effects, including:

[0026] Determining a target number of viewpoints that the virtual display can support based on naked-eye 3D film parameters of the virtual display;

[0027] Image splitting processing is performed on the resource to be displayed based on the target number of viewpoints to obtain left and right eye views with naked eye 3D effect.

[0028] In an exemplary embodiment of the present disclosure, performing image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed includes:

[0029] Calling a vertex shader and a fragment shader in a memory processor, and calculating an interpolation range of the left and right eye views based on the vertex shader;

[0030] Calculating interpolated content of the left and right eye views based on the fragment shader;

[0031] Image interleaving processing is performed on the left and right eye views according to the interpolation range and the interpolation content to obtain a current vector texture corresponding to the resource to be displayed.

[0032] In an exemplary embodiment of the present disclosure, calculating the interpolation range of the left and right eye views based on the vertex shader includes:

[0033] Determining an image display range of the left-eye and right-eye views on the virtual display, and determining a vertex position of each pixel vertex in the left-eye and right-eye views on the virtual display based on the image display range;

[0034] The vertex shader determines the interpolation range of the naked eye 3D resource according to the vertex position of each pixel vertex on the virtual display.

[0035] In an exemplary embodiment of the present disclosure, calculating the interpolated content of the left and right eye views based on the fragment shader includes:

[0036] Obtaining a color value arrangement rule of the virtual display; wherein the color value arrangement rule includes pixel spacing, screen line number, and maximum offset;

[0037] Determining, by the fragment shader, a viewpoint interleaving rule of the virtual display according to a target number of viewpoints that the virtual display can support;

[0038] The interpolation contents of the left and right eye views are calculated according to the viewpoint interleaving rule and the color value arrangement rule.

[0039] In an exemplary embodiment of the present disclosure, determining the viewpoint interleaving rule of the virtual display according to the target number of viewpoints that the virtual display can support through the fragment shader includes:

[0040] Determining the original pixel matrix of the naked eye 3D resource;

[0041] According to the target number of viewpoints supported by the virtual display, performing an orthogonal change of the human eye projection corresponding to the target number of viewpoints in the fragment shader to obtain a shader pixel matrix;

[0042] A viewpoint interleaving rule of the virtual display is determined according to the shader pixel matrix and the original pixel matrix.

[0043] In an exemplary embodiment of the present disclosure, determining a viewpoint interleaving rule of the virtual display according to the shader pixel matrix and the original pixel matrix includes:

[0044] A product operation result between the shader pixel matrix and the original pixel matrix is ​​calculated, and a viewpoint interleaving rule of the virtual display is determined according to the product operation result.

[0045] In an exemplary embodiment of the present disclosure, pushing the current vector texture to a global container, and outputting the current vector texture to the virtual display based on the global container, includes:

[0046] Pushing the current vector texture to a global container, and based on a multimedia programming interface, pushing the current vector texture in the global container to an independent graphics card in the terminal device;

[0047] The historical vector texture in the independent graphics card is replaced based on the current vector texture, and the current vector texture in the independent graphics card is transmitted to the virtual display based on the video signal transmission interface in the terminal device.

[0048] In an exemplary embodiment of the present disclosure, the naked eye 3D resource includes at least one of a game scene, a video, and an image;

[0049] The information display method further includes:

[0050] Interacting with the game scene displayed on the virtual display based on the gaze point of the human eye; and / or

[0051] The game scene and / or video and / or image displayed in the virtual display are interacted with based on external input events.

[0052] In an exemplary embodiment of the present disclosure, interacting with a game scene displayed on the virtual display based on a human eye gaze point includes:

[0053] Obtaining a current gaze point position of a human eye in the virtual display, and obtaining a center point position of the virtual display;

[0054] Calculating the angle between the current gaze point position and the center point position, and controlling the virtual lens in the game scene to rotate from the current position to the target lens position corresponding to the angle;

[0055] The scene image captured by the virtual lens at the target lens position is displayed.

[0056] In an exemplary embodiment of the present disclosure, interacting with a game scene and / or video and / or image displayed on the virtual display based on an external input event includes:

[0057] Capturing external input events acting on the game scene and / or video and / or image through the virtual display based on the global container;

[0058] The external input event is transparently transmitted to the event processing layer based on the global container, and the external input event is processed based on the event processing layer to achieve interaction with the game scene and / or video and / or image.

[0059] According to one aspect of the present disclosure, there is provided an information display device, configured in a terminal device, the information display device comprising:

[0060] A virtual display creation module, configured to create a virtual display and a global container corresponding to the terminal device;

[0061] An image splitting processing module is used to perform image splitting processing on the display resource based on the naked-eye 3D film parameters of the virtual display to obtain left and right eye views with naked-eye 3D effects;

[0062] An image interleaving processing module, configured to perform image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed;

[0063] The vector texture rendering module is used to push the current vector texture to a global container, and output the current vector texture to the virtual display based on the global container, so as to render the current vector texture through the virtual display.

[0064] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the computer program implements any one of the above-mentioned information display methods.

[0065] According to one aspect of the present disclosure, there is provided an electronic device, including:

[0066] processor; and

[0067] a memory for storing executable instructions of the processor;

[0068] The processor is configured to execute any one of the above-mentioned information display methods by executing the executable instructions.

[0069] An information display method provided by an embodiment of the present disclosure, on the one hand, creates a virtual display and a global container corresponding to a terminal device; then performs image splitting processing on a to-be-displayed resource based on naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with a naked-eye 3D effect; then performs image interleaving processing on the left-eye and right-eye views to obtain a current vector texture corresponding to the to-be-displayed resource; finally, pushes the current vector texture to a global container, and outputs the current vector texture to the virtual display based on the global container, so as to render the current vector texture through the virtual display, thereby realizing soft interleaving of the to-be-displayed resource, and directly processing the to-be-displayed resource based on the naked-eye 3D film parameters to obtain the current vector texture, thereby improving the adaptability between the current vector texture and the virtual display; on the other hand, since the to-be-displayed resource can be image splitting processed based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with a naked-eye 3D effect; then performs image interleaving processing on the left-eye and right-eye views to obtain the current vector texture corresponding to the to-be-displayed resource, thereby improving the accuracy of the current vector texture, and further improving the accuracy of the rendering result of the current vector texture.

[0070] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0072] FIG1 schematically shows a flow chart of an information display method according to an exemplary embodiment of the present disclosure.

[0073] FIG2 schematically shows an example diagram of an architecture of a display driver model according to an example embodiment of the present disclosure.

[0074] FIG3 schematically shows an example diagram of the system architecture of a terminal device according to an example embodiment of the present disclosure.

[0075] FIG4 schematically shows an example diagram of a scene of a two-viewpoint left-eye and right-eye view according to an exemplary embodiment of the present disclosure.

[0076] FIG5 schematically shows an example diagram of a scene of left-eye and right-eye views with nine viewpoints according to an exemplary embodiment of the present disclosure.

[0077] FIG6 schematically shows an example diagram of a scene of left-eye and right-eye views with 16 viewpoints according to an exemplary embodiment of the present disclosure.

[0078] FIG7 schematically shows an example diagram of a scene obtained by performing an image zoom-out interactive operation according to an example embodiment of the present disclosure.

[0079] FIG8 schematically illustrates an example scene diagram obtained by performing an image zoom interaction operation according to an example embodiment of the present disclosure.

[0080] FIG9 schematically shows a block diagram of an information display device according to an exemplary embodiment of the present disclosure.

[0081] FIG10 schematically shows an electronic device for implementing the above-mentioned information display method according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0082] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0083] In addition, the accompanying drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. Identical reference numerals in the figures denote identical or similar parts, and thus repetitive descriptions thereof will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities that do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0084] This example embodiment first provides an information display method, which can be run on a terminal device, and of course can also be run on a server, server cluster, or cloud server, etc. Of course, those skilled in the art can also run the method disclosed herein on other platforms as needed, and this exemplary embodiment does not specifically limit this. At the same time, the terminal devices described herein can include display terminals (such as all-in-one conference machines, smart city display screens), and can also include personal computers, tablet computers, and desktop computers, etc., and this example does not specifically limit this.

[0085] In an exemplary embodiment, referring to FIG1 , the information display method may include the following steps:

[0086] Step S110. Create a virtual display and a global container corresponding to the terminal device;

[0087] Step S120: performing image splitting processing on the display resource based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with naked-eye 3D effects;

[0088] Step S130: performing image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed;

[0089] Step S140: Push the current vector texture to a global container, and output the current vector texture to the virtual display based on the global container, so as to render the current vector texture through the virtual display.

[0090] In the above-mentioned information display method, on the one hand, a virtual display and a global container corresponding to the terminal device are created; then, based on the naked-eye 3D film parameters of the virtual display, image splitting processing is performed on the display resource to obtain left and right eye views with naked-eye 3D effect; then, image interleaving processing is performed on the left and right eye views to obtain the current vector texture corresponding to the resource to be displayed; finally, the current vector texture is pushed to the global container, and based on the global container, the current vector texture is output to the virtual display, so that the current vector texture is rendered through the virtual display, thereby realizing soft interleaving of the display resource, and the display resource can be directly processed based on the naked-eye 3D film parameters to obtain the current vector texture, thereby improving the adaptability between the current vector texture and the virtual display; on the other hand, since the display resource can be split according to the naked-eye 3D film parameters of the virtual display, the left and right eye views with naked-eye 3D effect are obtained; then, image interleaving processing is performed on the left and right eye views to obtain the current vector texture corresponding to the resource to be displayed, thereby improving the accuracy of the current vector texture, and further improving the accuracy of the rendering result of the current vector texture.

[0091] Hereinafter, the information display method described in the exemplary embodiments of the present disclosure will be further explained and illustrated with reference to the accompanying drawings.

[0092] First, the terms involved in the exemplary embodiments of the present disclosure are explained.

[0093] Global processing: refers to the processing of display images at the Windows system level of the terminal device. It is not targeted at any application or display content running on the system, but refers to all display images included in the terminal device; for example, the images displayed by the display system, and the interactions and responses brought by peripherals such as Mouse / KeyBoard / TouchBar. Among them, the interactions and responses brought by peripherals can include pausing the player with the space bar, fast forward and rewinding with the left and right keys, and other operations.

[0094] SoftWare Interweave: refers to the process of using drivers or applications to complete the corresponding image interweaving processing at the Windows system level of the terminal device, and then obtain the corresponding pixel arrangement and rendering display.

[0095] WDDM: The Windows Display Driver Model (WDDM) is a display driver model. In actual use, the DDM display driver model architecture consists of user mode and kernel mode components, as shown in Figure 2. The display driver model architecture shown in Figure 2 includes an application layer (Application) 210, user mode (User Mode) 220, and kernel mode (Kernel Mode) 230. In user mode, graphics hardware vendors must provide a user-mode display driver (User-mode display driver) 221; in kernel mode, graphics hardware vendors must provide a display miniport driver (Display miniport driver) 231. The display miniport driver described herein may also be referred to as a kernel-mode display driver (KMD). Furthermore, the user-mode display driver is a dynamic link library (DLL) loaded by the Direct3D runtime. The display miniport driver communicates with the DirectX graphics kernel subsystem.

[0096] It should be noted that the WDDM involved in this application is a nimiport driver that complies with the WDM (Windows Driver Model) specification. It has power management functions and can be loaded through plug-and-play (PnP). In actual application, the specific application functions of WDDM can be classified into three categories: one is the callback function of ordinary WDM drivers, such as DxgkDdiAddDevice, DxgkDdiStartDevice, etc., which correspond to the WDM AddDevice function and IRP_MN_START_DEVICE request; the other is the DDI (Direct Data Ingestion) function, which is an image-related function and can be used to allocate image resources and draw mouse shapes; and the other is the VIDPN (Video Present Networks) function, which is used to manage VIDPN. In actual application, if an additional display terminal (virtual display) needs to be simulated, it can be achieved by modifying the VIDPN related functions.

[0097] DirectX: (Direct eXtension, abbreviated as DX) is a multimedia programming interface created by Microsoft. It is an application program interface (API). DirectX can make games or multimedia programs based on the Windows platform perform more efficiently, enhance 3D graphics and sound effects, and provide designers with a common hardware driver standard, so that game developers do not have to write different drivers for each brand of hardware, and also reduce the complexity of users installing and setting up hardware. Microsoft DirectX is designed to make Windows-based computers an ideal platform for running and displaying applications with rich multimedia elements (such as full-color graphics, video, 3D animation, and rich audio). DirectX includes security and performance updates, as well as many new features covering all technologies; applications can access these new features by using the DirectX API.

[0098] Virtual Display: Also known as Desktop Virtualization or Virtual Desktop Infrastructure, Virtual Display is a server-based computing model. While it leverages the traditional thin client model, it allows administrators and users to leverage the advantages of both approaches: hosting and centrally managing all desktop virtual machines in the data center; and providing users with a complete PC experience, supporting enterprise-level technologies for remote dynamic access to desktop systems and centralized data center hosting.

[0099] Next, the technical implementation principles of the exemplary embodiments of the present disclosure are explained and illustrated. Specifically, the information display method described in the exemplary embodiments of the present disclosure provides a solution for developing a graphics card filter driver using the Windows driver layer and performing global soft interleaving using DirectX technology on the Windows platform, thereby achieving a global soft interleaving display format and completing the display of naked-eye 3D related content. Furthermore, in the information display method described in the present application, the reason why the main display needs to be switched through a virtual display is because there is a DPI (Dots Per Inch) attribute in the Windows system; the role of this attribute in image display is: at a customized resolution, the corresponding system UI (User Interface) is reduced or expanded as a whole. If the resolution or DPI of the original display is used, the actual resolution in the full-screen state will not be able to reach the target resolution of 4K or above, resulting in a false 4K display; at the same time, if the DPI of the target display device or the system DPI is forcibly modified at the original resolution through the Windows API, the icons of the client user will be confused, thereby reducing the user experience; therefore, a virtual display is needed; at the same time, in actual application, the virtual display can be assigned default attributes through the attributes of the target display device. For example, the default here is 3840*2160 and the DPI is 100%.

[0100] Furthermore, when a virtual display is created using WDDM, the system assigns it a default GUID_Class (Globally Unique Identifier Class). This value is unique within the system, ensuring that the user's interface habits and system layout are preserved, regardless of how many times the virtual display is turned off or on. For example, the size and arrangement of icons on the display interface are preserved. Additionally, using WinAPI to force DPI settings on an existing display can cause screen flickering. This can be avoided by first setting the virtual display's parameters and then switching to the primary display.

[0101] Furthermore, the overall system architecture of the terminal device described in the exemplary embodiment of the present disclosure is explained and illustrated. Specifically, referring to FIG3 , the overall system architecture may include a hardware layer 310, a user layer 320, a driver layer 330, and an operating environment layer 340. Among them:

[0102] The hardware layer may include displays corresponding to the terminal device, external devices (such as mouse, keyboard, etc.) and other hosts adapted to naked-eye 3D;

[0103] The user layer may include a user layer startup module and a user interaction module; at the same time, the user interaction module may include multimedia file browsing interaction and independent application startup interaction, etc.;

[0104] The driver layer may include a video memory management module, a video memory replacement module, a frame processing module, a pixel processing module, and a system log module, etc.;

[0105] The operating environment layer may include the Windows system operating environment and the like.

[0106] In an exemplary embodiment, the resources to be displayed described in the exemplary embodiment of the present disclosure are primarily derived from UMDF (User-Mode Driver Framework) layer drivers, i.e., changes in the GPU (Graphics Processing Unit), commonly known as display changes, triggered by user-layer drivers. For example, a user may initiate a third-party application or play a multimedia file. In actual application, user interaction may trigger corresponding changes in the GPU. However, regardless of the changes, the only output port for data is the GPU to the display. Therefore, the information display method described in the exemplary embodiment of the present disclosure can be implemented by copying addresses in the GPU to a secondary cache in the CPU. This has the advantage that no matter what modifications are made to the frame, the corresponding essential display content will not be affected. However, different resolutions and refresh rates can be displayed according to different virtual displays. The virtual display is extended by EDID (Extended Display Identification Data), so its refresh rate can be equivalent to that of the hardware device. Therefore, when the information display method described in the example embodiment of the present disclosure pushes data, the specific push process is: GPU→CPU→GPU; therefore, even if a secondary cache is implemented, the delay for the user is relatively imperceptible. Of course, the data flow itself will have a delay due to the addition of corresponding data processing, but this delay is completed before the GPU is converted to the virtual display, so it is imperceptible and acceptable to the client user (that is, the client corresponding to the application).

[0107] The information display method shown in FIG1 will be further explained and illustrated below in conjunction with FIG2 and FIG3. Specifically:

[0108] In step S110 , a virtual display and a global container corresponding to the terminal device are created.

[0109] In this example embodiment, first, a virtual display corresponding to the terminal device is created. Specifically, the specific process of creating the virtual display can be implemented as follows: first, a graphics driver model in the terminal device is loaded; second, a video rendering network function in the graphics driver model is called, and the virtual display is created through the video program network function. That is, in actual application, if a virtual display corresponding to the target display of the terminal device needs to be created, a graphics driver model needs to be installed. The installation of the graphics driver model can be implemented in a plug-and-play manner. For example, the graphics driver model can be installed on a chip. If the graphics driver model needs to be installed, the chip can be directly installed on the terminal device in a pluggable manner, and the graphics driver model can be loaded from the chip. After the graphics driver model is installed, the graphics driver model can be driven, and a virtual display corresponding to the target display can be created based on the graphics driver model.

[0110] In an exemplary embodiment, in the process of creating a virtual display, it is first necessary to determine whether the terminal device includes multiple target displays; if it includes multiple target displays, it is necessary to determine a main display from the multiple target displays and create a virtual display based on the main display; if it includes only one target display, the virtual display is created based on the target display; at the same time, after the virtual display is created, no matter how many target displays the terminal device has, it is necessary to use the virtual display as the main display.

[0111] In an exemplary embodiment, when creating a virtual display based on a graphics driver model, it is first necessary to call a video rendering network function in the graphics driver model, and then create a virtual display based on the video rendering network function; then, a device globally unique identifier class is assigned to the virtual display; wherein, the device globally unique identifier class is assigned by default by the Windows system and is used to uniquely identify the virtual display. It should be noted that the reason for assigning a globally unique identifier class (GUID_Class) is that no matter how many times the virtual display is turned on or off, the system layout of the user interface on the virtual display can be called based on the GUID_Class, thereby avoiding display confusion.

[0112] In an example embodiment, after the virtual display is successfully created, the naked-eye 3D film parameters can be configured for the virtual display; specifically, the specific configuration process of the naked-eye 3D film parameters can be achieved in the following manner: first, the extended display identification data of the main display of the terminal device is obtained; secondly, based on the extended display identification data, the original screen resolution, original screen refresh rate and original number of viewpoints that the main display can support are determined; then, according to the original screen resolution, original screen refresh rate and original number of viewpoints, the naked-eye 3D film parameters of the virtual display are generated. Specifically, since EDID contains the vendor information, maximum image size, color settings, manufacturer presets, frequency range restrictions, and character strings of the display name and serial number of the main display, the original screen resolution, original screen refresh rate, and original number of viewpoints of the main display can be determined based on the extended display identification data, and then the naked-eye 3D film parameters of the virtual display can be determined based on the original screen resolution, original screen refresh rate, and original number of viewpoints; among them, the target screen resolution, target screen refresh rate, and target number of viewpoints in the naked-eye 3D film parameters can be consistent with the original screen resolution, original screen refresh rate, and original number of viewpoints.

[0113] Secondly, a global container corresponding to the display terminal is created. Specifically, this can be achieved by calling the integrated graphics card in the terminal device based on the multimedia programming interface in the terminal device, and creating a global container corresponding to the display terminal through the integrated graphics card; wherein the global container is a modal container, and the background of the global container is a transparent background. That is, in actual application, in order not to occupy the resources of the independent graphics card of the terminal device, the global container can be established through the integrated graphics card; at the same time, the reason for establishing a global container is to achieve soft interleaving of all resources to be displayed in the terminal device; of course, based on this global container, mouse events, keyboard events, or touch events can also be transparently transmitted, thereby achieving event-based interaction with the displayed resources; for example, based on mouse events, keyboard events, or touch events, the resources displayed by the player can be paused, fast-forwarded, zoomed in, etc.; for example, based on mouse events, keyboard events, or touch events, the game scene displayed on the virtual display can be switched, or virtual objects can be controlled, etc.

[0114] In step S120 , image splitting processing is performed on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with naked-eye 3D effects.

[0115] Specifically, image splitting processing is performed on the resources to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with naked-eye 3D effects. This can be achieved in the following manner: intercepting the resources to be displayed based on the graphics driver model, and establishing a path between the graphics driver model and the integrated graphics card based on the multimedia programming interface in the terminal device; transmitting the resources to be displayed to the integrated graphics card based on the path between the graphics driver model and the integrated graphics card, and caching the resources to be displayed in the integrated graphics card to a memory processor based on the multimedia programming interface; in the memory processor, image splitting processing is performed on the resources to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with naked-eye 3D effects. That is, in the actual application process, in order to achieve global soft interleaving of resources to be displayed, the resources to be displayed can be intercepted through the graphics driver model, and the interception is done before the image processing of the resources to be displayed is performed, thereby avoiding the problem of hardware resource waste caused by the need to intercept resources through hardware; at the same time, after the graphics driver model intercepts the resources to be displayed, the resources to be displayed can be transferred to the integrated graphics card based on the multimedia programming interface DirectX, and then based on the multimedia programming interface DirectX, the resources to be displayed are transferred from the integrated graphics card to the memory processor, and image splitting processing and image interleaving processing are performed based on the memory processor to obtain the current vector texture. At the same time, the resources to be displayed recorded here can be video resources to be displayed or image resources to be displayed loaded by the target application, or can be game scenes to be displayed recorded by the target application; or can be directly selected video resources to be displayed or image resources to be displayed, and this example does not impose any special restrictions on this.

[0116] In an exemplary embodiment, performing image splitting processing on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with a naked-eye 3D effect can be achieved as follows: first, determining a target number of viewpoints that the virtual display can support based on the naked-eye 3D film parameters of the virtual display; second, performing image splitting processing on the resource to be displayed based on the target number of viewpoints to obtain left-eye and right-eye views with a naked-eye 3D effect. That is, in actual application, the resource to be displayed can be split into left-eye and right-eye views based on the target number of viewpoints, wherein the left-eye and right-eye views can also be referred to as SideBySide images; wherein the target number of viewpoints recorded herein can include 2 viewpoints, 9 viewpoints, 16 viewpoints, 49 viewpoints, etc.; the obtained left-eye and right-eye views can include 2-viewpoint images, 9-viewpoint images, 16-viewpoint images, or 49-viewpoint images, etc.; wherein the 2-viewpoint image can refer to FIG. 4 , the 9-viewpoint image can refer to FIG. 5 , and the 16-viewpoint image can refer to FIG. 6 . It should be noted here that the reason for splitting the resources to be displayed into left and right eye views is to determine the number of multi-viewpoint images based on the target number of viewpoints that the virtual display can support; at the same time, the reason for image interleaving is to achieve the naked-eye 3D effect on the virtual display.

[0117] In step S130 , image interleaving processing is performed on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed.

[0118] Specifically, performing image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed can be achieved in the following manner: calling a vertex shader and a fragment shader in a memory processor, and calculating an interpolation range of the left and right eye views based on the vertex shader; calculating an interpolation content of the left and right eye views based on the fragment shader; performing image interleaving processing on the left and right eye views according to the interpolation range and the interpolation content to obtain a current vector texture corresponding to the resource to be displayed.

[0119] In an exemplary embodiment, the interpolation range of the left and right eye views is calculated based on the vertex shader, which can be achieved as follows: determining the image display range of the left and right eye views on the virtual display, and determining the vertex position of each pixel vertex in the left and right eye views on the virtual display based on the image display range; determining the interpolation range of the naked eye 3D resource based on the vertex position of each pixel vertex on the virtual display through the vertex shader.

[0120] In an example embodiment, based on the fragment shader, calculating the interpolated content of the left and right eye views can be achieved in the following manner: obtaining the color value arrangement rule of the virtual display; wherein the color value arrangement rule includes pixel spacing, number of screen lines and maximum offset; through the fragment shader, determining the viewpoint interleaving rule of the virtual display according to the target number of viewpoints that the virtual display can support; and calculating the interpolated content of the left and right eye views according to the viewpoint interleaving rule and the color value arrangement rule.

[0121] In an exemplary embodiment, the viewpoint interleaving rule of the virtual display is determined by the fragment shader according to the target number of viewpoints that the virtual display can support, which can be achieved in the following manner: determining the original pixel matrix of the naked eye 3D resource; according to the target number of viewpoints that the virtual display can support, performing an orthogonal change of the human eye projection corresponding to the target number of viewpoints in the fragment shader to obtain a shader pixel matrix; and determining the viewpoint interleaving rule of the virtual display according to the shader pixel matrix and the original pixel matrix.

[0122] In an exemplary embodiment, determining the viewpoint interleaving rule of the virtual display based on the shader pixel matrix and the original pixel matrix can be achieved by calculating the product operation result between the shader pixel matrix and the original pixel matrix, and determining the viewpoint interleaving rule of the virtual display based on the product operation result.

[0123] The following will explain and illustrate the specific interleaving process of the left and right eye views. Specifically, since the left and right eye views themselves need to be different, that is, the left view and the right view both have their ranges and corresponding edge values, shaders are required before rendering the left and right eye views. The shaders described here can include vertex shaders and fragment shaders. Specifically:

[0124] Vertex shader, also known as Vertshader, can be used to determine the display range of the left and right eye views, such as interweaving into 1K, 2K or 4K; in actual application, the vertex shader can act on each pixel vertex in the naked eye 3D resource and generate the final position of each pixel vertex; at the same time, for each pixel vertex, the vertex shader will be executed once to determine the final position of the pixel vertex; further, once the final position of each pixel vertex is determined, the GPU can assemble the collection of these visible vertices into points, lines and triangles, thereby improving the speed of rendering scenes and models; and, since the size of the left and right eye views themselves is equivalent to half of the target view, it is necessary to determine the positions of the pixel vertices in the left and right eye views before the multi-view graph can be interwoven.

[0125] The fragment shader, also known as PixShader, can be used to determine the interpolation content during the interleaving process. Specifically, since interleaving is equivalent to regional insertion of RGB / RGBA values ​​according to a certain rule, the role of this shader is to insert the corresponding interleaved pixel values ​​into the corresponding position of the main display to cooperate with the 3D film (i.e., virtual display) for naked eye display. This part depends on two factors: on the one hand, the RGB arrangement rule of the main display; the RGB arrangement rule of the main display may include but is not limited to pixel spacing, number of screen lines, and maximum offset, etc. The RGB arrangement rule of the main display can be determined based on the extended display identification data of the main display; on the other hand, the viewpoint interleaving rule; specifically, in the actual application process, for 2 viewpoints and 9 viewpoints, the number of shader pixel matrices that need to be processed is different. The higher the number of viewpoints, the higher the number of matrices, but the matrix size will decrease because the length and width of a single view are smaller. Therefore, it is necessary to calculate the shader pixel matrix based on the fragment shader, and then determine the viewpoint interleaving rule based on the shader pixel matrix and the original pixel matrix.

[0126] It should be further explained here that, based on the above-mentioned records, the vertex shader recorded above can be used to determine the interpolation range of the left and right eye views, and the fragment shader can be used to determine the interpolation content of the left and right eye views; under this premise, after the memory processor has interleaved the left and right eye views, the GPU can be allowed to render according to the rules specified by the specified range and content; at the same time, in addition to global interleaving, it can also dynamically adjust its parameters and ranges to achieve interleaving at any position and size on the screen to achieve local naked-eye 3D; of course, the realization of local naked-eye 3D depends on whether the corresponding main display has such a 3D film or hardware capability.

[0127] In step S140 , the current vector texture is pushed to a global container, and the current vector texture is output to the virtual display based on the global container, so as to render the current vector texture through the virtual display.

[0128] Specifically, pushing the current vector texture to a global container and outputting the current vector texture to the virtual display based on the global container can be achieved by: pushing the current vector texture to a global container, and pushing the current vector texture in the global container to a discrete graphics card in the terminal device based on a multimedia programming interface; replacing a historical vector texture in the discrete graphics card based on the current vector texture, and transmitting the current vector texture in the discrete graphics card to the virtual display based on a video signal transmission interface in the terminal device. That is, in actual application, after obtaining the current vector texture, the current vector texture can be pushed to a full-screen container via a corresponding data stream push channel. After the full-screen container receives the current vector texture, the current vector texture can be pushed to the discrete graphics card based on the multimedia programming interface. The discrete graphics card then replaces the historical vector texture in the discrete graphics card based on the current vector texture, and assembles a set of pixel vertices into points, lines, and triangles based on an interpolation range in the current vector texture, thereby improving the rendering speed of the scene to be rendered and the model to be rendered in the rendering resource.

[0129] Furthermore, after the set of pixel vertices is assembled, the current vector texture in the independent graphics card is transmitted to the virtual display based on the video signal transmission interface; wherein, the video signal transmission interface recorded here may include an HDMI (High Definition Multimedia Interface) or a DP (DisplayPort) interface; after the virtual display receives the current vector texture, it can render the current vector texture to realize the display of the display resource.

[0130] In an exemplary embodiment, after displaying the resources to be displayed, the information display method further includes: interacting with the game scene displayed on the virtual display based on the human eye's gaze point; or interacting with the game scene and / or video and / or image displayed on the virtual display based on an external input event. That is, in actual application, the displayed game scene can be switched by changing the position of the human eye, or game scene switching, video pause, video fast forward, video rewind, image zooming, and other interactions can be performed by external input events (such as mouse input events, keyboard input events, screen input events).

[0131] In an exemplary embodiment, interaction with the game scene displayed on the virtual display based on the gaze point of the human eye can be achieved as follows: obtaining the current gaze point position of the human eye gaze point in the virtual display and obtaining the center point position of the virtual display; calculating the position angle between the current gaze point position and the center point position, and controlling the virtual lens in the game scene to rotate from the current position to the target lens position corresponding to the position angle; and displaying the scene image captured by the virtual lens at the target lens position. In other words, the user's current eye image can be captured by an image acquisition device corresponding to the main display, and the current gaze point position of the human eye gaze point can be determined based on the current eye image. If the gaze point position changes, the virtual lens can be controlled to rotate based on the corresponding position angle to achieve the switching of the game scene.

[0132] In an exemplary embodiment, interaction with the game scene and / or video and / or image displayed in the virtual display based on external input events can be achieved in the following manner: based on the global container, external input events acting on the game scene and / or video and / or image through the virtual display are captured; based on the global container, the external input events are transmitted to the event processing layer, and based on the event processing layer, the external input events are processed to achieve interaction with the game scene and / or video and / or image. In other words, if game scene interaction, video interaction, or image interaction needs to be achieved through external input events, it needs to be achieved through the global container; in actual application, external input events are captured based on the global container, and then the external input events are passed to the event processing layer, and then event processing is performed based on the event processing layer to achieve the corresponding interaction process.

[0133] For example, if the virtual display shows a game scene, when an external input event is captured, the game scene can be switched, skills can be released, or other interactive operations can be performed. This example does not impose any special restrictions on this.

[0134] For example, if a video is displayed in the virtual display, when an external input event is captured, the video can be paused, fast-forwarded, or rewound, etc.; full-screen display or partial display can also be performed, etc. This example does not impose any special restrictions on this.

[0135] For another example, if an image is displayed in the virtual display, then when an external input event is captured, the image can be zoomed in or out, etc.; among them, the scene example diagram obtained by performing the image zooming interaction operation can be shown in Figure 7; the scene example diagram obtained by performing the image zooming interaction operation can be shown in Figure 8.

[0136] At this point, the information display method described in the exemplary embodiments of the present disclosure has been fully implemented. Based on the above description, it can be seen that the information display method described in the exemplary embodiments of the present disclosure can use WDDM technology to create a virtual display on the integrated graphics card and use DX technology for soft interleaving. The advantage of this is that it does not occupy the performance consumption of the independent graphics card. If the user runs a high-consumption program on the independent graphics card at this time, it will not affect the user experience. In addition, the information display method described in this application is different from the software-level interleaving solution of hard interleaving. The hard interleaving processing solution is processed at the product layer of the image signal. Since the current mainstream signal transmission has two types, HDMI and DP, it is necessary to process both signal protocols and add additional hardware devices such as FPGA or K3 boards to the hardware layer for parsing and processing signals. The information display method provided in this application is a Windows system layer solution based on the integrated graphics card. It processes the image from the source and has no other dependence on the signal transmission equipment. Furthermore, since the underlying technology used in the information display method described in this application is based on the Windows system layer and has no additional dependencies, it does not require additional adaptation when the Windows system is updated.

[0137] The following are embodiments of the apparatus disclosed herein, which can be used to implement the method embodiments disclosed herein. For details not disclosed in the apparatus embodiments disclosed herein, please refer to the method embodiments disclosed herein.

[0138] The exemplary embodiments of the present disclosure further provide an information display device configured in a terminal device. Specifically, as shown in FIG9 , the information display device may include a virtual display creation module 910, an image splitting processing module 920, an image interleaving processing module 930, and a vector texture rendering module 940.

[0139] A virtual display creation module 910 may be used to create a virtual display and a global container corresponding to the terminal device;

[0140] An image splitting processing module 920 may be configured to perform image splitting processing on a resource to be displayed based on the naked-eye 3D film parameters of the virtual display, to obtain left-eye and right-eye views with a naked-eye 3D effect;

[0141] An image interleaving processing module 930 may be configured to perform image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed;

[0142] The vector texture rendering module 940 may be configured to push the current vector texture to a global container, and output the current vector texture to the virtual display based on the global container, so as to render the current vector texture through the virtual display.

[0143] In an exemplary embodiment of the present disclosure, creating a virtual display corresponding to the terminal device includes: loading a graphics driver model in the terminal device; calling a video rendering network function in the graphics driver model, and creating the virtual display through the video program network function.

[0144] In an exemplary embodiment of the present disclosure, the information display device further includes:

[0145] An extended display identification data acquisition module, which can be used to obtain extended display identification data of the main display of the terminal device;

[0146] an original viewpoint number determination module, configured to determine an original screen resolution and an original screen refresh rate of the main display and an original viewpoint number that the main display can support based on the extended display identification data;

[0147] The naked-eye 3D film parameter generation module is used to generate the naked-eye 3D film parameters of the virtual display according to the original screen resolution, the original screen refresh rate and the original number of viewpoints.

[0148] In an exemplary embodiment of the present disclosure, creating a global container corresponding to the display terminal includes: calling an integrated graphics card in the terminal device based on a multimedia programming interface in the terminal device, and creating a global container corresponding to the display terminal through the integrated graphics card; wherein the global container is a modal container, and the background of the global container is a transparent background.

[0149] In an exemplary embodiment of the present disclosure, image splitting processing is performed on the resources to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with a naked-eye 3D effect, including: intercepting the resources to be displayed based on a graphics driver model, and establishing a path between the graphics driver model and the integrated graphics card based on the multimedia programming interface in the terminal device; transmitting the resources to be displayed to the integrated graphics card based on the path between the graphics driver model and the integrated graphics card, and caching the resources to be displayed in the integrated graphics card to a memory processor based on the multimedia programming interface; performing image splitting processing on the resources to be displayed in the memory processor based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with a naked-eye 3D effect.

[0150] In an exemplary embodiment of the present disclosure, image splitting processing is performed on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left-eye and right-eye views with naked-eye 3D effect, including: determining the target number of viewpoints that the virtual display can support based on the naked-eye 3D film parameters of the virtual display; and image splitting processing is performed on the resource to be displayed based on the target number of viewpoints to obtain left-eye and right-eye views with naked-eye 3D effect.

[0151] In an exemplary embodiment of the present disclosure, image interleaving processing is performed on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed, including: calling a vertex shader and a fragment shader in a memory processor, and calculating an interpolation range of the left and right eye views based on the vertex shader; calculating an interpolation content of the left and right eye views based on the fragment shader; and performing image interleaving processing on the left and right eye views according to the interpolation range and the interpolation content to obtain a current vector texture corresponding to the resource to be displayed.

[0152] In an exemplary embodiment of the present disclosure, the interpolation range of the left and right eye views is calculated based on the vertex shader, including: determining the image display range of the left and right eye views on the virtual display, and determining the vertex position of each pixel vertex in the left and right eye views on the virtual display based on the image display range; determining the interpolation range of the naked eye 3D resource based on the vertex position of each pixel vertex on the virtual display through the vertex shader.

[0153] In an exemplary embodiment of the present disclosure, the interpolation content of the left and right eye views is calculated based on the fragment shader, including: obtaining the color value arrangement rule of the virtual display; wherein the color value arrangement rule includes pixel interval, number of screen lines and maximum offset; through the fragment shader, according to the target number of viewpoints that the virtual display can support, determining the viewpoint interleaving rule of the virtual display; according to the viewpoint interleaving rule and the color value arrangement rule, calculating the interpolation content of the left and right eye views.

[0154] In an exemplary embodiment of the present disclosure, the viewpoint interleaving rule of the virtual display is determined through the fragment shader according to the target number of viewpoints that the virtual display can support, including: determining the original pixel matrix of the naked eye 3D resource; according to the target number of viewpoints that the virtual display can support, performing orthogonal changes in the human eye projection corresponding to the target number of viewpoints in the fragment shader to obtain a shader pixel matrix; and determining the viewpoint interleaving rule of the virtual display according to the shader pixel matrix and the original pixel matrix.

[0155] In an exemplary embodiment of the present disclosure, the viewpoint interleaving rule of the virtual display is determined based on the shader pixel matrix and the original pixel matrix, including: calculating the product operation result between the shader pixel matrix and the original pixel matrix, and determining the viewpoint interleaving rule of the virtual display based on the product operation result.

[0156] In an exemplary embodiment of the present disclosure, the current vector texture is pushed to a global container, and the current vector texture is output to the virtual display based on the global container, including: pushing the current vector texture to the global container, and based on a multimedia programming interface, pushing the current vector texture in the global container to the independent graphics card in the terminal device; replacing the historical vector texture in the independent graphics card based on the current vector texture, and transmitting the current vector texture in the independent graphics card to the virtual display based on the video signal transmission interface in the terminal device.

[0157] In an exemplary embodiment of the present disclosure, the naked eye 3D resource includes at least one of a game scene, a video, and an image; wherein the information display device further includes:

[0158] A first interaction module may be configured to interact with the game scene displayed on the virtual display based on a human eye gaze point; and / or

[0159] The second interaction module can be used to interact with the game scene and / or video and / or image displayed in the virtual display based on external input events.

[0160] In an exemplary embodiment of the present disclosure, interaction with the game scene displayed in the virtual display is performed based on the gaze point of the human eye, including: obtaining the current gaze point position of the human eye in the virtual display, and obtaining the center point position of the virtual display; calculating the position angle between the current gaze point position and the center point position, and controlling the virtual lens in the game scene to rotate from the current position to the target lens position corresponding to the position angle; and displaying the scene picture captured by the virtual lens at the target lens position.

[0161] In an exemplary embodiment of the present disclosure, interaction with the game scene and / or video and / or image displayed in the virtual display based on external input events includes: capturing external input events that act on the game scene and / or video and / or image through the virtual display based on the global container; transmitting the external input events to an event processing layer based on the global container, and processing the external input events based on the event processing layer to achieve interaction with the game scene and / or video and / or image.

[0162] The specific details of each module in the above-mentioned information display device have been described in detail in the corresponding information display method, so they will not be repeated here.

[0163] It should be noted that although several modules or units of the device for action execution are mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.

[0164] Furthermore, although the steps of the method of the present disclosure are described in a particular order in the accompanying drawings, this does not require or imply that the steps must be performed in this particular order, or that all steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0165] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0166] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods, or program products. Therefore, various aspects of the present disclosure may be implemented in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "circuits," "modules," or "systems."

[0167] The electronic device 1000 according to this embodiment of the present disclosure is described below with reference to Figure 10. The electronic device 1000 shown in Figure 10 is merely an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0168] As shown in FIG10 , electronic device 1000 is implemented as a general-purpose computing device. Components of electronic device 1000 may include, but are not limited to, the aforementioned at least one processing unit 1010, the aforementioned at least one storage unit 1020, a bus 1030 connecting various system components (including storage unit 1020 and processing unit 1010), and a display unit 1040.

[0169] Wherein, the storage unit stores a program code, and the program code can be executed by the processing unit 1010, so that the processing unit 1010 performs the steps according to various exemplary embodiments of the present disclosure described in the above "Exemplary Method" section of this specification. For example, the processing unit 1010 can execute step S110 as shown in Figure 1: create a virtual display and a global container corresponding to the terminal device; step S120: perform image splitting processing on the display resource based on the naked eye 3D film parameters of the virtual display to obtain left and right eye views with naked eye 3D effects; step S130: perform image interleaving processing on the left and right eye views to obtain the current vector texture corresponding to the resource to be displayed; step S140: push the current vector texture to the global container, and output the current vector texture to the virtual display based on the global container, so as to render the current vector texture through the virtual display.

[0170] The storage unit 1020 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 10201 and / or a cache memory unit 10202 , and may further include a read-only memory unit (ROM) 10203 .

[0171] The storage unit 1020 may also include a program / utility 10204 having a set (at least one) of program modules 10205, such program modules 10205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0172] Bus 1030 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0173] The electronic device 1000 can also communicate with one or more external devices 1100 (e.g., a keyboard, a pointing device, a Bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 1000, and / or any device that enables the electronic device 1000 to communicate with one or more other computing devices (e.g., a router, a modem, etc.). Such communication can occur via an input / output (I / O) interface 1050. Furthermore, the electronic device 1000 can also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 1060. As shown, the network adapter 1060 communicates with other modules of the electronic device 1000 via a bus 1030. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device 1000, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0174] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0175] In exemplary embodiments of the present disclosure, a computer-readable storage medium is also provided, on which is stored a program product capable of implementing the aforementioned methods of this specification. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product comprising program code. When the program product is executed on a terminal device, the program code is configured to cause the terminal device to execute the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of the present disclosure.

[0176] According to an embodiment of the present disclosure, a program product for implementing the above-mentioned method can be a portable compact disc read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0177] The program product may be implemented in any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0178] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0179] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0180] The program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and the like, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0181] Furthermore, the figures above are merely illustrative of the processes included in the methods according to exemplary embodiments of the present disclosure and are not intended to be limiting. It is readily understood that the processes illustrated in the figures above do not indicate or limit the temporal order of these processes. Furthermore, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0182] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow from the general principles of the present disclosure and include common knowledge or customary techniques in the art not invented herein. The specification and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the claims.

Claims

1. An information display method, characterized in that Configured in a terminal device, the information display method includes: Create a virtual display and a global container corresponding to the terminal device; Perform image splitting processing on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left and right eye views with a naked-eye 3D effect; Perform image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed; Push the current vector texture to the global container and output the current vector texture to the virtual display based on the global container, so as to render the current vector texture through the virtual display.

2. The information display method according to claim 1, characterized in that Create a virtual display corresponding to the terminal device, including: Load the graphics driver model in the terminal device; Call the video presentation network function in the graphics driver model and create the virtual display through the video program network function.

3. The information display method according to claim 2, wherein The information display method further includes: Obtain the extended display identification data of the main display of the terminal device; Based on the extended display identification data, determine the original screen resolution, original screen refresh rate of the main display, and the original number of viewpoints supported by the main display; Generate the naked-eye 3D film parameters of the virtual display according to the original screen resolution, original screen refresh rate, and original number of viewpoints.

4. The information display method according to claim 1, wherein Create a global container corresponding to the display terminal, including: Based on the multimedia programming interface in the terminal device, call the integrated graphics card in the terminal device and create a global container corresponding to the display terminal through the integrated graphics card; wherein, the global container is a modal container and the background of the global container is a transparent background.

5. The information display method according to claim 1, wherein Perform image splitting processing on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left and right eye views with a naked-eye 3D effect, including: Intercept the resource to be displayed based on the graphics driver model and establish a path between the graphics driver model and the integrated graphics card based on the multimedia programming interface in the terminal device; Based on the path between the graphics driver model and the integrated graphics card, transmit the resource to be displayed to the integrated graphics card, and cache the resource to be displayed in the integrated graphics card to the memory processor based on the multimedia programming interface; Perform image splitting processing on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display in the memory processor to obtain left and right eye views with a naked-eye 3D effect.

6. The information display method according to claim 1, wherein Perform image splitting processing on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left and right eye views with a naked-eye 3D effect, including: Determine the target number of viewpoints supported by the virtual display based on the naked-eye 3D film parameters of the virtual display; Perform image splitting processing on the resource to be displayed based on the target number of viewpoints to obtain left and right eye views with a naked-eye 3D effect.

7. The information display method according to claim 1, wherein Perform image interleaving processing on the left and right eye views to obtain a current vector texture corresponding to the resource to be displayed, including: Call the vertex shader and fragment shader in the memory processor, and calculate the interpolation range of the left and right eye views based on the vertex shader; Calculate the interpolation content of the left and right eye views based on the fragment shader; Perform image interleaving processing on the left and right eye views according to the interpolation range and interpolation content to obtain the current vector texture corresponding to the resource to be displayed.

8. The information display method according to claim 7, characterized in that Calculating the interpolation range of the left and right eye views based on the vertex shader includes: Determine the image display range of the left and right eye views on the virtual display, and determine the vertex positions of each pixel vertex in the left and right eye views on the virtual display according to the image display range; Use the vertex shader to determine the interpolation range of the naked-eye 3D resource according to the vertex positions of the pixel vertices on the virtual display.

9. The information display method according to claim 7, characterized in that Calculating the interpolation content of the left and right eye views based on the fragment shader includes: Obtain the color value arrangement rule of the virtual display; wherein, the color value arrangement rule includes pixel interval, number of screen lines, and maximum offset; Use the fragment shader to determine the view point interleaving rule of the virtual display according to the target number of view points supported by the virtual display; Calculate the interpolation content of the left and right eye views according to the view point interleaving rule and the color value arrangement rule.

10. The information display method according to claim 9, characterized in that Using the fragment shader to determine the view point interleaving rule of the virtual display according to the target number of view points supported by the virtual display includes: Determine the original pixel matrix of the naked-eye 3D resource; According to the target number of view points supported by the virtual display, perform an orthogonal transformation of the human eye projection corresponding to the target number of view points in the fragment shader to obtain a shader pixel matrix; Determine the view point interleaving rule of the virtual display according to the shader pixel matrix and the original pixel matrix.

11. The information display method according to claim 10, characterized in that, Determining the view point interleaving rule of the virtual display according to the shader pixel matrix and the original pixel matrix includes: Calculate the product operation result between the shader pixel matrix and the original pixel matrix, and determine the view point interleaving rule of the virtual display according to the product operation result. Push the current vector texture to the global container, and output the current vector texture to the virtual display based on the global container, including:

12. The information display method according to claim 1, wherein Push the current vector texture to the global container, and based on the multimedia programming interface, push the current vector texture in the global container to the independent graphics card in the terminal device; Replace the historical vector texture in the independent graphics card based on the current vector texture, and transmit the current vector texture in the independent graphics card to the virtual display based on the video signal transmission interface in the terminal device. The naked-eye 3D resource includes at least one of a game scene, a video, and an image; 13. The information display method according to claim 1, wherein Wherein, the information display method further includes: Interact with the game scene displayed on the virtual display based on the human eye fixation point; and / or Interact with the game scene and / or video and / or image displayed on the virtual display based on an external input event. ​ 14. The information display method according to claim 13, characterized in that Interact with the game scene displayed in the virtual display based on the human eye fixation point, including: Obtain the current fixation point position of the human eye fixation point in the virtual display, and obtain the center point position of the virtual display; Calculate the position angle between the current fixation point position and the center point position, and control the virtual camera in the game scene to rotate from the current position to the target camera position corresponding to the position angle; Display the scene image captured by the virtual camera at the target camera position.

15. The information display method according to claim 13, characterized in that, Interact with the game scene and / or video and / or image displayed in the virtual display based on an external input event, including: Capture, based on the global container, an external input event acting on the game scene and / or video and / or image through the virtual display; Transmit the external input event to the event processing layer based on the global container, and process the external input event based on the event processing layer to implement interaction with the game scene and / or video and / or image.

16. An information display device, characterized in that, Configured in a terminal device, the information display device includes: A virtual display creation module for creating a virtual display and a global container corresponding to the terminal device; An image splitting processing module for performing image splitting processing on the resource to be displayed based on the naked-eye 3D film parameters of the virtual display to obtain left and right eye views with a naked-eye 3D effect; An image interleaving processing module for performing image interleaving processing on the left and right eye views to obtain the current vector texture corresponding to the resource to be displayed; A vector texture rendering module for pushing the current vector texture to the global container, and outputting the current vector texture to the virtual display based on the global container to render the current vector texture through the virtual display.

17. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the information display method according to any one of claims 1-15.

18. An electronic device, characterized in that, Including: A processor; And A memory for storing executable instructions of the processor; Wherein, the processor is configured to execute the information display method according to any one of claims 1-15 by executing the executable instructions.

Images