3D display system and 3D display method
Through the 3D display system and method, the image content of various applications is converted into 3D display image content suitable for 3D display, solving the problem of insufficient 3D image content in the prior art, and achieving the goal of users to fully experience 3D visual effects.
Patent Information
- Application Number
- CN202210184546.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-05-18
- Filing Date
- 2022-02-23
- Publication Date
- 2025-02-28
- Estimated Expiration
- 2042-02-23
AI Technical Summary
The existing 3D display technology requires image content in a specific stereoscopic image format, resulting in insufficient 3D image content and users cannot fully enjoy the display effect of 3D displays.
Through the 3D display system and method, the image content of a variety of different applications is converted into 3D display image content that can be played by a 3D display, and the images are adapted and processed using processors and runtime.
The 3D content that can be displayed by 3D displays is expanded, allowing users to fully experience the 3D visual effects, and the image content of any application can be converted into suitable 3D display images.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a display system, and in particular to a 3D display system and a 3D display method. Background Art
[0002] With the vigorous development of three-dimensional (3D) display technology, people can be provided with an immersive visual experience. In terms of 3D display technology, it can be divided into glasses-type 3D image display technology and naked-eye 3D image display technology. Although glasses-type 3D image display technology is relatively mature, 3D glasses are inconvenient to use. Therefore, naked-eye 3D image display technology has gradually become the focus of development in various industries. On the other hand, head-mounted display devices (Head Mounted Display, HMD) that can provide 3D visual experience, such as Mixed Reality (Mixed Reality, MR) or Virtual Reality (VirtualReality, VR) displays, have gradually become popular products on the market.
[0003] The principle of the above 3D display technologies is to let the user's left eye watch the left eye image and the user's right eye watch the right eye image, so that the user can feel the 3D visual effect. It is known that the 3D display needs to use the corresponding 3D display technology to play the image in a specific stereo image format, otherwise the 3D display will not be able to display the image correctly. In other words, no matter which 3D display technology is used, it is necessary to cooperate with the specifications, hardware design and user-related parameters of the 3D display to generate 3D display image content suitable for display by the 3D display. However, the 3D image content on the market is not sufficient, so even if the user has a 3D display, the user still cannot fully and arbitrarily enjoy the display effect brought by the 3D display. Summary of the invention
[0004] The present invention relates to a 3D display system and a 3D display method, which can convert image contents of various different application programs into 3D display image contents that can be played by a 3D display, so that users can experience 3D visual effects.
[0005] An embodiment of the present invention provides a 3D display system, which includes a 3D display, a memory, and one or more processors. The processor is connected to the 3D display and the memory, and is configured to: when executing a first type of application, obtain the image content of the first type of application and generate a stereoscopic format image based on the image content of the first type of application; pass the stereoscopic format image to a running component (also called runtime) that meets the specific development standard through an application programming interface that meets the specific development standard; and perform display frame processing on the stereoscopic format image associated with the 3D display through the runtime, and provide the 3D display image content generated by the display frame processing to the 3D display for display.
[0006] The embodiment of the present invention provides a 3D display method, which is applicable to a 3D display system. The method comprises the following steps. When executing a first type of application, the image content of the first type of application is obtained and a stereoscopic format image is generated according to the image content of the first type of application. The stereoscopic format image is transmitted to a runtime that meets the specific development standard via an application programming interface that meets the specific development standard. The runtime performs display frame processing associated with a 3D display on the stereoscopic format image, and provides the 3D display image content generated by the display frame processing to the 3D display for display.
[0007] Based on the above, in the embodiments of the present invention, the image content of various applications can be converted into a stereoscopic format image without being limited by the type of application. This stereoscopic format image can be transmitted to a runtime that meets a specific development standard via an application programming interface that meets a specific development standard, so that this runtime can use a hardware driver or link library related to the 3D display to perform display frame processing associated with the 3D display on the stereoscopic format image. Therefore, the 3D display image content generated by the display frame processing is suitable for correct display by the 3D display. Accordingly, the embodiments of the present invention can expand the 3D content that can be displayed by the 3D display, allowing users to fully experience the display effect brought by the 3D display. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] Figure 1A and Figure 1B is a schematic diagram of a 3D display system according to an embodiment of the present invention;
[0009] Figure 2 is a flow chart of a 3D display method according to an embodiment of the present invention;
[0010] Figure 3 is a flow chart of a 3D display method according to an embodiment of the present invention;
[0011] Figure 4 is a schematic diagram of a software architecture of a 3D display system according to an embodiment of the present invention;
[0012] Figure 5 FIG. 4 is a schematic diagram of generating 3D display image content according to an embodiment of the present invention.
[0013] Description of Reference Numerals
[0014] 10: 3D display system;
[0015] 110: 3D display;
[0016] 120: memory;
[0017] 130: processor;
[0018] 131: Stereoscopic image generating component;
[0019] 132: interface component;
[0020] 133: runtime component;
[0021] 410: application layer;
[0022] 420:framework;
[0023] 430: Hardware;
[0024] 411: Desktop application;
[0025] 412: Standardized applications;
[0026] 413: Launcher program;
[0027] 414: 3D display application;
[0028] 421:OpenXR application programming interface;
[0029] 422:OpenXR runtime;
[0030] 423_1: lens control module;
[0031] 423_2: eye tracking module;
[0032] 423_3: image weaving module;
[0033] L1: lens;
[0034] Cl: Camera;
[0035] D1: display panel;
[0036] W1: window;
[0037] G1: layer;
[0038] Img_1: image content;
[0039] Img_2: side-by-side image;
[0040] Img_3: 3D display image content;
[0041] S201~S203, S301~S304: steps. DETAILED DESCRIPTION
[0042] Reference will now be made in detail to exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.
[0043] Figure 1A and Figure 1B is a schematic diagram of a 3D display system according to an embodiment of the present invention. Figure 1A and Figure 1B , the 3D display system 10 may include a 3D display 110, a memory 120, and a processor 130. The processor 130 couples the 3D display 110 and the memory 120. The 3D display 110 is a stereoscopic display device and can be connected to the processor 130 via a wired or wireless data transmission interface. The 3D display system 10 can be a single integrated system or a separate system. Specifically, the 3D display 110, the memory 120, and the processor 130 in the 3D display system 10 can be implemented as an all-in-one (AIO) electronic device, such as a laptop or a tablet computer, and the processor 130 of the electronic device can be connected to the 3D display 110 via a system bus. Alternatively, the 3D display system 10 can be implemented by multiple electronic products, and the 3D display 110 can be connected to the processor 130 of the computer system via a wired transmission interface or a wireless transmission interface, such as a head-mounted display device, a desktop screen, or an electronic billboard connected to the computer system. The 3D display 110 can receive the image data provided by the processor 130 and play pictures with 3D effects for users to watch according to the image data provided by the processor 130 .
[0044] The 3D display 110 allows the user to experience a stereoscopic visual effect. In order to allow the user to experience a 3D visual effect through the 3D display 110, the 3D display 110 can allow the user's left eye and right eye to respectively view image content corresponding to different viewing angles (i.e., left-eye image and right-eye image) according to its hardware specifications and the 3D display technology it applies. In some embodiments, the 3D display 110 can be a naked-eye 3D display or a glasses-type 3D display, such as a laptop computer display, a television, a desktop screen, or an electronic billboard. Alternatively, in some embodiments, the 3D display 110 can be implemented as a head-mounted display device, such as an AR display device, a VR display device, or an MR display device.
[0045] From another perspective, the 3D display 110 may include a liquid crystal display (LCD), a light-emitting diode (LED) display, a field emission display (FED), an organic light-emitting diode display (OLED) or other types of displays, but the present invention is not limited thereto.
[0046] The memory 120 is used to store data and data such as software modules (such as operating systems, applications, and drivers) accessed by the processor 130. It can be, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk, or a combination thereof.
[0047] The processor 130 is coupled to the memory 120 and the 3D display 110, and is, for example, a central processing unit (CPU), an application processor (AP), or other programmable general-purpose or special-purpose microprocessor, digital signal processor (DSP), image signal processor (ISP), graphics processing unit (GPU) or other similar devices, integrated circuits and combinations thereof. The processor 130 can access and execute the software module recorded in the memory 120 to implement the 3D display method in the embodiment of the present invention. The above-mentioned software module can be broadly interpreted as meaning instructions, instruction sets, codes, program codes, programs, applications, software suites, threads, programs, functions, etc., regardless of whether it is called software, firmware, middleware, microcode, hardware description language or others.
[0048] Please refer to Figure 1BIn one embodiment, the processor 130 may include a stereo image generation component 131, an interface component 132, and a runtime component 133. In one embodiment, the stereo image generation component 131, the interface component 132, and the runtime component 133 may be implemented by hardware. For example, dedicated hardware implementations such as application-specific integrated circuits (ASICs), programmable logic arrays, and other hardware components may be configured to implement the components within the processor 130. More specifically, the blocks of the stereo image generation component 131, the interface component 132, and the runtime component 133 may be implemented as logic circuits on an integrated circuit. The related functions of the stereo image generation component 131, the interface component 132, and the runtime component 133 may be implemented as hardware using hardware description languages (such as Verilog HDL or VHDL) or other suitable programming languages. For example, the related functions of the above-mentioned stereoscopic image generation component 131, interface component 132 and runtime component 133 can be implemented in one or more controllers, microcontrollers, microprocessors, application-specific integrated circuits (ASIC), digital signal processors (DSP) and / or field programmable gate arrays (FPGA). That is, the stereoscopic image generation component 131, interface component 132 and runtime component 133 can be multiple hardware components installed in the electronic device. In one embodiment, the stereoscopic image generation component 131, interface component 132 and runtime component 133 can be multiple special hardware circuits, and the processor 130 is a special processor architecture formed by integrating multiple special hardware circuits. The stereoscopic image generation component 131, interface component 132 and runtime component 133 have a specific connection relationship, and the stereoscopic image generation component 131, interface component 132 and runtime component 133 can be connected to each other through their respective data output interfaces and data input interfaces.
[0049] In one embodiment, the stereoscopic image generating component 131 is connected to the memory 120. The interface component 132 is connected to the stereoscopic image generating component 131. The runtime component 133 is connected to the interface component 132 and the 3D display. When the first type of application is executed, the stereoscopic image generating component 131 obtains the image content of the first type of application from the memory 120 and generates a stereoscopic format image according to the image content of the first type of application, and outputs the stereoscopic format image to the interface component 132. The interface component 132 outputs the stereoscopic format image to the runtime component 133, so as to pass the stereoscopic format image to the runtime that meets the specific development standard via the application programming interface that meets the specific development standard. The runtime component 133 performs display frame processing associated with the 3D display on the stereoscopic format image through the runtime, and provides the 3D display image content generated by the display frame processing to the 3D display for display. When the second type of application that meets the specific development standard is executed, the stereoscopic image generating component 131 obtains the stereoscopic format image provided by the second type of application.
[0050] In some embodiments, the stereoscopic image generating component 131 obtains the image content of the first category application from the window of the first category application. The stereoscopic image generating component 131 further determines whether the image content of the first category application is a stereoscopic format image that conforms to the stereoscopic display format. If not, the stereoscopic image generating component 131 converts the image content of the first category application into a stereoscopic format image that conforms to the stereoscopic display format. In some embodiments, the stereoscopic image generating component 131 receives user operations. The stereoscopic image generating component 131 obtains the image content of the first category application in response to the user operation, wherein the user operation includes controlling the first category application to operate in full screen mode or taking a screenshot in the window of the first category application by using a mouse.
[0051] Figure 2 is a flow chart of a 3D display method according to an embodiment of the present invention. Figure 1A , Figure 1B and Figure 2 The method of this embodiment is applicable to the 3D display system 10 in the above embodiment. The following will describe the detailed steps of this embodiment with the components in the 3D display system 10.
[0052] In step S201, when the processor 130 executes the first type of application, the processor 130 obtains the image content of the first type of application and generates a three-dimensional format image according to the image content of the first type of application. In some embodiments, the first type of application may be a desktop application, which is an application software that can be installed on a single computer device and used to perform various tasks, such as a browser program, a game program, a word editing program, a multimedia player program, a drawing program, etc., and the present invention is not limited to this.
[0053] It should be noted that the first category of applications is not an application that complies with a specific development standard. For example, the above-mentioned specific development standard may be the OpenXR standard, the OpenVR standard or other software development standards for developing 3D display applications, virtual reality applications, and augmented reality applications. In other words, the first category of applications is not a standardized application developed based on the OpenXR standard or the OpenVR standard. It is conceivable that when the processor 130 executes the first category of applications, the image content of the first category of applications generally does not conform to the stereoscopic display format. The image content of the first category of applications will not be passed to the runtime that complies with the specific development standard for 3D display via an application programming interface that complies with the specific development standard.
[0054] In an embodiment of the present invention, by executing a standardized application developed according to a specific development standard, the processor 130 can obtain the image content of the first type of application and generate a stereoscopic format image according to the image content of the first type of application. More specifically, in some embodiments, the processor 130 can use screen acquisition technology such as "Desktop Duplication API" of Windows operating system to obtain the image content of the first type of application. In some embodiments, the processor 130 can use the application programming interface provided by the operating system to obtain the image content of the first type of application from the window of the first type of application. For example, the processor 130 can use the window screen acquisition technology such as "Windows Graphics Capture API" of Windows operating system to obtain the image content of the first type of application.
[0055] That is, when the processor 130 executes the first type of application, the image content in the window of the first type of application will be recorded in a certain rendering layer or a current display frame synthesized by multiple rendering layers. In some embodiments, the processor 130 can obtain the image content of the first type of application by obtaining a partial image or all images of the current display frame or a certain layer from the memory 120. In addition, in some embodiments, the processor 130 can first perform other image processing on the obtained image content, such as image scaling, image cropping, etc., and then perform format conversion processing for the stereoscopic display format.
[0056] As described above, after acquiring the image content of the first type of application, the processor 130 generates a stereoscopic format image according to the image content of the first type of application. In some embodiments, the stereoscopic format image is a side-by-side image that conforms to the side-by-side format. More specifically, in some embodiments, the processor 130 may determine whether the image content of the first type of application is a stereoscopic format image that conforms to the stereoscopic display format. The stereoscopic image format may include a Side by Side (SBS) format or a Top and Bottom (TB) format. For example, the processor 130 may determine whether the image content of the first type of application is a side-by-side image including a left eye image and a right eye image. If the image content of the first type of application is not a stereoscopic format image that conforms to the stereoscopic display format, the processor 130 may convert the image content of the first type of application into a stereoscopic format image. For example, the processor 130 may generate a left eye image and a right eye image according to the image content of a single perspective to obtain a side-by-side image including a left eye image and a right eye image. In one embodiment, the processor 130 may convert the image content of the first type of application into a stereoscopic format image through a neural network model. Alternatively, if the image content of the first type of application is a stereoscopic image that conforms to the stereoscopic display format, the processor 130 does not need to perform a format conversion process for the stereoscopic display format.
[0057] Next, in step S202, the processor 130 passes the stereoscopic format image to the runtime that conforms to the specific development standard via the application programming interface that conforms to the specific development standard. In an embodiment of the present invention, the application programming interface that conforms to the specific development standard is implemented in the 3D display system 10, and the runtime is developed based on the specific development standard and the hardware characteristics of the 3D display 110. For example, the application programming interface that conforms to the specific development standard can be the OpenXR API developed by the Khronos Alliance. The OpenXR API allows standardized applications developed based on the OpenXR standard to communicate with the hardware driver of the 3D display 110. Based on this, in one embodiment, since the processor 130 obtains the stereoscopic format image by executing the standardized application developed based on the OpenXR standard and the runtime is also developed based on the OpenXR standard, the OpenXR API that can be called by the standardized application developed based on the OpenXR standard is used to pass the stereoscopic format image to the OpenXR runtime by the OpenXR API.
[0058] Then, in step S203, the processor 130 performs display frame processing associated with the 3D display 110 on the stereoscopic format image through the runtime, and provides the 3D display image content generated by the display frame processing to the 3D display 110 for display. Specifically, the processor 130 can further convert the stereoscopic format image into 3D display image content suitable for display by the 3D display 110 according to the hardware specifications of the 3D display 110 and the 3D display technology applied thereto. That is, the processor 130 can obtain the 3D display image content according to the side-by-side image according to the 3D display parameters provided by the underlying hardware driver of the 3D display 110 and the display frame processing required by the 3D display 110. In more detail, the runtime can be regarded as a program (process) running by the processor 130, and the runtime can communicate with the underlying hardware driver of the 3D display 110, such as obtaining parameters provided by the underlying hardware driver or using a link library, etc.
[0059] It is worth mentioning that, in one embodiment, the 3D display 110 may be a naked-eye 3D display, and the display frame processing may include image weaving processing. That is, since the runtime is developed based on a specific development standard and the hardware characteristics of the 3D display 110, the runtime has the ability to use a link library corresponding to the image weaving processing. In detail, when the 3D display 110 is a naked-eye 3D display, it provides two images with parallax to the left eye and the right eye through the lens refraction principle or grating technology to allow the viewer to experience a stereoscopic display effect. Therefore, the processor 130 performs image weaving processing on the stereoscopic format image to interleave the pixel data of the left eye image with the pixel data of the right eye image to generate a single frame image suitable for playback by a naked-eye 3D display.
[0060] based on Figure 2 As can be seen from the description of the embodiment, the 3D display system 10 can convert the image contents of various desktop applications into 3D display image contents suitable for being played by the 3D display 110 , thereby greatly expanding the application scope of the 3D display.
[0061] It should also be noted that in the embodiment of the present invention, a standardized API that complies with a specific development standard is deployed in the 3D display system 10. Therefore, when the processor 130 executes a second type of application that complies with the specific development standard, the second type of application can call the standardized API by itself and pass the stereoscopic format image that complies with the stereoscopic display format to the runtime to convert the stereoscopic format image into 3D display image content suitable for playback by the 3D display 110. For example, taking the OpenXR standard as an example, whether the processor 130 executes a first type of application that does not comply with the OpenXR standard or a second type of application that complies with the OpenXR standard, the side-by-side image can be passed to the OpenXR runtime, so that the user can experience a 3D visual experience through the 3D display 110.
[0062] Figure 3 is a flow chart of a 3D display method according to an embodiment of the present invention. Figure 1A , Figure 1B and Figure 3 The method of this embodiment is applicable to the 3D display system 10 in the above embodiment. The following will describe the detailed steps of this embodiment with the components in the 3D display system 10.
[0063] In step S301, when the processor 130 executes the first type of application, the processor 130 obtains the image content of the first type of application and generates a stereoscopic image according to the image content of the first type of application. Figure 2 The invention has been clearly taught by the embodiments, and will not be described in detail here.
[0064] In step S302, when the processor 130 executes the second type of application that complies with the specific development standard, the processor 130 obtains the stereoscopic format image provided by the second type of application. Here, the second type of application responds to being executed and provides the stereoscopic format image to the runtime using the application programming interface that complies with the specific development standard. For example, when the processor 130 executes an OpenXR application (such as WebXR, etc.), the image content of the OpenXR application is a side-by-side image and the side-by-side image is passed to the OpenXR runtime via the OpenXR API.
[0065] Therefore, in step S303, the processor 130 transmits the stereoscopic format image to the runtime that complies with the specific development standard via the application programming interface that complies with the specific development standard. In step S304, the processor 130 performs display frame processing associated with the 3D display 110 on the stereoscopic format image through the runtime, and provides the 3D display image content generated by the display frame processing to the 3D display 110 for display. The implementation of steps S303 and S304 can be performed by Figure 2 The invention has been clearly taught by the embodiments, and will not be described in detail here.
[0066] Based on this, in one embodiment, when the 3D display 110 is a naked-eye 3D display, regardless of whether the application executed by the 3D display system 10 complies with the specific development standard, the runtime that complies with the specific development standard can perform image weaving processing without being limited by the type of application program to obtain a single-frame image suitable for playback by the naked-eye 3D display.
[0067] Figure 4 3D display system according to an embodiment of the present invention. The following embodiments will be described by taking the 3D display 110 as a naked-eye display and the specific development standard as the OpenXR standard as an example. Figure 4, the 3D display system 10 may include an application layer 410, a framework 420, and hardware 430. The application layer 410 may include a desktop application 411 (i.e., a first type of application) and a standardized application 412 (i.e., a second type of application) that complies with the OpenXR standard or the OpenVR standard. In other words, the processor 130 may execute the desktop application 411 and / or the standardized application 412 that complies with the OpenXR standard or the OpenVR standard. The framework 420 includes an OpenXR API 421 that complies with the OpenXR standard, an OpenXR runtime 422, and a lens control module 423_1, an eye tracking module 423_2, and an image weaving module 423_3 that are hardware drivers or link libraries, respectively. The hardware 430 may include a lens L1, a camera C1, and a display panel D1.
[0068] In this embodiment, the application layer 410 may also include a launcher program 413 and a 3D display application 414 that complies with OpenXR. In detail, in some embodiments, the processor 130 may acquire the image content of the first type of application in response to a user operation. This user operation may include controlling the first type of application to operate in full screen mode or taking a screenshot in the window of the first type of application by a mouse. In this embodiment, the launcher program 413 is used to detect user operations and determine whether to initiate subsequent operations related to acquiring the image content of the desktop application 411. The launcher program 413 may, for example, run as a background program in the operating system. In other words, when the processor 130 detects a user operation that meets a preset condition through the launcher program 413, the processor 130 may be triggered to start executing the 3D display application 414.
[0069] For example, during the execution of the desktop application 411, in response to the launcher program 413 detecting that the desktop application 411 switches to the full screen mode, the processor 130 starts to execute the 3D display application 414. Alternatively, during the execution of the desktop application 411, in response to the launcher program 413 detecting that the image content of the desktop application 411 is a side-by-side image, the processor 130 starts to execute the 3D display application 414. Alternatively, during the execution of the desktop application 411, in response to the launcher program 413 detecting that one or more preset hot keys are pressed by the user, the processor 130 starts to execute the 3D display application 414. Alternatively, during the execution of the desktop application 411, in response to the launcher program 413 detecting that the mouse selects a specific range in the window of the desktop application 411 to perform a screenshot operation, the processor 130 starts to execute the 3D display application 414.
[0070] The 3D display application 414 is a standardized application developed according to the OpenXR standard, and it can be connected to the serial launcher program 413 through an application programming interface. The 3D display application 414 provides the function of obtaining image content and converting image format for the desktop application 411. In other words, by executing the 3D display application 414 by the processor 130, step S201 or step 301 of the above-mentioned embodiment can be implemented. Thereby, the processor 130 can generate a stereo format image according to the image content of the desktop application 411, and pass the stereo format image to the OpenXR runtime 422 via the OpenXR API 421. Therefore, the OpenXR runtime 422 can control the lens L1 to open through the lens control module 423_1, and the eye tracking module 423_2 detects the user's eye information through the camera 140. The OpenXR runtime 422 can convert the stereo format image into 3D display image content through the image weaving module 423_3. Image weaving processing is suitable for converting image content conforming to the side-by-side image format into 3D display image content determined based on the hardware architecture of the 3D display 110 (eg, lens architecture or panel pixel design, etc.) and user parameters (eg, user's eye information).
[0071] On the other hand, in this embodiment, when the processor 130 executes the standardized application 412 that complies with the OpenXR standard or the OpenVR standard, the standardized application 412 can generate a stereoscopic format image that complies with the side-by-side format by itself and transmit the stereoscopic format image to the OpenXR runtime 422 via the OpenXR API 421. Then, the OpenXR runtime 422 can communicate with the underlying hardware driver or use a link library associated with the 3D display 110 to provide the 3D display image content generated by the image weaving process to the 3D display 110 for display.
[0072] In this embodiment, through the interface of the OpenXR API 421, the 3D display system 10 can convert the image content of the application program into 3D display image content suitable for display by the 3D display 110 without being limited by the type of application program. For a naked-eye 3D display, the user experience of the user using the naked-eye 3D display can be greatly improved. For example, when a user uses a multimedia player to watch a multimedia file, the user can use the naked-eye 3D display function to display the image played by the multimedia player through a specific user operation, thereby experiencing the effect that the image played by the multimedia player has a floating screen.
[0073] Figure 5FIG. 1 is a schematic diagram of generating 3D display image content according to an embodiment of the present invention. Assume that the 3D display 110 is a naked-eye display and can be operated in a 2D display mode or a 3D display mode. Figure 5 , when the user uses the first type of application, the 3D display 110 operating in the 2D display mode may display a window W1 of the first type of application. The memory 120 records a layer G1 corresponding to the window W1. The 3D display 110 switches to the 3D display mode in response to a specific user operation, and the processor 130 may obtain the image content Img_1 in the window W1 from the memory 120 in response to the specific user operation. Then, the processor 130 may convert the image content Img_1 into a side-by-side image Img_2. The side-by-side image Img_2 will be passed to the runtime that complies with the OpenXR standard via the OpenXR API. Then, the processor 130 may perform image weaving processing on the side-by-side image Img_2 associated with the naked-eye 3D display 110 to generate a 3D display image content Img_3. When the naked-eye 3D display 110 operating in the 3D display mode displays the 3D display image content Img_3, the user may feel the 3D visual effect of the display object floating out of the screen.
[0074] In summary, in the embodiments of the present invention, by acquiring the image content of various applications through standardized applications developed according to specific development standards, the image content of various applications can be converted into 3D display image content suitable for display by a 3D display without being limited by the type of application. Accordingly, the 3D content that can be displayed by the naked-eye 3D display can be enriched. In addition, when executing an application that does not comply with the specific development standard, by acquiring the layer data corresponding to the application window in the memory or the screen image in full-screen mode, the image content selected by the user can be converted into 3D display image content, so that the user can fully experience the 3D visual effect.
[0075] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A 3D display system, characterized in that: include: 3D display; Memory; as well as A processor, connected to the 3D display and the memory, configured to: When executing a first type of application, obtaining image content of the first type of application and generating a stereoscopic image including a left-eye image and a right-eye image according to the image content of the first type of application, wherein the first type of application is not an application that complies with a specific development standard, wherein the specific development standard includes an OpenXR standard, an OpenVR standard, or other software development standards for developing 3D display applications, virtual reality applications, and augmented reality applications; The application program conforming to the specific development standard transmits the stereoscopic format image to an operating component conforming to the specific development standard via an application programming interface conforming to the specific development standard, wherein the operating component is developed according to the specific development standard and the hardware characteristics of the 3D display, and the standardized application program developed according to the specific development standard calls the application programming interface to transmit the stereoscopic format image to the operating component conforming to the specific development standard through the application programming interface; as well as The operating component performs display frame processing associated with the 3D display on the stereoscopic format image, and provides the 3D display image content generated by the display frame processing to the 3D display for display.
2. The 3D display system according to claim 1, characterized in that: The processor is further configured to: When executing a second type of application that complies with the specific development standard, the stereoscopic format image provided by the second type of application is obtained, wherein the second type of application responds to being executed and provides the stereoscopic format image to the running component using the application programming interface that complies with the specific development standard.
3. The 3D display system according to claim 1, characterized in that: The stereoscopic format image is a side-by-side image conforming to a side-by-side format.
4. The 3D display system according to claim 1, characterized in that: The processor is further configured to: The image content of the first type of application is acquired from the window of the first type of application using an application programming interface provided by the operating system.
5. The 3D display system according to claim 1, characterized in that: The processor is further configured to: Determining whether the image content of the first type of application is the stereoscopic format image that complies with the stereoscopic display format; as well as If not, the image content of the first type of application is converted into the stereoscopic format image that complies with the stereoscopic display format.
6. The 3D display system according to claim 1, characterized in that: The 3D display is a naked-eye 3D display, and the display frame processing includes image weaving processing.
7. The 3D display system according to claim 1, characterized in that: The processor is further configured to: The image content of the first type of application is acquired in response to a user operation, wherein the user operation includes controlling the first type of application to operate in a full screen mode or taking a screenshot in a window of the first type of application using a mouse.
8. A 3D display method, applicable to a 3D display system, characterized in that: include: When executing a first type of application, obtaining image content of the first type of application and generating a stereoscopic image including a left-eye image and a right-eye image according to the image content of the first type of application, wherein the first type of application is not an application that complies with a specific development standard, wherein the specific development standard includes an OpenXR standard, an OpenVR standard, or other software development standards for developing 3D display applications, virtual reality applications, and augmented reality applications; The application program conforming to the specific development standard transmits the stereoscopic format image to an operating component conforming to the specific development standard via an application programming interface conforming to the specific development standard, wherein the operating component is developed according to the specific development standard and the hardware characteristics of the 3D display, and the standardized application program developed according to the specific development standard calls the application programming interface, so that the stereoscopic format image is transmitted to the operating component conforming to the specific development standard through the application programming interface; as well as The operating component performs display frame processing associated with the 3D display on the stereoscopic format image, and provides the 3D display image content generated by the display frame processing to the 3D display for display.
9. The 3D display method according to claim 8, characterized in that: The method further comprises: When executing a second type of application that complies with the specific development standard, the stereoscopic format image provided by the second type of application is obtained, wherein the second type of application responds to being executed and provides the stereoscopic format image to the running component using the application programming interface that complies with the specific development standard.
10. The 3D display method according to claim 8, characterized in that: The stereoscopic format image is a side-by-side image conforming to a side-by-side format.
11. The 3D display method according to claim 8, characterized in that: When executing the first type of application, the steps of obtaining the image content of the first type of application and generating the stereoscopic format image according to the image content of the first type of application include: The image content of the first type of application is acquired from the window of the first type of application using an application programming interface provided by an operating system.
12. The 3D display method according to claim 8, characterized in that: When executing the first type of application, the steps of obtaining the image content of the first type of application and generating the stereoscopic format image according to the image content of the first type of application include: Determining whether the image content of the first type of application is the stereoscopic format image that complies with the stereoscopic display format; and If not, the image content of the first type of application is converted into the stereoscopic format image that complies with the stereoscopic display format.
13. The 3D display method according to claim 8, characterized in that: The 3D display is a naked-eye 3D display, and the display frame processing includes image weaving processing.
14. The 3D display method according to claim 8, characterized in that: When executing the first type of application, the steps of obtaining the image content of the first type of application and generating the stereoscopic format image according to the image content of the first type of application include: The image content of the first type of application is acquired in response to a user operation, wherein the user operation includes controlling the first type of application to operate in a full screen mode or taking a screenshot in a window of the first type of application using a mouse.
Citation Information
Patent Citations
Video 3D display method and device, equipment, and storage medium
CN109640180A
Three-dimensional image conversion apparatus for converting two-dimensional image into three-dimensional image and method for controlling the conversion apparatus
US20140300566A1