Image display system, method, storage medium, program product, apparatus, and vehicle
By introducing virtual service components into the 3D ecosystem, image data from 2D applications can be converted into 3D displays, solving the problem that 2D applications cannot be used in the 3D ecosystem, enabling 3D display effects, reducing development costs, and improving user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-11-20
- Publication Date
- 2026-03-31
AI Technical Summary
Existing 2D applications cannot be used directly in the 3D ecosystem, resulting in an inefficient way to apply 3D display effects to 2D applications, and high redevelopment costs.
By introducing virtual service components into the 3D ecosystem, image data from 2D applications is intercepted and forwarded to the 3D rendering service component. After processing, the data is displayed on the 3D screen, achieving a 3D display effect.
3D displays can be achieved in a 3D ecosystem without modifying 2D applications, reducing development costs and improving user experience.
Smart Images
Figure CN121764367A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of display technology, and in particular to an image display system, method, storage medium, program product, device and vehicle. Background Technology
[0002] With the rapid development of the automotive industry, multimedia smart cockpits are gradually replacing traditional cockpits. Related technologies are introducing a 3D ecosystem into these cockpits, providing users with novel user interfaces and immersive interactive experiences, becoming a significant development trend. However, most current applications are developed based on a 2D ecosystem. Unless applications are redeveloped based on a 3D ecosystem, existing 2D applications cannot utilize 3D ecosystem components to improve image display. Therefore, how to efficiently apply 3D display effects to 2D applications is a key technical challenge currently being researched in the industry. Summary of the Invention
[0003] This application provides an image display system, method, storage medium, program product, device, and vehicle. By using a virtual service component, it enables the integration of two-dimensional applications into a three-dimensional ecosystem, efficiently imparting three-dimensional display effects to two-dimensional applications. This avoids the need to redevelop two-dimensional applications based on the three-dimensional ecosystem, reducing development costs and at least partially solving the aforementioned technical problems.
[0004] To achieve the above objectives, according to a first aspect of this application, an image display system is provided, comprising a three-dimensional ecosystem and a three-dimensional screen. The three-dimensional ecosystem includes a virtual service component and a three-dimensional rendering service component. The virtual service component is used to: forward two-dimensional image data from a two-dimensional application to the three-dimensional rendering service component. The three-dimensional rendering service component is used to: process the two-dimensional image data to obtain three-dimensional image data; and send the three-dimensional image data to the three-dimensional screen. The three-dimensional screen is used to: perform a three-dimensional display operation based on the three-dimensional image data.
[0005] Optionally, the virtual service component includes a 2D compositor, and the 3D rendering service component includes a 3D compositor. The 2D compositor is used to: forward 2D image data from a 2D application to the 3D compositor; the 3D compositor is used to: process the 2D image data to obtain 3D image data; and send the 3D image data to the 3D screen.
[0006] Optionally, the 3D screen is further configured to: in response to a user operation, send 3D touch position data corresponding to the user operation to the 3D rendering service component. The 3D rendering service component is further configured to: determine 2D application position data based on the 3D touch position data; and send the 2D application position data to the virtual service component. The virtual service component is further configured to: forward the 2D application position data to the 2D application.
[0007] Optionally, the virtual service component includes a two-dimensional window manager, and the three-dimensional rendering service component includes a three-dimensional window manager. The three-dimensional screen is further configured to: send three-dimensional touch position data corresponding to the user operation to the three-dimensional window manager. The three-dimensional window manager is further configured to: determine two-dimensional application position data based on the three-dimensional touch position data; and send the two-dimensional application position data to the two-dimensional window manager. The two-dimensional window manager is further configured to: forward the two-dimensional application position data to the two-dimensional application.
[0008] Optionally, the two-dimensional application resides within the three-dimensional ecosystem.
[0009] Optionally, the image display system also includes a two-dimensional ecosystem in which the two-dimensional application resides.
[0010] Optionally, the two-dimensional ecosystem serves as a container for the three-dimensional ecosystem.
[0011] Optionally, the two-dimensional ecosystem is hosted in a virtual machine program generated by the virtualization of the three-dimensional ecosystem.
[0012] Optionally, the two-dimensional ecosystem includes a synthesis service component and a display service component. The synthesis service component is used to: generate two-dimensional image data for a two-dimensional application; and send the two-dimensional image data to the display service component. The display service component is used to: forward the two-dimensional image data to the virtual service component.
[0013] Optionally, the 3D ecosystem further includes an application agent. The display service component is used to: pass the 2D image data through to the application agent. The application agent is used to: forward the 2D image data to the virtual service component.
[0014] Optionally, the two-dimensional ecosystem includes an input service component, a two-dimensional kernel component, and an event management component. The virtual service component is further configured to: send two-dimensional application location data corresponding to user operations to the input service component. The input service component is configured to: write the two-dimensional application location data to the two-dimensional kernel component. The two-dimensional kernel component is configured to: send the two-dimensional application location data to the event management component. The event management component is configured to: distribute the two-dimensional application location data to the two-dimensional application.
[0015] Optionally, the three-dimensional ecosystem further includes an application agent. The virtual service component is also configured to: send two-dimensional application location data corresponding to the user operation to the application agent; the application agent is configured to: forward the two-dimensional application location data to the input service component.
[0016] Optionally, the image display system further includes a two-dimensional screen. The virtual service component is further configured to: send the two-dimensional image data to the two-dimensional screen; the two-dimensional screen is configured to: perform a two-dimensional display operation based on the two-dimensional image data.
[0017] According to a second aspect of this application, an image display method is provided, the method comprising: forwarding two-dimensional image data of a two-dimensional application to a three-dimensional rendering service component based on a virtual service component; processing the two-dimensional image data based on the three-dimensional rendering service component to obtain three-dimensional image data; and controlling a three-dimensional screen to perform a three-dimensional display operation based on the three-dimensional image data.
[0018] Optionally, the method further includes: in response to a user operation, sending three-dimensional touch position data corresponding to the user operation to the three-dimensional rendering service component; determining two-dimensional application position data based on the three-dimensional touch position data according to the three-dimensional rendering service component; and forwarding the two-dimensional application position data to the two-dimensional application based on the virtual service component.
[0019] Optionally, determining the two-dimensional application location data based on the three-dimensional touch location data using the three-dimensional rendering service component includes: spatially transforming the three-dimensional touch location data using the three-dimensional rendering service component to obtain two-dimensional touch location data; and determining the two-dimensional application location data using the three-dimensional rendering service component based on the two-dimensional touch location data and the reference location data of the two-dimensional application.
[0020] According to a third aspect of this application, a computer-readable storage medium is provided, on which a computer program or instructions are stored, which, when executed by a processor, implement the image display method described above.
[0021] According to a fourth aspect of this application, a computer program product is provided, comprising a computer program or instructions that, when executed by a processor, implement the image display method described above.
[0022] According to a fifth aspect of this application, an electronic device is provided, comprising: a memory having a computer program or instructions stored thereon; and a processor for executing the computer program or instructions in the memory to implement the image display method as described above.
[0023] According to a sixth aspect of this application, a vehicle is provided, including the image display system described above, or including the electronic equipment described above.
[0024] In summary, this application embodiment adds a virtual service component to the 3D ecosystem to intercept 2D image data from 2D applications and forward it to a 3D rendering service component within the 3D ecosystem. The 3D rendering service component then processes the 2D image data into 3D image data and further controls the 3D screen to perform 3D display operations based on this data. This application embodiment achieves the integration of 2D applications into the 3D ecosystem through the virtual service component, endows 2D image data with 3D display effects through the 3D rendering service component, and presents a 3D world to the user through the 3D screen. This efficiently imparts 3D display effects to 2D applications, avoiding the need to redevelop 2D applications based on the 3D ecosystem, thus reducing development costs. Furthermore, this application embodiment does not require modification of the 2D application to adapt to the 3D ecosystem; modifications are made at the system level, making the application unaware of the changes, further reducing development costs and improving the user experience.
[0025] Other features and advantages of this application will be described in detail in the following detailed description section. Attached Figure Description
[0026] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0027] To gain a more complete understanding of this application and its beneficial effects, the following description will be provided in conjunction with the accompanying drawings, wherein the same reference numerals in the following description denote the same parts.
[0028] Figure 1 This is a schematic diagram of an image display system provided in an embodiment of this application; Figure 2 This is a schematic diagram of another image display system provided in an embodiment of this application; Figure 3 This is a schematic diagram of yet another image display system provided in an embodiment of this application; Figure 4 This is a schematic diagram of a data transfer process provided in an embodiment of this application; Figure 5 This is a schematic diagram of an event flow process provided in an embodiment of this application; Figure 6 This is a schematic diagram of another data flow process provided in an embodiment of this application; Figure 7 This is a schematic diagram of another event flow process provided in an embodiment of this application; Figure 8 This is a schematic diagram of another image display system provided in an embodiment of this application; Figure 9 This is a schematic diagram of a multi-screen broadcast provided in an embodiment of this application; Figure 10 This is a flowchart of an image display method provided in an embodiment of this application; Figure 11 This is a schematic diagram of a vehicle provided in an embodiment of this application. Detailed Implementation
[0029] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.
[0030] According to a first aspect of this application, an embodiment of this application provides an image display system.
[0031] Please see Figure 1 , Figure 1 This is a schematic diagram of an image display system provided in an embodiment of this application. Figure 1 As shown, the image display system includes a three-dimensional ecosystem 100 and a three-dimensional screen 210.
[0032] The 3D ecosystem 100 is developed based on a 3D engine, including but not limited to: Linux, Unity, Blender, OpenSceneGraph (OSG), Three.js, etc. In this embodiment, the 3D ecosystem 100 includes a virtual service component 110 and a 3D rendering service component 120. The virtual service component 110 intercepts 2D image data from 2D applications and forwards it to the 3D rendering service component 120, which then processes the 2D image data.
[0033] Based on this, the virtual service component 110 is used to: forward the two-dimensional image data of the two-dimensional application to the three-dimensional rendering service component 120; the three-dimensional rendering service component 120 is used to: process the two-dimensional image data to obtain three-dimensional image data, and send the three-dimensional image data to the three-dimensional screen 210; the three-dimensional screen 210 is used to: perform three-dimensional display operations based on the three-dimensional image data.
[0034] The three-dimensional screen 210 can be a physical screen, such as a display panel; or it can be a non-physical screen, such as a screen based on technologies such as floating display, virtual reality, augmented reality, and optical levitation display.
[0035] like Figure 1 As shown, the 3D ecosystem 100 also includes a 3D kernel component 140. The 3D rendering service component 120 can interact with the 3D screen 210 through the 3D kernel component 140. For example, the 3D rendering service component 120 can send 3D image data to the 3D screen 210 through the 3D kernel component 140, or the 3D screen 210 can send 3D touch position data to the 3D rendering service component 120 through the 3D kernel component 140. Taking Linux as an example, the 3D kernel component 140 can be the Linux Kernel.
[0036] By processing 2D image data through the 3D rendering service component 120, 2D applications can be given 3D display effects in terms of special effects and animation effects. For example, 3D water ripples and reflections can be added to 2D screens, or 2D applications can be expanded in a 3D manner when they start up, achieving a cooler display effect than 2D.
[0037] This application embodiment adds a virtual service component to the 3D ecosystem to intercept 2D image data from 2D applications and forward it to a 3D rendering service component within the 3D ecosystem. The 3D rendering service component then processes the 2D image data into 3D image data and further controls the 3D screen to perform 3D display operations based on this data. This application embodiment achieves the integration of 2D applications into the 3D ecosystem through the virtual service component, endows 2D image data with 3D display effects through the 3D rendering service component, and presents a 3D world to the user through the 3D screen. This efficiently provides 3D display effects to 2D applications, avoiding the need to redevelop 2D applications based on the 3D ecosystem, thus reducing development costs. Furthermore, this application embodiment does not require modification of the 2D application to adapt to the 3D ecosystem; modifications are made at the system level, making the application unaware of the changes, further reducing development costs and improving the user experience.
[0038] In some embodiments, such as Figure 2 As shown, a two-dimensional application can reside within a three-dimensional ecosystem 100. That is, embodiments of this application can enable two-dimensional access to three-dimensional environments within the same ecosystem. By utilizing three-dimensional components within the same ecosystem, two-dimensional applications are given a three-dimensional display effect, fully utilizing the resources of the three-dimensional ecosystem and improving resource efficiency.
[0039] In some embodiments, such as Figure 3 As shown, the image display system also includes a 2D ecosystem 300, within which 2D applications can reside. The 2D ecosystem 300 includes, but is not limited to, ecosystems such as Android, QT, Flutter, GTK+, Kanzi, ImGUI, KDE, and Windows. In other words, this embodiment enables cross-system 2D access to 3D, achieving cross-system support, broadly supporting existing 2D ecosystems, and exhibiting good compatibility.
[0040] In some embodiments, the two-dimensional ecosystem 300 can be a container for the three-dimensional ecosystem 100. That is, the two-dimensional ecosystem 300 runs within the environment or framework provided by the three-dimensional ecosystem 100, and the three-dimensional ecosystem 100 provides a basic platform for the operation of the two-dimensional ecosystem 300, including but not limited to computing resources, interfaces or windows, user input, etc. When the two-dimensional ecosystem 300 is a container for the three-dimensional ecosystem 100, the two-dimensional ecosystem 300 is more lightweight.
[0041] In some embodiments, the 2D ecosystem 300 is hosted within a virtual machine program generated by the virtualization of the 3D ecosystem 100. The 3D ecosystem 100, as the host system or basic operating system, is the foundation and core of the entire computer system environment, running directly on the computer hardware and managing and scheduling hardware resources. The virtual machine program generated by the virtualization of the 3D ecosystem 100 runs on the 3D ecosystem 100 and is software capable of simulating a complete computer environment, including but not limited to virtual CPUs, memory, and storage devices. The 2D ecosystem 300 can be hosted within a virtual machine program; that is, the 2D ecosystem 300 does not run directly on real hardware but rather in a virtual environment simulated by the virtual machine program. When the 2D ecosystem 300 is hosted within a virtual machine program generated by the virtualization of the 3D ecosystem 100, the system startup sequence is: 3D ecosystem startup, virtual machine program startup, 2D ecosystem startup.
[0042] To achieve image data processing, in some embodiments, such as Figures 1 to 3 As shown, the virtual service component 110 may include a 2D compositor 111, and the 3D rendering service component 120 may include a 3D compositor 121. The 2D compositor 111 is used to: forward 2D image data from a 2D application to the 3D compositor 121. The 3D compositor 121 is used to: process the 2D image data to obtain 3D image data; and send the 3D image data to the 3D screen 210.
[0043] The 2D synthesizer 111 carries the 2D image data of the 2D application and is responsible for forwarding the 2D image data to the 3D synthesizer 121, but does not perform image data synthesis; the 3D synthesizer 121 processes the image data, synthesizes the 2D image data to obtain 3D image data, and then transmits it to the 3D screen 210.
[0044] In order to respond to user operations and realize the interaction between the two-dimensional application and the user, in some embodiments, the three-dimensional screen 210 is also used to: send the three-dimensional touch position data corresponding to the user operation to the three-dimensional rendering service component 120 in response to the user operation; the three-dimensional rendering service component 120 is also used to: determine the two-dimensional application position data according to the three-dimensional touch position data and send the two-dimensional application position data to the virtual service component 110; the virtual service component 110 is also used to: forward the two-dimensional application position data to the two-dimensional application.
[0045] Three-dimensional touch position data refers to the position data of the touch point operated by the user on the three-dimensional screen 210, such as the three-dimensional position coordinates of the touch point. Two-dimensional application position data refers to the relative position data of the touch point in the user interface of a two-dimensional application, such as the two-dimensional position coordinates of the touch point relative to the user interface. In some embodiments, the three-dimensional rendering service component 120 is further used to: perform spatial transformation on the three-dimensional touch position data to obtain two-dimensional touch position data; and determine the two-dimensional application position data based on the two-dimensional touch position data and the reference position data of the two-dimensional application. The two-dimensional application position data can be the difference between the two-dimensional touch position data and the reference position data. The reference position data can be the two-dimensional position coordinates of a reference point in the user interface of the two-dimensional application. This reference point can be any position in the user interface, such as the upper left corner, upper right corner, lower left corner, lower right corner, etc. By setting a reference point and calculating the two-dimensional application position data based on the reference position data, calculation is facilitated, allowing the two-dimensional application to quickly respond to user operation events.
[0046] To achieve a fast and accurate response to user actions, in some embodiments, such as Figures 1 to 3 As shown, the virtual service component 110 includes a two-dimensional window manager 112, and the three-dimensional rendering service component 120 includes a three-dimensional window manager 122. The three-dimensional screen 210 is further configured to: send three-dimensional touch position data corresponding to user operations to the three-dimensional window manager 122. The three-dimensional window manager 122 is further configured to: determine two-dimensional application position data based on the three-dimensional touch position data; and send the two-dimensional application position data to the two-dimensional window manager 112. The two-dimensional window manager 112 is further configured to: forward the two-dimensional application position data to the two-dimensional application.
[0047] The 3D window manager 122 processes and calculates location data to obtain 2D application location data; the 2D window manager 112 is responsible for event dispatch, determining the corresponding 2D application for user operation, and forwarding the 2D application location data to the corresponding 2D application. The 3D window manager 122 can synchronously send the identifier of the 2D application to the 2D window manager 112 so that the 2D window manager 112 can perform event dispatch.
[0048] In this embodiment of the application, when the virtual service component 110 intercepts the two-dimensional image data of the two-dimensional application, it can also synchronously obtain the identifier of the two-dimensional application, so as to synchronously transmit the identifier of the two-dimensional application in subsequent data transmission, so that when the user operation returns the corresponding event, the virtual service component 110 can forward it to the corresponding two-dimensional application according to the identifier of the two-dimensional application, thereby realizing fast and accurate event distribution.
[0049] The following section uses a two-dimensional application located within a three-dimensional ecosystem 100 as an example to illustrate the flow of data and events.
[0050] For example, such as Figure 4 As shown, the two-dimensional application in the three-dimensional ecosystem 100 sends two-dimensional image data to the two-dimensional synthesizer 111, which forwards the two-dimensional image data to the three-dimensional synthesizer 121. The three-dimensional synthesizer 121 synthesizes the two-dimensional image data to obtain three-dimensional image data, which is then passed to the three-dimensional screen 210 to present a three-dimensional world to the user.
[0051] For example, such as Figure 5 As shown, the 3D screen 210 responds to user operations by acquiring the 3D touch position data corresponding to the user operation and forwarding it to the 3D window manager 122. The 3D window manager 122 calculates the 2D application position data based on the 3D touch position data and the reference position data of the 2D application, and then passes it to the 2D window manager 112. The 2D window manager 112 is then responsible for event distribution, forwarding the 2D application position data to the corresponding 2D application so that the 2D application can respond to the event corresponding to the user operation and realize interaction.
[0052] The following section uses a two-dimensional application located in the two-dimensional ecosystem 300 as an example to illustrate the flow of data and events.
[0053] In some embodiments, such as Figure 3 As shown, the 2D ecosystem 300 includes a composition service component 310 and a display service component 320. The composition service component 310 is used to: generate 2D image data for 2D applications; and send the 2D image data to the display service component 320. The display service component 320 is used to: forward the 2D image data to the virtual service component 110. Taking the 2D ecosystem 300 as an Android system as an example, the composition service component 310 can be implemented as SurfaceFlinger, and the display service component 320 can be implemented as android_virtual_display_service.
[0054] This application embodiment adds a display service component 320 to the two-dimensional ecosystem 300 to forward two-dimensional image data to the three-dimensional ecosystem 100, enabling two-dimensional applications in the two-dimensional ecosystem 300 to access the three-dimensional ecosystem 100 across systems.
[0055] In some embodiments, such as Figure 3As shown, the 3D ecosystem 100 also includes an application agent 130. The display service component 320 is used to: pass through 2D image data to the application agent 130. The application agent 130 is used to: forward 2D image data to the virtual service component 110. By adding the application agent 130 to the 3D ecosystem 100, relevant data can be relayed between the 2D ecosystem 300 and the 3D ecosystem 100, improving system security and reliability and preventing malicious access to the 3D ecosystem 100. Taking the 2D ecosystem 300 as an Android system as an example, the application agent 130 can act as an Android Automotive OS Agent (AAOS). The application agent 130 can be understood as a buffer for 2D applications; it does not generate data itself but receives and forwards 2D image data from 2D applications.
[0056] To achieve responsiveness to user actions, in some embodiments, such as Figure 3 As shown, the 2D ecosystem 300 includes an input service component 330, a 2D kernel component 340, and an event management component 350. The virtual service component 110 is further configured to: send 2D application location data corresponding to user operations to the input service component 330. The input service component 330 is configured to: write the 2D application location data to the 2D kernel component 340. The 2D kernel component 340 is configured to: send the 2D application location data to the event management component 350. The event management component 350 is configured to: distribute the 2D application location data to 2D applications.
[0057] Taking the two-dimensional ecosystem 300 as an example of the Android system, the input service component 330 can be implemented as android_virtual_input_service, the kernel component 340 can be implemented as / dev / input / eventx, and the event management component 350 can be implemented as input manager.
[0058] In this embodiment, after the 3D rendering service component 120 in the 3D ecosystem 100 calculates the 2D application location data, the virtual service component 110 forwards the 2D application location data to the 2D ecosystem 300. To ensure system security, the 3D ecosystem 100 also includes an application agent 130; the virtual service component 110 is further used to: send the 2D application location data corresponding to the user operation to the application agent 130; the application agent 130 is used to: forward the 2D application location data to the input service component 330. Then, the input service component 330 writes the 2D application location data into the 2D kernel component 340, and then, based on the native event distribution mechanism of the event management component 350 in the 2D ecosystem 300, passes the 2D application location data to the corresponding 2D application. The 2D kernel component 340, as an intermediate layer between the input service component 330 and the event management component 350, can perform multiple functions such as interface adaptation, buffering, and synchronization.
[0059] For example, such as Figure 6 As shown, the compositing service component 310 in the 2D ecosystem 300 generates 2D image data for the 2D application and sends it to the display service component 320; the display service component 320 transmits the 2D image data to the application agent 130, which forwards the 2D image data to the 2D compositor 111; the 2D compositor 111 then forwards the 2D image data to the 3D compositor 121; the 3D compositor 121 composites the 2D image data to obtain 3D image data, and then transmits it to the 3D screen 210, thereby presenting a 3D world to the user.
[0060] For example, such as Figure 7 As shown, the 3D screen 210 responds to user operations by acquiring the 3D touch position data corresponding to the user operation and forwarding it to the 3D window manager 122. The 3D window manager 122 calculates the 2D application position data based on the 3D touch position data and the reference position data of the 2D application, and then passes it to the 2D window manager 112. The 2D window manager 112 further passes the 2D application position data to the input service component 330 in the 2D ecosystem 300 through the application agent program 130, so as to write it into the 2D kernel component 340. Then, based on the native event distribution mechanism of the event management component 350, the corresponding 2D application is determined, and the 2D application position data is sent to the 2D application so that the 2D application can respond to the event corresponding to the user operation and realize interaction.
[0061] In some embodiments, such as Figure 8As shown, the image display system also includes a two-dimensional screen 220. The virtual service component 110 is further configured to send two-dimensional image data to the two-dimensional screen 220. The two-dimensional screen 220 is configured to perform two-dimensional display operations based on the two-dimensional image data. The two-dimensional screen 220 can be a physical screen, such as one including a display panel; or it can be a non-physical screen, such as a screen based on technologies like levitation display, virtual reality, augmented reality, or optical levitation display.
[0062] In this embodiment of the application, a two-dimensional screen 220 is also provided in the image display system. The two-dimensional image data of the two-dimensional application is transmitted to the two-dimensional screen 220, thereby achieving a conventional two-dimensional display effect. By combining the display of the two-dimensional screen 220 and the three-dimensional screen 210, this embodiment of the application can realize multi-screen simultaneous display of the screen of the two-dimensional application, and simultaneously present the two-dimensional world and the three-dimensional world, enriching the screen display effect.
[0063] For example, such as Figure 9 As shown, after the 2D synthesizer 111 in the virtual service component 110 intercepts the 2D image data of the 2D application, on the one hand, the 2D synthesizer 111 forwards the 2D image data to the 3D synthesizer 121 so that the 3D synthesizer 121 generates 3D image data based on the 2D image data and transmits it to the 3D screen 210 to present the 3D world to the user; on the other hand, the 2D synthesizer 111 directly transmits the 2D image data to the 2D screen 220 to present the 2D world to the user.
[0064] It should be understood that, in this embodiment of the application, although the virtual service component 110 does not perform image data synthesis or other processing, but is used to forward two-dimensional image data, two-dimensional application location data and other data related to two-dimensional applications, in order to achieve interface adaptation, ensure correct data parsing and processing, data synchronization and integration, security, etc., the virtual service component 110 can perform format conversion on the relevant data to ensure compliance with specific protocols, such as the Wayland protocol (window management protocol).
[0065] According to a second aspect of this application, embodiments of this application provide an image display method.
[0066] Please see Figure 10 , Figure 10 This is a schematic diagram of an image display method provided in an embodiment of this application. This image display method can be executed by the aforementioned image display system. Figure 10 As shown, the image display method may include the following steps S1010 to S1030.
[0067] Step S1010: Based on the virtual service component, forward the 2D image data of the 2D application to the 3D rendering service component.
[0068] Step S1020: Based on the 3D rendering service component, process the 2D image data to obtain 3D image data.
[0069] Step S1030: Control the 3D screen to perform 3D display operations based on the 3D image data.
[0070] In some embodiments, the virtual service component includes a 2D compositor, and the 3D rendering service component includes a 3D compositor; step S1010 includes: forwarding 2D image data of a 2D application to the 3D compositor based on the 2D compositor; step S1020 includes: processing the 2D image data based on the 3D compositor to obtain 3D image data.
[0071] In some embodiments, the image display method further includes: in response to a user operation, sending three-dimensional touch position data corresponding to the user operation to a three-dimensional rendering service component; determining two-dimensional application position data based on the three-dimensional touch position data using the three-dimensional rendering service component; and forwarding the two-dimensional application position data to the two-dimensional application using a virtual service component.
[0072] In some embodiments, the above-mentioned determination of two-dimensional application location data based on three-dimensional touch location data using a three-dimensional rendering service component includes: spatially transforming the three-dimensional touch location data using a three-dimensional rendering service component to obtain two-dimensional touch location data; and determining the two-dimensional application location data based on the two-dimensional touch location data and reference location data of the two-dimensional application using a three-dimensional rendering service component.
[0073] In some embodiments, the virtual service component includes a two-dimensional window manager, and the three-dimensional rendering service component includes a three-dimensional window manager; the above-mentioned sending three-dimensional touch position data corresponding to the user operation to the three-dimensional rendering service component includes: sending three-dimensional touch position data corresponding to the user operation to the three-dimensional window manager; the above-mentioned determining two-dimensional application position data based on the three-dimensional touch position data according to the three-dimensional rendering service component includes: determining two-dimensional application position data based on the three-dimensional touch position data according to the three-dimensional window manager; the above-mentioned forwarding two-dimensional application position data to the two-dimensional application based on the virtual service component includes: forwarding two-dimensional application position data to the two-dimensional application based on the two-dimensional window manager.
[0074] In some embodiments, the two-dimensional application resides within a three-dimensional ecosystem.
[0075] In some embodiments, the 2D application resides within a 2D ecosystem.
[0076] In some embodiments, a two-dimensional ecosystem is a container for a three-dimensional ecosystem.
[0077] In some embodiments, the two-dimensional ecosystem is hosted in a virtual machine program generated by the virtualization of the three-dimensional ecosystem.
[0078] In some embodiments, the two-dimensional ecosystem includes a synthesis service component and a display service component; the image display method further includes: generating two-dimensional image data of a two-dimensional application based on the synthesis service component; and forwarding the two-dimensional image data to a virtual service component based on the display service component.
[0079] In some embodiments, the 3D ecosystem further includes an application agent; the above-mentioned forwarding of 2D image data to the virtual service component based on the display service component includes: passing the 2D image data through to the application agent based on the display service component; and forwarding the 2D image data to the virtual service component based on the application agent.
[0080] In some embodiments, the two-dimensional ecosystem includes an input service component, a two-dimensional kernel component, and an event management component; the above image display method further includes: sending two-dimensional application location data corresponding to user operations to the input service component based on the virtual service component; writing the two-dimensional application location data to the two-dimensional kernel component based on the input service component; sending the two-dimensional application location data to the event management component based on the two-dimensional kernel component; and distributing the two-dimensional application location data to the two-dimensional application based on the event management component.
[0081] In some embodiments, the 3D ecosystem further includes an application agent; the above-mentioned sending two-dimensional application location data corresponding to user operations to the input service component based on the virtual service component includes: sending two-dimensional application location data corresponding to user operations to the application agent based on the virtual service component; and forwarding the two-dimensional application location data to the input service component based on the application agent.
[0082] In some embodiments, the image display system further includes a two-dimensional screen; the image display method further includes controlling the two-dimensional screen to perform a two-dimensional display operation based on the two-dimensional image data.
[0083] The above image display method is executed by the image display system. For a description of each step in the image display method and its beneficial effects, please refer to the description of the image display system in the above embodiments, which will not be repeated here.
[0084] According to a third aspect of this application, embodiments of this application also provide a computer-readable storage medium storing a computer program or instructions that, when executed by a processor, implement the above-described image display method and have all the beneficial effects of the above-described image display method, which will not be elaborated further here.
[0085] According to a fourth aspect of this application, embodiments of this application also provide a computer program product, including a computer program or instructions, which, when executed by a processor, implement the above-described image display method and have all the beneficial effects of the above-described image display method, which will not be elaborated further here.
[0086] According to a fifth aspect of this application, embodiments of this application also provide an electronic device, including: a memory and a processor, wherein the memory stores a computer program or instructions; the processor is configured to execute the computer program or instructions in the memory to implement the steps of the above-described image display method. This electronic device possesses all the beneficial effects of the above-described image display method, which will not be elaborated upon further herein.
[0087] Computer-readable storage media can be, for example, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof, without particular limitation herein. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0088] In some embodiments of this application, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used or combined with an instruction execution system, apparatus, or device.
[0089] The aforementioned computer-readable storage medium may be included in the aforementioned electronic device or may exist independently without being assembled into the electronic device.
[0090] Computer program code for performing operations of some embodiments of this application can be written in one or more programming languages or a combination thereof. These programming languages include object-oriented programming languages such as Java, Smalltalk, and C++, as well as conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network (including a Local Area Network (LAN) or a Wide Area Network (WAN)), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0091] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function.
[0092] It should also be noted that in some alternative implementations, the functions marked in the box may occur in a different order than those marked in the attached figures.
[0093] For example, two consecutively represented blocks can actually be executed in substantially parallel order, and sometimes they can be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, as well as combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified functions or operations, or using a combination of dedicated hardware and computer instructions.
[0094] The units described in some embodiments of this application can be implemented in software or in hardware. The described units can also be located in a processor.
[0095] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Parts (ASSP), System on Chip (SOC), Complex Programmable Logic Device (CPLD), and so on.
[0096] According to the sixth aspect of this application, such as Figure 11 As shown, this application also provides a vehicle 10, which includes the aforementioned electronic equipment or the aforementioned image display system. This vehicle possesses all the beneficial effects of the aforementioned electronic equipment and image display system, etc., which will not be elaborated upon here.
[0097] The vehicle may be a gasoline-powered vehicle, a plug-in hybrid electric vehicle, or a new energy vehicle, etc., and this application does not make any specific restrictions.
[0098] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.
[0099] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.
[0100] The embodiments, implementation methods, and related technical features of this application can be combined and substituted for each other without conflict.
[0101] The above are merely preferred embodiments of this application and are not intended to limit this application in any way. Although the descriptions of each embodiment in this application have different focuses, and parts not described in detail in a certain embodiment can be referred to the relevant descriptions of other embodiments, any simple modifications, equivalent changes and alterations made to the above embodiments based on the technical essence of this application without departing from the content of the technical solution of this application shall still fall within the scope of the technical solution of this application.
Claims
1. An image display system, characterized by comprising: The image display system comprises a three-dimensional ecosystem (100) and a three-dimensional screen (210), the three-dimensional ecosystem (100) comprising a virtual service component (110) and a three-dimensional rendering service component (120); wherein, the virtual service component (110) is configured to forward two-dimensional image data of a two-dimensional application to the three-dimensional rendering service component (120); the three-dimensional rendering service component (120) is configured to process the two-dimensional image data to obtain three-dimensional image data, and send the three-dimensional image data to the three-dimensional screen (210); the three-dimensional screen (210) is configured to perform a three-dimensional display operation according to the three-dimensional image data.
2. The system of claim 1, wherein, The virtual service component (110) comprises a two-dimensional compositor (111), and the three-dimensional rendering service component (120) comprises a three-dimensional compositor (121); wherein, the two-dimensional compositor (111) is configured to forward two-dimensional image data of a two-dimensional application to the three-dimensional compositor (121); the three-dimensional compositor (121) is configured to process the two-dimensional image data to obtain three-dimensional image data, and send the three-dimensional image data to the three-dimensional screen (210).
3. The system of claim 1, wherein, the three-dimensional screen (210) is further configured to send three-dimensional touch position data corresponding to the user operation to the three-dimensional rendering service component (120) in response to the user operation; the three-dimensional rendering service component (120) is further configured to determine two-dimensional application position data according to the three-dimensional touch position data, and send the two-dimensional application position data to the virtual service component (110); the virtual service component (110) is further configured to forward the two-dimensional application position data to the two-dimensional application.
4. The system of claim 3, wherein, The virtual service component (110) comprises a two-dimensional window manager (112), and the three-dimensional rendering service component (120) comprises a three-dimensional window manager (122); wherein, the three-dimensional screen (210) is further configured to send three-dimensional touch position data corresponding to the user operation to the three-dimensional window manager (122); the three-dimensional window manager (122) is further configured to determine two-dimensional application position data according to the three-dimensional touch position data, and send the two-dimensional application position data to the two-dimensional window manager (112); the two-dimensional window manager (112) is further configured to forward the two-dimensional application position data to the two-dimensional application.
5. The system of claim 1, wherein, The two-dimensional application is located in the three-dimensional ecosystem (100).
6. The system of claim 1, wherein, The image display system further comprises a two-dimensional ecosystem (300), and the two-dimensional application is located in the two-dimensional ecosystem (300).
7. The system of claim 6, wherein, The two-dimensional ecosystem (300) comprises a composition service component (310) and a display service component (320); wherein, the composition service component (310) is configured to generate two-dimensional image data of a two-dimensional application, and send the two-dimensional image data to the display service component (320); the display service component (320) is configured to perform a two-dimensional display operation according to the two-dimensional image data. The display service component (320) is configured to forward the two-dimensional image data to the virtual service component (110).
8. The system of claim 6, wherein, The two-dimensional ecosystem (300) comprises an input service component (330), a two-dimensional kernel component (340), and an event management component (350); wherein, The virtual service component (110) is further configured to send two-dimensional application position data corresponding to a user operation to the input service component (330); The input service component (330) is configured to write the two-dimensional application position data to the two-dimensional kernel component (340); The two-dimensional kernel component (340) is configured to send the two-dimensional application position data to the event management component (350); The event management component (350) is configured to distribute the two-dimensional application position data to the two-dimensional application program.
9. The system of claim 1, wherein, The image display system further comprises a two-dimensional screen (220); wherein, The virtual service component (110) is further configured to send the two-dimensional image data to the two-dimensional screen (220); The two-dimensional screen (220) is configured to perform a two-dimensional display operation according to the two-dimensional image data.
10. An image display method characterized by The method comprises: forwarding, based on a virtual service component, two-dimensional image data of a two-dimensional application program to a three-dimensional rendering service component; processing, based on the three-dimensional rendering service component, the two-dimensional image data to obtain three-dimensional image data; controlling a three-dimensional screen to perform a three-dimensional display operation according to the three-dimensional image data.
11. The method of claim 10, wherein, The method further comprises: in response to a user operation, sending three-dimensional touch position data corresponding to the user operation to the three-dimensional rendering service component; determining, based on the three-dimensional rendering service component, two-dimensional application position data according to the three-dimensional touch position data; forwarding, based on the virtual service component, the two-dimensional application position data to the two-dimensional application program.
12. A computer readable storage medium having stored thereon a computer program or instructions, characterized in that, The computer program or instructions, when executed by a processor, implement the image display method of claim 10 or 11.
13. A computer program product comprising computer programs or instructions, characterized in that, The computer program or instructions, when executed by a processor, implement the image display method of claim 10 or 11.
14. An electronic device, comprising: comprise: a memory having stored thereon computer programs or instructions; a processor configured to execute the computer programs or instructions in the memory to implement the image display method of claim 10 or 11.
15. A vehicle characterized by comprising: The vehicle comprises the image display system of any one of claims 1 to 9, or the electronic device of claim 14.