A screen projection method and device based on a virtual screen of a vehicle machine, a vehicle machine device, and a vehicle
Patent Information
- Application Number
- CN202211566904.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-07
- Publication Date
- 2026-09-15
- Estimated Expiration
- 2042-12-07
AI Technical Summary
[0003]但是,在实际应用中发现,由于市面上车企较多,各种车型车机屏幕大小不一、分辨率/屏幕像素密度不同,且未适配应用本身可能不支持自适应或者对自适应支持有限,导致未适配应用在不同分辨率的车机虚拟屏上表现不尽相同,部分界面可能存在异常,比如界面元素重叠、错乱、溢出,功能可用性较差,投屏效果差,直接影响到用户体验
[0063] In this embodiment, after the vehicle-mounted device connects to the terminal device, it receives a screen projection command from the terminal device. This command carries projection data for the unadapted application. When the unadapted application is one that does not support full-screen adaptive display, a target virtual screen is created based on the expected screen parameters of the vehicle-mounted virtual screen and the application group to which the unadapted application belongs. Then, the projection data of the unadapted application is displayed on the target virtual screen. By implementing this embodiment, a virtual screen can be created by combining the expected screen parameters without intruding on the unadapted application, ensuring that the unadapted application can be displayed normally on vehicle-mounted screens of different resolutions. This improves the integrity and usability of the unadapted application display, allowing the unadapted application to obtain an almost consistent visual experience and interactive experience on all vehicle-mounted devices.
Smart Images

Figure CN116204144B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle-machine interconnection technology, and in particular to a projection method, device, vehicle-machine equipment and vehicle based on a vehicle virtual screen. Background Technology
[0002] With the development of vehicle-to-everything (V2X) technology, users' demands for mobility products are no longer limited to calls, navigation, and music; they also increasingly require diverse applications for entertainment, leisure, and work. However, some third-party applications on mobile phones face difficulties in integration with in-vehicle systems. To enhance the core competitiveness and user experience of various mobility products, some have provided the ability to support uncompatible applications running on the in-vehicle screen. A common technique is to directly launch uncompatible mobile applications in full-screen mode on the in-vehicle virtual screen.
[0003] However, in practical applications, it has been found that due to the large number of car manufacturers on the market, the screen sizes, resolutions / screen pixel densities of various car models are different, and the unadapted applications themselves may not support adaptation or have limited support for adaptation. As a result, the unadapted applications perform differently on the virtual screens of the car's infotainment system at different resolutions. Some interfaces may have abnormalities, such as overlapping, disordered, or overflowing interface elements, poor functional usability, and poor screen projection effect, which directly affects the user experience. Summary of the Invention
[0004] This application discloses a screen projection method, device, vehicle equipment, and vehicle based on a vehicle-mounted virtual screen, which can achieve complete screen projection on vehicle-mounted systems with different screen resolutions that are not adapted to the application, ensuring the projection effect and improving the user experience.
[0005] The first aspect of this application discloses a screen projection method based on a vehicle-mounted virtual screen, which may include:
[0006] After the vehicle-mounted device connects to the terminal device, it receives a screen projection command from the terminal device, which carries screen projection data for applications that are not compatible.
[0007] When the unadapted application is one that does not support full-screen adaptive display, a target virtual screen is created based on the expected screen parameters of the vehicle's virtual screen and the application group to which the unadapted application belongs;
[0008] The projection data is displayed on the target virtual screen.
[0009] As an optional implementation, in the first aspect of the embodiments of this application, when the unadapted application is an application that does not support full-screen adaptive display, and before creating the target virtual screen based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs, the method further includes:
[0010] Determine whether the target virtual screen has already been created;
[0011] If not, proceed with the step of creating a target virtual screen based on the expected screen parameters of the vehicle's virtual screen and the application group to which the unadapted application belongs.
[0012] As an optional implementation, in the first aspect of the embodiments of this application, the method further includes:
[0013] If the target virtual screen has already been created, reuse the target virtual screen to display the projection data on the target virtual screen.
[0014] As an optional implementation, in the first aspect of the embodiments of this application, creating a target virtual screen based on the vehicle-mounted virtual screen and the expected screen parameters of the application group to which the unadapted application belongs includes:
[0015] Obtain the expected screen parameters of the application group to which the unadapted application belongs, wherein the expected screen parameters include at least the expected screen width, the expected screen height, and the expected screen pixel density;
[0016] Create a target virtual screen based on the expected screen parameters;
[0017] Place the target virtual screen in a display container of the same size;
[0018] The scaling factor of the display container is calculated based on the screen resolution of the vehicle's virtual screen;
[0019] The display container is scaled according to the scaling factor;
[0020] Move the scaled display container to fully display the target virtual screen on the vehicle's virtual screen;
[0021] Inject the touch events of the vehicle's virtual screen into the target virtual screen.
[0022] As an optional implementation, in the first aspect of the embodiments of this application, calculating the scaling factor of the display container based on the screen resolution of the vehicle-mounted virtual screen includes:
[0023] Obtain the actual screen parameters of the vehicle's virtual screen, wherein the actual screen parameters include at least the actual screen width and the actual screen height;
[0024] Based on the actual screen parameters, calculate the aspect ratio of the actual application area of the vehicle virtual screen;
[0025] Calculate the aspect ratio of the expected screen resolution based on the expected screen parameters;
[0026] The scaling factor of the display container is calculated based on the actual screen parameters, the expected screen parameters, the aspect ratio of the actual application area, and the aspect ratio of the expected screen resolution.
[0027] As an optional implementation, in a first aspect of this application, the moving and scaling of the display container to fully display the target virtual screen on the vehicle-mounted virtual screen includes:
[0028] Calculate the horizontal and vertical translation amounts based on the expected screen parameters and the scaling factor;
[0029] Based on the horizontal and vertical translation amounts, the scaled display container is moved to the center of the vehicle-mounted virtual screen to fully display the target virtual screen on the vehicle-mounted virtual screen.
[0030] As an optional implementation, in the first aspect of the embodiments of this application, injecting the touch events of the vehicle-mounted virtual screen into the target virtual screen includes:
[0031] Listen for touch events on the vehicle's virtual screen;
[0032] Obtain the coordinates of the touch events on the vehicle's virtual screen;
[0033] The touch event coordinates are scaled according to the scaling factor.
[0034] The processed touch event coordinates are injected into the target virtual screen.
[0035] As an optional implementation, in the first aspect of the embodiments of this application, the method further includes:
[0036] When the unadapted application is one that supports full-screen adaptive display, the projection data is directly displayed on the vehicle's virtual screen.
[0037] The second aspect of this application discloses a screen projection device based on a vehicle-mounted virtual screen, which may include:
[0038] The receiving module is used to receive the screen projection instruction from the terminal device after the vehicle-mounted device and the terminal device are connected. The screen projection instruction carries screen projection data that is not adapted to the application.
[0039] A creation module is used to create a target virtual screen based on the vehicle virtual screen and the expected screen parameters of the application group to which the unadapted application belongs when the unadapted application does not support full-screen adaptive display.
[0040] The startup module is used to display the projection data on the target virtual screen.
[0041] As an optional implementation, in a second aspect of the embodiments of this application, the apparatus further includes:
[0042] The judgment module is used to determine whether the target virtual screen has been created when the unadapted application is an application that does not support full-screen adaptive display, and before the creation module creates the target virtual screen based on the vehicle virtual screen and the expected screen parameters of the application group to which the unadapted application belongs.
[0043] The creation module is specifically used to create a target virtual screen based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs when the judgment result of the judgment module is negative.
[0044] As an optional implementation, in the second aspect of the embodiments of this application, the startup module is further configured to reuse the target virtual screen to display the projection data on the target virtual screen when the judgment result of the judgment module is that the target virtual screen has been created.
[0045] As an optional implementation, in the second aspect of the embodiments of this application, the method by which the creation module creates a target virtual screen based on the vehicle-mounted virtual screen and the expected screen parameters of the application group to which the unadapted application belongs is as follows:
[0046] The system acquires the expected screen parameters of the application group to which the unadapted application belongs, the expected screen parameters including at least the expected screen width, expected screen height, and expected screen pixel density; creates a target virtual screen based on the expected screen parameters; places the target virtual screen in a display container of the same size; calculates a scaling factor for the display container based on the screen resolution of the vehicle infotainment virtual screen; scales the display container based on the scaling factor; moves the scaled display container to fully display the target virtual screen on the vehicle infotainment virtual screen; and injects touch events from the vehicle infotainment virtual screen into the target virtual screen.
[0047] As an optional implementation, in the second aspect of the embodiments of this application, the method by which the creation module calculates the scaling factor of the display container based on the screen resolution of the vehicle-mounted system is specifically as follows:
[0048] Obtain the actual screen parameters of the vehicle infotainment virtual screen, which include at least the actual screen width and the actual screen height; calculate the aspect ratio of the actual application area of the vehicle infotainment virtual screen based on the actual screen parameters; calculate the aspect ratio of the expected screen resolution based on the expected screen parameters; and calculate the scaling factor of the display container based on the actual screen parameters, the expected screen parameters, the aspect ratio of the actual application area, and the aspect ratio of the expected screen resolution.
[0049] As an optional implementation, in the second aspect of the embodiments of this application, the method by which the creation module moves the scaled display container to fully display the target virtual screen on the vehicle-mounted virtual screen is specifically as follows:
[0050] Based on the expected screen parameters and the scaling factor, calculate the horizontal and vertical translation amounts; and based on the horizontal and vertical translation amounts, move the scaled display container to the center position of the vehicle virtual screen to fully display the target virtual screen on the vehicle virtual screen.
[0051] As an optional implementation, in the second aspect of the embodiments of this application, the method by which the creation module injects the touch events of the vehicle-mounted virtual screen into the target virtual screen is specifically as follows:
[0052] Listen for touch events on the vehicle's virtual screen; obtain the touch event coordinates of the vehicle's virtual screen; scale the touch event coordinates according to the scaling factor; and inject the processed touch event coordinates into the target virtual screen.
[0053] A third aspect of this application discloses a vehicle infotainment system, which may include:
[0054] Memory containing executable program code;
[0055] A processor coupled to the memory;
[0056] The processor calls the executable program code stored in the memory to execute a screen projection method based on a vehicle-mounted virtual screen disclosed in the first aspect of the present invention.
[0057] A fourth aspect of this application discloses a vehicle that may include:
[0058] The vehicle-mounted equipment disclosed in the third aspect of the embodiments of this application.
[0059] The fifth aspect of this application discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute a screen projection method based on a vehicle-mounted virtual screen disclosed in the first aspect of this invention.
[0060] The sixth aspect of this application discloses a computer program product that, when run on a computer, causes the computer to perform some or all of the steps of any of the methods of the first aspect.
[0061] The seventh aspect of this application discloses an application publishing platform for publishing computer program products, wherein when the computer program products are run on a computer, the computer performs some or all of the steps of any of the methods of the first aspect.
[0062] Compared with the prior art, the embodiments of this application have the following beneficial effects:
[0063] In this embodiment, after the vehicle-mounted device connects to the terminal device, it receives a screen projection command from the terminal device. This command carries projection data for the unadapted application. When the unadapted application is one that does not support full-screen adaptive display, a target virtual screen is created based on the expected screen parameters of the vehicle-mounted virtual screen and the application group to which the unadapted application belongs. Then, the projection data of the unadapted application is displayed on the target virtual screen. By implementing this embodiment, a virtual screen can be created by combining the expected screen parameters without intruding on the unadapted application, ensuring that the unadapted application can be displayed normally on vehicle-mounted screens of different resolutions. This improves the integrity and usability of the unadapted application display, allowing the unadapted application to obtain an almost consistent visual experience and interactive experience on all vehicle-mounted devices. Attached Figure Description
[0064] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0065] Figure 1 This is a schematic diagram illustrating an application scenario of the screen projection method based on the vehicle-mounted virtual screen disclosed in this application.
[0066] Figure 2 This is a flowchart illustrating the screen projection method based on the vehicle-mounted virtual screen disclosed in Embodiment 1 of this application;
[0067] Figure 3 This is a schematic flowchart of the screen projection method based on the vehicle-mounted virtual screen disclosed in Embodiment 2 of this application;
[0068] Figure 4 This is a flowchart illustrating the screen projection method based on the vehicle-mounted virtual screen disclosed in Embodiment 3 of this application;
[0069] Figure 5 This is a schematic diagram of the in-vehicle virtual screen disclosed in an embodiment of this application;
[0070] Figure 6 This is a schematic diagram of the target virtual screen disclosed in Embodiment 1 of this application;
[0071] Figure 7 This is a schematic diagram of the target virtual screen after scaling, as disclosed in Embodiment 2 of this application;
[0072] Figure 8 This is a schematic diagram of the target virtual screen disclosed in Embodiment 3 of this application;
[0073] Figure 9 This is a schematic diagram of the projection device based on the vehicle-mounted virtual screen disclosed in Embodiment 1 of this application;
[0074] Figure 10 This is a schematic diagram of the projection device based on the vehicle-mounted virtual screen disclosed in Embodiment 2 of this application;
[0075] Figure 11 This is a schematic diagram of the structure of the vehicle-mounted equipment disclosed in the embodiments of this application;
[0076] Figure 12 This is a schematic diagram of the vehicle structure disclosed in an embodiment of this application. Detailed Implementation
[0077] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0078] It should be noted that the terms "first," "second," "third," and "fourth," etc., used in the specification and claims of this application are used to distinguish different objects, not to describe a specific order. The terms "comprising" and "having," and any variations thereof, in the embodiments of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products, or devices.
[0079] The terminal devices involved in the embodiments of this application can be electronic devices such as smartphones, wearable devices (smart bracelets, smartwatches, etc.), and tablet computers.
[0080] In this application, "unadapted applications" refers to third-party applications on terminal devices that have not been integrated with the in-vehicle infotainment system. This means the third-party application vendor and the vehicle manufacturer have not yet pre-integrated the third-party application to meet the vehicle manufacturer's planning or requirements for adaptive full-screen display on the virtual screen of the in-vehicle infotainment system. Therefore, in this application, unadapted applications are divided into three groups: applications that support adaptive full-screen display, applications that only support landscape display, and applications that only support portrait display. Applications that only support landscape display and applications that only support portrait display are also collectively referred to as applications that do not support adaptive full-screen display. For applications that only support landscape display, they can be directly displayed in full-screen mode on the vehicle's virtual screen. For applications that only support landscape display, in this embodiment, it is necessary to pre-set the corresponding expected screen parameters based on the characteristics of the application group to which the application belongs, i.e., the characteristic of only supporting landscape mode, and combine them with the vehicle's virtual screen to create a target virtual screen suitable for display, and then display the application on the target virtual screen. For applications that only support portrait mode, in this embodiment, it is necessary to pre-set the corresponding expected screen parameters based on the characteristics of the application group to which the application belongs, i.e., the characteristic of only supporting portrait mode, and combine them with the vehicle's virtual screen to create a target virtual screen suitable for display, and then display the application on the target virtual screen. The expected screen parameters for the application group to which the application only supports landscape mode is located are different from the expected screen parameters for the application group to which the application only supports portrait mode is located.
[0081] For further details, please refer to Figure 1 , Figure 1 This is a schematic diagram illustrating an application scenario of the screen projection method based on the vehicle-mounted virtual screen disclosed in the embodiments of this application; as follows: Figure 1 As shown, the vehicle's infotainment system and smartphones can establish a communication link via Wi-Fi, Bluetooth, or other means. Based on this connection, the smartphone can further extend the capabilities of the vehicle's infotainment head unit (IHU) by projecting smartphone applications onto the vehicle's virtual screen. This allows the vehicle to not only provide navigation, radio, audio and video playback, but also enable online work and access to work meetings.
[0082] Furthermore, the virtual screen sizes, resolutions, and pixel densities of in-vehicle infotainment systems vary across different automakers. For non-adapted applications that support adaptive full-screen display, the projection data can be directly displayed on the in-vehicle infotainment system's virtual screen. Applications that only support landscape or portrait modes can be considered as not supporting full-screen adaptive display. Upon receiving a projection command from a smartphone, a target virtual screen is created based on the in-vehicle virtual screen and the expected screen of the application group to which the non-adapted application belongs. The projection data of the non-adapted application is then displayed on this target virtual screen. This allows for the creation of a target virtual screen based on preset expected screen parameters without intruding on the non-adapted application, ensuring that the non-adapted application can display correctly on in-vehicle screens of different resolutions. This improves the integrity and usability of the non-adapted application display, providing a nearly consistent visual experience and interactive feel across all in-vehicle infotainment systems.
[0083] Based on the above description, this application discloses a screen projection method, device, vehicle device, and storage medium based on a vehicle-mounted virtual screen. This enables complete screen projection on vehicle-mounted virtual screens with different screen resolutions that are not adapted to the application, ensuring projection effect and improving user experience.
[0084] The technical solution of this application will be described in detail below through specific embodiments.
[0085] Please see Figure 2 , Figure 2 This is a flowchart illustrating the screen projection method based on the vehicle-mounted virtual screen disclosed in Embodiment 1 of this application; as shown... Figure 2 As shown, the screen projection method based on the vehicle's virtual screen may include:
[0086] 201. After the vehicle-mounted device is connected to the terminal device, it receives the screen projection command from the terminal device, which carries the screen projection data of the application that is not adapted.
[0087] In this application embodiment, the execution subject can be a projection device based on the vehicle virtual screen or a vehicle device. The projection device based on the vehicle virtual screen can be independent of the vehicle device or it can be a module built into the vehicle device.
[0088] The terminal device can receive connection requests from the in-vehicle infotainment system and establish a communication link accordingly. Similarly, the in-vehicle infotainment system can also receive connection requests from the terminal device and establish a communication link accordingly. For example, the terminal device can receive a connection request from the in-vehicle infotainment system via Bluetooth or Wi-Fi, or send a connection request to the in-vehicle infotainment system via Bluetooth, Wi-Fi, or QR code scanning. Therefore, when a communication link needs to be established between the terminal device and the in-vehicle infotainment system, a connection request can be sent from the in-vehicle infotainment system to the terminal device, or vice versa, thus quickly establishing a communication link between the two devices.
[0089] After the vehicle infotainment system and the terminal device establish a communication link, the vehicle infotainment system will create a virtual screen. Then, if it receives a screen mirroring command from the terminal device, it will mirror the uncompatible application indicated by the command onto the virtual screen for display.
[0090] Based on the above description, the unadapted applications are divided into three types: applications that support adaptive full-screen display, applications that only support landscape display, and applications that only support portrait display. For applications that only support landscape and portrait display, their respective expected screen parameters are pre-set and stored in local memory or on the connected cloud server. Due to the characteristics of landscape and portrait display, the pre-set expected screen parameters for the two application groups are different.
[0091] 202. When the unadapted application is one that does not support full-screen adaptive display, create a target virtual screen based on the expected screen parameters of the vehicle's virtual screen and the application group to which the unadapted application belongs.
[0092] In this embodiment, after receiving the screen casting command, the unadapted applications in the screen casting command are distinguished by their respective application groups. For the unadapted applications that only support landscape display and only support portrait display, since they cannot adapt to the vehicle virtual screen for display, in this embodiment, the matching preset expected screen parameters are obtained according to the application group to which the unadapted application belongs, and the target virtual screen is created according to the expected screen parameters and the vehicle virtual screen.
[0093] It should be noted that after the communication link is established between the vehicle-mounted device and the terminal device, until the communication link is disconnected, a target virtual screen only needs to be created once for application groups that only support landscape display, and similarly, a target virtual screen only needs to be created once for application groups that only support portrait display. In other words, the lifecycle of a target virtual screen is from the time it is created until the communication link between the vehicle-mounted device and the terminal device is disconnected.
[0094] Optionally, distinguishing the non-compatible applications in the screen casting command by their respective application groups can be achieved through the following steps:
[0095] The unadapted applications are input into the classification model, which is obtained by mathematical modeling based on a large number of unadapted application samples that have been identified as supporting adaptive full-screen display, only supporting landscape display, and only supporting portrait display.
[0096] Obtain the output of the classification model, which indicates the application group to which the unfit application belongs.
[0097] The above implementation method can quickly identify which application group an unsupported application belongs to, thereby improving screen mirroring efficiency.
[0098] Furthermore, each time a screen mirroring is used, the uncompatible application will be saved as a sample for the classification model to be optimized periodically. When the number of uncompatible application samples reaches a certain amount, the classification model will be optimized to improve the accuracy of the classification model in identifying uncompatible applications.
[0099] 203. Display the projected data on the target virtual screen.
[0100] It's important to note that the target virtual screen is displayed overlaid on the vehicle's virtual screen; that is, the target virtual screen is loaded and displayed on top of the vehicle's virtual screen, allowing it to be displayed full-screen. Specifically, for applications that only support landscape mode, the width of the target virtual screen is the same as the width of the vehicle's virtual screen, while its height is usually smaller. For applications that only support portrait mode, the height of the target virtual screen is the same as the height of the vehicle's virtual screen, while its width is usually smaller.
[0101] By implementing the above embodiments, after the vehicle-mounted device and the terminal device are connected, a screen projection command is received from the terminal device. This screen projection command carries the screen projection data of the unadapted application. When the unadapted application is one that does not support full-screen adaptive display, a target virtual screen is created based on the expected screen parameters of the vehicle-mounted virtual screen and the application group to which the unadapted application belongs. Then, the screen projection data of the unadapted application is displayed on the target virtual screen. By implementing the embodiments of this application, a virtual screen can be created by combining the expected screen parameters without intruding on the unadapted application, ensuring that the unadapted application can be displayed normally on vehicle-mounted screens of different resolutions. This improves the integrity and usability of the display of the unadapted application, enabling the unadapted application to obtain an almost consistent visual experience and interactive experience on all vehicle-mounted devices.
[0102] Please see Figure 3 , Figure 3 This is a flowchart illustrating the screen projection method based on the vehicle-mounted virtual screen disclosed in Embodiment 2 of this application; as shown... Figure 3As shown, the screen projection method based on the vehicle's virtual screen may include:
[0103] 301. After the vehicle-mounted device is connected to the terminal device, it receives the screen projection command from the terminal device, which carries the screen projection data of the application that is not adapted.
[0104] In this application embodiment, the execution subject can be a projection device based on the vehicle virtual screen or a vehicle device. The projection device based on the vehicle virtual screen can be independent of the vehicle device or it can be a module built into the vehicle device.
[0105] It should be noted that the screen mirroring data is page data from applications that are not yet compatible.
[0106] 302. When the application not adapted is one that does not support full-screen adaptive display, determine whether a target virtual screen has been created; if the result is yes, proceed to steps 303-304, and if the result is no, proceed to step 305.
[0107] In step 302, for the unadapted application indicated by the screen projection command, first determine whether a target virtual screen adapted to the application group of the unadapted application has been created after the vehicle-mounted device and the terminal device established this communication link. If it has been created, proceed to step 304; otherwise, proceed to steps 303-304. If the unadapted application is a full-screen adaptive display application, proceed to step 306.
[0108] 303. Create a target virtual screen based on the expected screen parameters of the vehicle's virtual screen and the application group to which the unadapted application belongs.
[0109] In this embodiment, the application group to which the unadapted application belongs is determined, and then the matching expected screen parameters can be found from the expected screen parameters stored in local memory. Based on the expected screen parameters and the screen resolution of the vehicle virtual screen, a target virtual screen is created.
[0110] 304. Display the projected data on the target virtual screen.
[0111] The target virtual screen can be overlaid and fully displayed on the vehicle's virtual screen, allowing the projected data to be displayed on the target virtual screen. This enables the display of applications that only support landscape or portrait modes on the vehicle's virtual screen. For example, for applications that only support landscape mode, displaying the projected data on the target virtual screen achieves the same visual effect as displaying the incompatible application in landscape mode on the vehicle's virtual screen. Similarly, for applications that only support portrait mode, displaying the projected data on the target virtual screen achieves the same visual effect as displaying the incompatible application in portrait mode on the vehicle's virtual screen.
[0112] As can be seen, by combining steps 303-304, for unadapted applications, a set of pre-set expected screen parameters can be used, and then the screen can be projected and displayed on the vehicle's virtual screen with different screen resolutions. The display is complete, the stability is good, the overall visual experience is strong, and the difficulty of connecting unadapted applications to vehicle devices can be reduced.
[0113] In step 302, if a target virtual screen has already been created, the target virtual screen is overlaid and displayed in the middle position of the vehicle's virtual screen, and then the projection data is displayed on the target virtual screen to realize the current projection of the unadapted application.
[0114] In the above implementation, after the vehicle-mounted device and the terminal device establish the current communication link, if a target virtual screen belonging to the application group has already been created, it is not necessary to recreate it. The previously created target virtual screen can be directly called, and then the projection data can be directly displayed. This simplifies the projection operation and ensures the projection effect.
[0115] 305. When the application is not adapted to support full-screen adaptive display, the projected data will be displayed directly on the vehicle's virtual screen.
[0116] When the application that is not adapted is one that supports full-screen adaptive display, the projected data can be displayed in full screen on the vehicle's virtual screen without the need to create a separate target virtual screen.
[0117] Optionally, for applications that support full-screen adaptive display, they may not be able to display stably on the vehicle's virtual screen when encountering extreme screen resolutions. In this case, you can also create a new virtual screen by pre-setting the expected screen parameters and the screen resolution of the vehicle's virtual screen, and then project the application onto the created virtual screen to improve the stability and feasibility of application projection and improve the projection effect.
[0118] By implementing the above embodiments, after the vehicle-mounted device and the terminal device are connected, a screen projection command is received from the terminal device. This command carries the projection data of the unadapted application. When the unadapted application is one that does not support full-screen adaptive display, it can first be determined whether a target virtual screen exists. If so, the target virtual screen is directly reused to display the projection data. If not, a target virtual screen is created based on the screen resolution of the vehicle-mounted virtual screen and the expected screen parameters of the application group to which the unadapted application belongs. Then, the projection data of the unadapted application is displayed on the target virtual screen. By implementing the embodiments of this application, a target virtual screen suitable for projection can be created using preset expected screen parameters without intruding on the unadapted application. This ensures that the unadapted application can be displayed normally on vehicle-mounted screens of different resolutions, improving the integrity and usability of the unadapted application display, and enabling the unadapted application to obtain an almost consistent visual experience and interactive experience on all vehicle-mounted devices. In addition, when the unadapted application is one that supports full-screen adaptive display, it can be directly projected onto the vehicle-mounted virtual screen, and the unadapted application can adaptively display in full screen on the vehicle-mounted virtual screen without additional intervention.
[0119] Please see Figure 4 , Figure 4 This is a flowchart illustrating the screen projection method based on the vehicle-mounted virtual screen disclosed in Embodiment 3 of this application; as shown... Figure 4 As shown, the screen projection method based on the vehicle's virtual screen may include:
[0120] 401. After the vehicle-mounted device is connected to the terminal device, it receives the screen projection command from the terminal device, which carries the screen projection data of the application that is not adapted.
[0121] In this application embodiment, the execution subject can be a projection device based on the vehicle virtual screen or a vehicle device. The projection device based on the vehicle virtual screen can be independent of the vehicle device or it can be a module built into the vehicle device.
[0122] 402. When the unadapted application is one that does not support full-screen adaptive display, obtain the expected screen parameters of the application group to which the unadapted application belongs. The expected screen parameters include at least the expected screen width, the expected screen height, and the expected screen pixel density.
[0123] In step 401, when the terminal device sends a screen projection command to attempt to launch an unadapted application on the vehicle's virtual screen, it can determine whether the unadapted application supports full-screen adaptive display. If so, proceed to step 410. Conversely, if the unadapted application does not support full-screen adaptive display, the application group to which the unadapted application belongs is determined. This group may only support landscape display or only support portrait display. The expected screen parameters for the two application groups are different. Therefore, in this embodiment, the expected screen parameters of the group to which the unadapted application belongs are obtained based on the characteristic that the unadapted application in different application groups only supports landscape or only supports portrait. These expected screen parameters include at least the expected screen width, expected screen height, and expected screen pixel density.
[0124] Optionally, the aforementioned expected screen parameters can be optimized and updated after several screen projections to obtain more accurate expected screen parameters and improve the screen projection effect of applications not adapted to the vehicle's virtual screen.
[0125] 403. Create the target virtual screen based on the expected screen parameters.
[0126] Specifically, a target virtual screen is created based on the determined expected screen parameters. The width of the target virtual screen is the expected screen width in the expected screen parameters, and the height of the target virtual screen is the expected screen height in the expected screen parameters, thus creating a target virtual screen that meets the expected screen pixel density.
[0127] 404. Place the target virtual screen in a display container of the same size.
[0128] Optionally, the size of the display container is the same as the size of the target virtual screen; that is, the width and height of the display container are the same as the expected screen width and height. Optionally, a TextureView with controllable display size is selected as the display container.
[0129] Since the target virtual screen is placed in the display container, the display size of the target virtual screen can be controlled by controlling the display size of the display container, that is, the height and width of the target virtual screen can be controlled.
[0130] 405. Calculate the scaling factor of the display container based on the screen resolution of the vehicle's virtual screen.
[0131] Optionally, step 405 may include:
[0132] Obtain the actual screen parameters of the vehicle's virtual screen, which include at least the actual screen width and the actual screen height.
[0133] Calculate the aspect ratio of the actual application area of the vehicle's virtual screen based on the actual screen parameters;
[0134] Calculate the aspect ratio of the expected screen resolution based on the expected screen parameters;
[0135] Calculate the scaling factor of the display container based on the actual screen parameters, expected screen parameters, aspect ratio of the actual application area, and aspect ratio of the expected screen resolution.
[0136] In this embodiment, after establishing a communication link between the vehicle-mounted device and the terminal device, the vehicle-mounted device creates a virtual screen. The actual screen parameters of the virtual screen are obtained, and the scaling factor of the display container is calculated based on the actual screen parameters of the virtual screen.
[0137] The scaling factor is calculated as follows:
[0138] Assuming the actual screen width of the vehicle's virtual screen is represented as REAL_DISPLAY_WIDTH and the actual screen height as REAL_DISPLAY_HEIGHT, then the aspect ratio of the actual application area of the vehicle's virtual screen is represented as realRatio, which is calculated using formula (1) as follows:
[0139] realRatio=REAL_DISPLAY_WIDTH / REAL_DISPLAY_HEIGHT*1f
[0140] Where f = float, representing a floating-point number, the calculated realRatio is converted into a floating-point number.
[0141] Assuming the expected screen height is represented as EXPECTED_DISPLAY_HEIGHT, the expected screen width as EPECTED_DISPLAY_WIDTH, and the expected screen resolution aspect ratio as expectedRatio, where expectedRatio is calculated using formula (2), as follows:
[0142] expectedRatio=EPECTED_DISPLAY_WIDTH / EXPECTED_DISPLAY_HE IGHT*1f
[0143] Similarly, f above is also an abbreviation for float, representing a floating-point number, and converts the calculated expectedRatio into a floating-point number.
[0144] Furthermore, if realRatio is greater than expectedRatio, assuming the scaling factor is represented as scale, then scale is calculated using formula (3), as follows:
[0145] scale=REAL_DISPLAY_HEIGHT*1f / EXPECTED_DISPLAY_HEIGHT
[0146] Conversely, if realRatio is less than or equal to expectedRatio, then scale is calculated using formula (4), as follows:
[0147] Scale=REAL_DISPLAY_WIDTH*1f / expectedRatio / EXPECTED_DISPLA Y_HEIGHT
[0148] As can be seen, through the above implementation method, the scaling factor that can accurately scale the display container can be calculated by combining the actual screen parameters of the vehicle virtual screen, so as to display the display container horizontally or vertically on the vehicle virtual screen, and finally achieve the purpose of displaying unadapted applications horizontally or vertically on the vehicle virtual screen.
[0149] 406. Scale the display container according to the scaling factor.
[0150] Since the display size of the display container can be controlled, in step 406, the display container is scaled according to a scaling factor. Scaling the display container also achieves the purpose of scaling the target virtual screen, scaling the target virtual screen to match the vehicle's virtual screen.
[0151] 407. Move the scaled display container to fully display the target virtual screen on the vehicle's virtual screen.
[0152] Optionally, the aforementioned moved and scaled display container to fully display the target virtual screen on the vehicle's virtual screen includes:
[0153] Calculate the horizontal and vertical translation amounts based on the expected screen parameters and scaling factor;
[0154] Based on the horizontal and vertical translation amounts, move the scaled display container to the center of the vehicle's virtual screen to fully display the target virtual screen on the vehicle's virtual screen.
[0155] In the above implementation, the target virtual screen is obtained by scaling the display container, and the target virtual screen is moved to the center of the vehicle virtual screen so that the target virtual screen can be displayed in landscape or portrait mode on the vehicle virtual screen.
[0156] The formula (5) for calculating the lateral translation is as follows:
[0157] (EXPECTED_DISPLAY_WIDTH-EXPECTED_DISPLAY_WIDTH*scale) / 2
[0158] The formula (6) for calculating the longitudinal translation is as follows:
[0159] (EXPECTED_DISPLAY_HEIGHT-EXPECTED_DISPLAY_HEIGHT*scale) / 2;
[0160] After calculating the horizontal and vertical translation amounts, the display container can be moved first by the horizontal translation amount, and then by the vertical translation amount, thereby moving the display container to the center of the vehicle's virtual screen; or, the display container can be moved first by the vertical translation amount, and then by the horizontal translation amount, thereby moving the display container to the center of the vehicle's virtual screen.
[0161] 408. Inject the touch events of the vehicle's virtual screen into the target virtual screen.
[0162] In this embodiment, the final step is to display the projected data on the target virtual screen. Users can interact with non-adapted applications on the target virtual screen. Therefore, it is necessary to obtain the touch events of the vehicle virtual screen and then inject the touch events of the vehicle virtual screen into the target virtual screen.
[0163] Optionally, the above-mentioned injection of touch events from the vehicle's virtual screen into the target virtual screen includes:
[0164] Listen for touch events on the vehicle's virtual screen;
[0165] Obtain the coordinates of touch events on the vehicle's virtual screen;
[0166] The coordinates of the touch event are scaled according to the scaling factor;
[0167] Inject the processed touch event coordinates into the target virtual screen.
[0168] The code implements the occurrence of touch events, listens for these events, obtains the corresponding touch event coordinates, scales the coordinates according to a scaling factor, and then injects the coordinates into the target virtual screen.
[0169] 409. Display the projected data on the target virtual screen.
[0170] The projected data of the unadapted application is displayed on the target virtual screen after creation. Since the target virtual screen has been injected with the touch events of the vehicle's virtual screen, the user can operate the application based on the target virtual screen, thus ultimately realizing the operation of the application on the vehicle's virtual screen.
[0171] 410. When the application is not adapted to support full-screen adaptive display, the screen projection data is directly displayed on the vehicle's virtual screen.
[0172] Implementing the above embodiments ensures that most pages of unadapted applications display normally without intruding on them, and guarantees that all unadapted applications have a nearly consistent visual and interactive experience on in-vehicle infotainment devices with different resolutions, significantly improving the integrity and usability of the interface display of unadapted applications. At the same time, through the above embodiments, different adaptation rules can be customized according to the characteristics of the unadapted applications themselves (whether they support full-screen adaptive display, landscape display only, or portrait display only), allowing unadapted applications to obtain the best possible interactive experience while displaying normally.
[0173] Furthermore, by simply creating a target virtual screen using a fixed set of expected screen parameters and combining the scalable feature of the TextureView display container, it is possible to ensure that unadapted applications can display pages normally on in-vehicle devices with different resolutions, and that the display effect of each page is basically consistent. This application embodiment optimizes the interactive experience of unadapted applications while also reducing the difficulty of accessing unadapted applications.
[0174] Please see Figures 5 to 8 ,in, Figure 5 This is a schematic diagram of the in-vehicle virtual screen disclosed in an embodiment of this application. Figure 6 This is a schematic diagram of the target virtual screen disclosed in Embodiment 1 of this application. Figure 7 This is a schematic diagram of the scaled-up target virtual screen disclosed in Embodiment 2 of this application. Figure 8 This is a schematic diagram of the target virtual screen disclosed in Embodiment 3 of this application. Figures 5-8 Taking an unadapted application that only supports portrait mode display as an example, the resolution of the in-vehicle device is 1280x720, the left icon bar is the Dock, and the width and height of the application display area are 1160x720. Figure 5 As shown.
[0175] Furthermore, the preset expected screen parameters that only support portrait mode display are EXPECTED_DISPLAY_WIDTH = 1280, EXPECTED_DISPLAY_HEIGHT = 1600, and EXPECTED_DISPLAY_DENSITY_DPI = 360. A new target virtual screen is created based on these expected screen parameters. The width and height of the new target virtual screen are larger than the virtual screen of the vehicle's infotainment system. Figure 6 As shown, the lighter-colored area covered above is the target virtual screen, which is the TextureView display container.
[0176] Furthermore, according to the appendix Figure 4The calculation formula given in the illustrated embodiment yields a scaling factor of 0.45. The TextureView display container is then scaled according to this scaling factor. The scaled TextureView display container is located in the upper left corner of the screen (gray area), which is the target virtual screen. The black area represents the vehicle's virtual screen. Figure 7 As shown.
[0177] Furthermore, the target virtual screen is moved to the center of the vehicle's virtual screen, and then the touch event coordinates of the vehicle's virtual screen are injected, such as... Figure 8 As shown, the projected data of the unsupported application can then be displayed on the target virtual screen.
[0178] Please see Figure 9 , Figure 9 This is a schematic diagram of the screen projection device based on the vehicle-mounted virtual screen disclosed in Embodiment 1 of this application; as shown... Figure 9 As shown, the screen projection device based on the vehicle's virtual screen may include:
[0179] The receiving module 901 is used to receive the screen projection instruction from the terminal device after the vehicle-mounted device and the terminal device are connected. The screen projection instruction carries screen projection data that is not adapted to the application.
[0180] Module 902 is used to create a target virtual screen based on the expected screen parameters of the vehicle's virtual screen and the application group to which the unadapted application belongs when the unadapted application does not support full-screen adaptive display.
[0181] The startup module 903 is used to display the projection data on the target virtual screen.
[0182] As can be seen, by implementing the above-described device, after the vehicle-mounted device connects to the terminal device, it receives a screen projection command from the terminal device. This command carries projection data for the unadapted application. When the unadapted application is one that does not support full-screen adaptive display, a target virtual screen is created based on the expected screen parameters of the vehicle-mounted virtual screen and the application group to which the unadapted application belongs. The projection data of the unadapted application is then displayed on the target virtual screen. By implementing this embodiment, a virtual screen can be created based on the expected screen parameters without intruding on the unadapted application, ensuring that the unadapted application can be displayed normally on vehicle-mounted screens of different resolutions. This improves the integrity and usability of the unadapted application display, allowing the unadapted application to achieve an almost consistent visual experience and interactive experience across all vehicle-mounted systems.
[0183] Please see Figure 10 , Figure 10 This is a schematic diagram of the projection device based on the vehicle-mounted virtual screen disclosed in Embodiment 2 of this application; Figure 10 The screen projection device shown is based on the vehicle's virtual screen. Figure 9The projection device shown is an optimized version of the in-vehicle virtual screen. Figure 10 The screen projection device based on the vehicle-mounted virtual screen shown further includes: a judgment module 1010.
[0184] Among them, the judgment module 1010 is used to determine whether a target virtual screen has been created when the unadapted application is an application that does not support full-screen adaptive display, and before the creation module 902 creates a target virtual screen based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs.
[0185] The aforementioned creation module 902 is specifically used to create a target virtual screen based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs when the judgment result of the judgment module 1010 is negative.
[0186] In some optional implementations, the startup module 903 is further configured to reuse the target virtual screen when the judgment result of the judgment module 1010 is that a target virtual screen has been created, so as to start the unadapted application on the target virtual screen.
[0187] In some optional implementations, the aforementioned startup module 903 is also used to directly display the projection data on the vehicle's virtual screen when the application is not adapted to support full-screen adaptive display.
[0188] By implementing the above embodiments, after the vehicle-mounted device and the terminal device are connected, a screen projection command is received from the terminal device. This command carries the projection data of the unadapted application. When the unadapted application is one that does not support full-screen adaptive display, it can first be determined whether a target virtual screen exists. If so, the target virtual screen is directly reused to display the projection data. If not, a target virtual screen is created based on the screen resolution of the vehicle-mounted virtual screen and the expected screen parameters of the application group to which the unadapted application belongs. Then, the projection data of the unadapted application is displayed on the target virtual screen. By implementing the embodiments of this application, a target virtual screen suitable for projection can be created using preset expected screen parameters without intruding on the unadapted application. This ensures that the unadapted application can be displayed normally on vehicle-mounted screens of different resolutions, improving the integrity and usability of the unadapted application display, and enabling the unadapted application to obtain an almost consistent visual experience and interactive experience on all vehicle-mounted devices. In addition, when the unadapted application is one that supports full-screen adaptive display, it can be directly projected onto the vehicle-mounted virtual screen, and the unadapted application can adaptively display in full screen on the vehicle-mounted virtual screen without additional intervention.
[0189] In some optional implementations, the creation module 902 is used to create a target virtual screen based on the expected screen parameters of the vehicle-mounted virtual screen and the application group to which the unadapted application belongs, specifically in the following ways:
[0190] The system retrieves the expected screen parameters of the application group to which the unadapted application belongs, including at least the expected screen width, expected screen height, and expected screen pixel density; creates a target virtual screen based on the expected screen parameters; places the target virtual screen in a display container of the same size; calculates a scaling factor for the display container based on the screen resolution of the vehicle infotainment virtual screen; scales the display container based on the scaling factor; moves the scaled display container to fully display the target virtual screen on the vehicle infotainment virtual screen; and injects touch events from the vehicle infotainment virtual screen into the target virtual screen.
[0191] Further optionally, the creation module 902 calculates the scaling factor of the display container based on the screen resolution of the vehicle system in the following specific manner:
[0192] Obtain the actual screen parameters of the vehicle infotainment virtual screen, which include at least the actual screen width and actual screen height; calculate the aspect ratio of the actual application area of the vehicle infotainment virtual screen based on the actual screen parameters; calculate the aspect ratio of the expected screen resolution based on the expected screen parameters; and calculate the scaling factor of the display container based on the actual screen parameters, expected screen parameters, the aspect ratio of the actual application area, and the aspect ratio of the expected screen resolution.
[0193] Alternatively, the creation module 902 described above can be used to move the scaled display container to fully display the target virtual screen on the vehicle's virtual screen in the following ways:
[0194] Based on the expected screen parameters and the scaling factor, calculate the horizontal and vertical translation amounts; and based on the horizontal and vertical translation amounts, move the scaled display container to the center position of the vehicle virtual screen to fully display the target virtual screen on the vehicle virtual screen.
[0195] Alternatively, the creation module 902 may inject touch events from the vehicle's virtual screen into the target virtual screen in the following specific manner:
[0196] Listen for touch events on the vehicle's virtual screen; obtain the touch event coordinates of the vehicle's virtual screen; scale the touch event coordinates according to a scaling factor; and inject the processed touch event coordinates into the target virtual screen.
[0197] By implementing the above-described method, it is only necessary to create a target virtual screen using a fixed set of expected screen parameters and combine the scalable feature of the TextureView display container to ensure that the unadapted application can display the page normally on in-vehicle devices with different resolutions and that the display effect of each page is basically consistent. This application embodiment optimizes the interactive experience of the unadapted application while also reducing the difficulty of accessing the unadapted application.
[0198] Please see Figure 11, Figure 11 This is a schematic diagram of the structure of the vehicle-mounted equipment disclosed in the embodiments of this application; Figure 11 The in-vehicle infotainment system shown may include:
[0199] Memory 1110 storing executable program code;
[0200] Processor 1120 coupled to memory 1110;
[0201] Specifically, the processor 1120 calls the executable program code stored in the memory 1110 and executes it. Figures 2 to 4 Some or all of the steps of any method.
[0202] Please see Figure 12 , Figure 12 This is a schematic diagram of the vehicle structure disclosed in the embodiments of this application; as shown Figure 12 As shown, the vehicle may include:
[0203] As attached Figure 11 For the in-vehicle infotainment device shown, please refer to the above embodiments for the method of how the in-vehicle infotainment device can realize the screen projection display of unadapted applications, which will not be repeated here.
[0204] This application also discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute... Figures 2 to 4 Publicly available methods.
[0205] This application also discloses a computer program product that, when run on a computer, causes the computer to execute... Figures 2 to 4 Some or all of the steps of any of the disclosed methods.
[0206] This application also discloses an application publishing platform for publishing computer program products. When the computer program product is run on a computer, it causes the computer to execute... Figures 2 to 4 Some or all of the steps of any of the disclosed methods.
[0207] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.
[0208] The foregoing has provided a detailed description of a screen projection method, device, vehicle equipment, and vehicle based on a vehicle-mounted virtual screen, as disclosed in the embodiments of the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.
[0209] The foregoing has provided a detailed description of a screen projection method, device, vehicle equipment, and vehicle based on a vehicle-mounted virtual screen, as disclosed in the embodiments of the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.
Claims
1. A screen projection method based on a vehicle-mounted virtual screen, characterized in that, include: After the vehicle-mounted device connects to the terminal device, it receives a screen projection command from the terminal device, which carries screen projection data for applications that are not compatible. When the unadapted application is an application that does not support full-screen adaptive display, a target virtual screen is created based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs. The target virtual screen is displayed over the vehicle virtual screen. The projection data is displayed on the target virtual screen; The step of creating a target virtual screen based on the vehicle's virtual screen and the expected screen parameters of the application group to which the unadapted application belongs includes: Obtain the expected screen parameters of the application group to which the unadapted application belongs, wherein the expected screen parameters include at least the expected screen width, the expected screen height, and the expected screen pixel density; Create a target virtual screen based on the expected screen parameters; Place the target virtual screen in a display container of the same size; The scaling factor of the display container is calculated based on the screen resolution of the vehicle's virtual screen; The display container is scaled according to the scaling factor; Move the scaled display container to fully display the target virtual screen on the vehicle's virtual screen; Inject the touch events of the vehicle's virtual screen into the target virtual screen.
2. The method according to claim 1, characterized in that, When the unadapted application is one that does not support full-screen adaptive display, and before creating the target virtual screen based on the expected screen parameters of the vehicle's virtual screen and the application group to which the unadapted application belongs, the method further includes: Determine whether the target virtual screen has already been created; If not, proceed with the step of creating a target virtual screen based on the expected screen parameters of the vehicle's virtual screen and the application group to which the unadapted application belongs.
3. The method according to claim 2, characterized in that, The method further includes: If the target virtual screen has already been created, the projection data is displayed on the target virtual screen.
4. The method according to claim 1, characterized in that, The step of calculating the scaling factor of the display container based on the screen resolution of the vehicle-mounted virtual screen includes: Obtain the actual screen parameters of the vehicle's virtual screen, wherein the actual screen parameters include at least the actual screen width and the actual screen height; Based on the actual screen parameters, calculate the aspect ratio of the actual application area of the vehicle virtual screen; Calculate the aspect ratio of the expected screen resolution based on the expected screen parameters; The scaling factor of the display container is calculated based on the actual screen parameters, the expected screen parameters, the aspect ratio of the actual application area, and the aspect ratio of the expected screen resolution.
5. The method according to claim 4, characterized in that, The mobile, scaled display container for fully displaying the target virtual screen on the vehicle-mounted virtual screen includes: Calculate the horizontal and vertical translation amounts based on the expected screen parameters and the scaling factor; Based on the horizontal and vertical translation amounts, the scaled display container is moved to the center of the vehicle-mounted virtual screen to fully display the target virtual screen on the vehicle-mounted virtual screen.
6. The method according to claim 1, characterized in that, The step of injecting the touch events of the vehicle's virtual screen into the target virtual screen includes: Listen for touch events on the vehicle's virtual screen; Obtain the coordinates of the touch events on the vehicle's virtual screen; The touch event coordinates are scaled according to the scaling factor. The processed touch event coordinates are injected into the target virtual screen.
7. The method according to claim 1, characterized in that, The method further includes: When the unadapted application is one that supports full-screen adaptive display, the projection data is directly displayed on the vehicle's virtual screen.
8. A screen projection device based on a vehicle-mounted virtual screen, characterized in that, include: The receiving module is used to receive the screen projection instruction from the terminal device after the vehicle-mounted device and the terminal device are connected. The screen projection instruction carries screen projection data that is not adapted to the application. A creation module is used to create a target virtual screen based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs when the unadapted application is an application that does not support full-screen adaptive display. The target virtual screen is displayed over the vehicle virtual screen. A startup module is used to display the projection data on the target virtual screen; The creation module is used to create a target virtual screen based on the vehicle's virtual screen and the expected screen parameters of the application group to which the unadapted application belongs. Specifically, the method is as follows: Obtain the expected screen parameters of the application group to which the unadapted application belongs, the expected screen parameters including at least the expected screen width, expected screen height and expected screen pixel density; and create a target virtual screen according to the expected screen parameters; and place the target virtual screen in a display container of the same size; and calculate the scaling factor of the display container according to the screen resolution of the vehicle virtual screen. And, scale the display container according to the scaling factor; And, move the scaled display container to fully display the target virtual screen on the vehicle's virtual screen; In addition, the touch events of the vehicle's virtual screen are injected into the target virtual screen.
9. The apparatus according to claim 8, characterized in that, The device further includes: The judgment module is used to determine whether the target virtual screen has been created when the unadapted application is an application that does not support full-screen adaptive display, and before creating the target virtual screen based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs. The creation module is specifically used to create a target virtual screen based on the expected screen parameters of the vehicle virtual screen and the application group to which the unadapted application belongs when the judgment result of the judgment module is negative.
10. The apparatus according to claim 9, characterized in that: The startup module is also used to display the projection data on the target virtual screen when the judgment result of the judgment module is that the target virtual screen has been created.
11. The apparatus according to claim 8, characterized in that, The creation module calculates the scaling factor of the display container based on the screen resolution of the vehicle system in the following specific way: Obtain the actual screen parameters of the vehicle's virtual screen, wherein the actual screen parameters include at least the actual screen width and the actual screen height; Based on the actual screen parameters, calculate the aspect ratio of the actual application area of the vehicle virtual screen; Calculate the aspect ratio of the expected screen resolution based on the expected screen parameters; The scaling factor of the display container is calculated based on the actual screen parameters, the expected screen parameters, the aspect ratio of the actual application area, and the aspect ratio of the expected screen resolution.
12. The apparatus according to claim 11, characterized in that, The creation module is used to move the scaled display container to fully display the target virtual screen on the vehicle's virtual screen in the following way: Based on the expected screen parameters and the scaling factor, calculate the horizontal and vertical translation amounts; and based on the horizontal and vertical translation amounts, move the scaled display container to the center position of the vehicle virtual screen to fully display the target virtual screen on the vehicle virtual screen.
13. The apparatus according to claim 8, characterized in that, The creation module injects touch events from the vehicle infotainment virtual screen into the target virtual screen in the following specific manner: Listen for touch events on the vehicle's virtual screen; obtain the coordinates of the touch events on the vehicle's virtual screen; and scale the touch event coordinates according to the scaling factor. In addition, the processed touch event coordinates are injected into the target virtual screen.
14. A vehicle-mounted infotainment system, characterized in that, include: Memory containing executable program code; A processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the screen projection method based on the vehicle virtual screen as described in any one of claims 1 to 7.
15. A vehicle, characterized in that, include: The vehicle-mounted equipment as described in claim 14.
16. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the program implements the steps of the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Virtual screen projection control method and device and computer readable storage medium
CN114296673A