Screen mirroring display method and apparatus, device and storage medium

Abstract

A screen mirroring display method and apparatus, a device and a storage medium. The method comprises: acquiring video stream dimensions of a video stream to be mirrored at a mobile terminal side and screen dimensions of an in-vehicle infotainment screen (S101); on the basis of the video stream dimensions and the screen dimensions and a preset proportional scaling rule, determining a target screen mirroring mode of said video stream at the mobile terminal side, the target screen mirroring mode being one of a first screen mirroring mode, a second screen mirroring mode, a third screen mirroring mode, a fourth screen mirroring mode, a fifth screen mirroring mode, a sixth screen mirroring mode or a seventh screen mirroring mode (S102); and, according to the target screen mirroring mode, mirroring said video stream to the in-vehicle infotainment screen (S103).

Description

Screen projection display methods, devices, equipment and storage media

[0001] This application claims priority to Chinese Patent Application No. 202510347231.8, filed with the Chinese Patent Office on March 24, 2025, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of screen projection technology, such as a screen projection display method, device, equipment, and storage medium. Background Technology

[0003] Screen mirroring technology between smart devices and in-vehicle infotainment systems facilitates easier interaction, enriching the multimedia functions of the in-vehicle system and making life more convenient for car owners. Common screen mirroring technologies include projecting videos or images from smartphones, tablets, computers, and other smart devices onto the in-vehicle screen for playback and viewing. However, due to the different types of smart devices, and even variations in models within the same type, their resolutions differ. When mirroring, the mismatch between the smart device and the in-vehicle screen size can lead to issues such as distortion, stretching, squashing, display errors, and pixel distortion. Therefore, a method is needed to adaptively display a suitable size even when the smart device and the in-vehicle screen are not compatible, ensuring the displayed image is undistorted and provides the best user experience. Summary of the Invention

[0004] This application provides a screen projection display method, device, equipment, and storage medium, which achieves screen projection effects without distortion, stretching, flattening, display overshooting, or loss of accuracy, maintaining the best display effect.

[0005] In a first aspect, embodiments of this application provide a screen projection display method, including:

[0006] Obtain the video stream size of the video stream to be projected from the mobile terminal and the screen size of the in-vehicle screen;

[0007] Based on the video stream size and the screen size, and combined with the preset proportional scaling rules, the target projection mode of the video stream to be projected on the mobile terminal side is determined. The target projection mode is one of the following: the first projection mode, the second projection mode, the third projection mode, the fourth projection mode, the fifth projection mode, the sixth projection mode, or the seventh projection mode.

[0008] According to the target projection mode, the video stream to be projected is projected onto the vehicle's side screen.

[0009] Secondly, embodiments of this application provide a screen projection display device, including:

[0010] The size acquisition module is configured to acquire the video stream size of the video stream to be projected on the mobile terminal side and the screen size of the screen on the vehicle side.

[0011] The mode determination module is configured to determine the target projection mode of the video stream to be projected on the mobile terminal side based on the video stream size and the screen size, combined with a preset proportional scaling rule. The target projection mode is one of the following: a first projection mode, a second projection mode, a third projection mode, a fourth projection mode, a fifth projection mode, a sixth projection mode, or a seventh projection mode.

[0012] The screen projection module is configured to project the video stream to be projected onto the vehicle-mounted side screen according to the target screen projection mode.

[0013] Thirdly, embodiments of this application provide an electronic device, including:

[0014] At least one processor; and

[0015] A memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the screen projection display method as described in any embodiment of this application.

[0017] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer instructions that, when executed by a processor, implement the screen projection display method as described in any embodiment of this application.

[0018] This application provides a screen projection method, apparatus, device, and storage medium. The method includes: obtaining the video stream size of the video stream to be projected from the mobile terminal side and the screen size of the in-vehicle infotainment system screen; determining a target projection mode for the video stream to be projected from the mobile terminal side based on the video stream size and the screen size, combined with a preset proportional scaling rule, wherein the target projection mode is one of a first projection mode, a second projection mode, a third projection mode, a fourth projection mode, a fifth projection mode, a sixth projection mode, or a seventh projection mode; and projecting the video stream to be projected onto the in-vehicle infotainment system screen according to the target projection mode. The above technical solution provides seven projection modes, determining which projection mode to use for projection based on the video stream size of the video stream to be projected from the mobile terminal side and the screen size of the in-vehicle infotainment system screen through proportional scaling. For different screen casting scenarios, the system selects the appropriate screen casting mode from seven options as the target screen casting mode. This allows for free transformation of the screen casting display using mobile terminals with different resolutions. The screen casting effect is not distorted, stretched, crushed, or out of bounds, and it maintains the best display effect. Attached Figure Description

[0019] Figure 1 is a flowchart illustrating a screen projection method provided in Embodiment 1 of this application;

[0020] Figure 2 is an example diagram of the first projection mode in the execution of a projection display method provided in Embodiment 1 of this application;

[0021] Figure 3 is an example diagram of the second screen projection mode in the execution of a screen projection display method provided in Embodiment 1 of this application;

[0022] Figure 4 is an example diagram of the third screen projection mode in the execution of a screen projection display method provided in Embodiment 1 of this application;

[0023] Figure 5 is an example diagram of the fourth screen projection mode in the execution of a screen projection display method provided in Embodiment 1 of this application;

[0024] Figure 6 is an example diagram of the fifth screen projection mode in the execution of a screen projection display method provided in Embodiment 1 of this application;

[0025] Figure 7 is an example diagram of the sixth projection mode in the execution of a projection display method provided in Embodiment 1 of this application;

[0026] Figure 8 is an example diagram of the seventh screen projection mode in the execution of a screen projection display method provided in Embodiment 1 of this application;

[0027] Figure 9 is a flowchart illustrating another screen projection method provided in Embodiment 2 of this application;

[0028] Figure 10 is a schematic diagram of a screen projection display device provided in Embodiment 3 of this application;

[0029] Figure 11 is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of this application. Detailed Implementation

[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0031] Common screen mirroring technologies include projecting videos or images from smartphones, tablets, computers, and other smart devices onto the car's infotainment system for playback and viewing. Taking a smartphone as an example, when mirroring a phone screen, due to the diverse screen sizes on the car's side, improper conversion methods can lead to distortion, stretching, compression, display errors, and pixel distortion. Furthermore, because smartphone screens vary in size and resolution, inconsistent resolutions on both sides can cause distortion, stretching, compression, display errors, and pixel distortion due to improper screen size handling. Moreover, when switching between portrait and landscape modes on the phone screen, the projected screen size changes accordingly. Without proper conversion processing or with improper conversion, this can also result in distortion, stretching, compression, display errors, and pixel distortion. Therefore, a method is needed to achieve screen mirroring compatibility with various mobile device models on the car's infotainment system, adapting to different screen sizes and providing seamless display.

[0032] Example 1

[0033] Figure 1 is a flowchart illustrating a screen projection display method provided in Embodiment 1 of this application. This method is applicable to situations where a video stream from a mobile terminal is projected onto a vehicle infotainment system. This method can be executed by a screen projection display device, which can be implemented in hardware and / or software and is generally integrated into an electronic device.

[0034] As shown in Figure 1, the screen projection method provided in this embodiment may include the following steps:

[0035] S101. Obtain the video stream size of the video stream to be projected on the mobile terminal side and the screen size of the screen on the vehicle side.

[0036] The application scenario of this embodiment can be described as projecting a video stream displayed on a mobile terminal to a vehicle-mounted infotainment system screen without distortion. This embodiment does not consider the connection process or the video transmission process, assuming that the connection and transmission are stable. The video stream to be projected can be understood as the video stream displayed on the mobile terminal that is to be projected to the vehicle-mounted infotainment system screen. The video stream to be projected is not limited to images; h.264, H.265, mp4, and other video streams are not specifically limited here. The size of the video stream to be projected is characterized in pixels or other units. The mobile terminal can be a mobile phone, computer, or other terminal. The projection method provided in this embodiment is not only applicable to projecting a video stream played on a mobile terminal to a vehicle-mounted infotainment system, but also applicable to projection to televisions, projectors, large screens, and other scenarios. This projection method can be used for any projection display between two devices.

[0037] This step is used to obtain the size of the video stream to be projected displayed on the mobile terminal, denoted as the video stream size. The video stream to be projected may be in landscape or portrait orientation. The video stream size can be represented in the form of width and height, such as the width and height of the video stream size. Simultaneously, the dimensions of the vehicle's side screen are acquired and recorded as the screen size. The screen size can be represented in the form of width and height, such as the width and height of the screen size can be represented as... For example, the video stream size to be projected can be transmitted from the mobile terminal to the vehicle's infotainment system, and the screen size of the vehicle's infotainment system can be directly read.

[0038] S102. Based on the video stream size and screen size, and combined with the preset proportional scaling rules, determine the target projection mode of the video stream to be projected on the mobile terminal side.

[0039] The target screen casting mode is one of the following: the first screen casting mode, the second screen casting mode, the third screen casting mode, the fourth screen casting mode, the fifth screen casting mode, the sixth screen casting mode, or the seventh screen casting mode.

[0040] In this embodiment, seven projection modes are provided, denoted as the first projection mode, the second projection mode, the third projection mode, the fourth projection mode, the fifth projection mode, the sixth projection mode, and the seventh projection mode. The projection mode can be understood as the method used to project the video stream to be projected onto the vehicle's side screen for display. Users can choose whether the video stream projected onto the vehicle's side screen is displayed in full screen or not, according to their actual needs. If the user selects a non-full-screen display, the corresponding projection mode is one of the first, second, or third projection modes. If the user selects a full-screen display, the corresponding projection mode is one of the fourth, fifth, sixth, or seventh projection modes.

[0041] In this embodiment, Figure 2 is an example diagram of the first projection mode in the execution of a projection display method provided in Embodiment 1 of this application. As shown in Figure 2, the first projection mode uses the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle-mounted side screen, and the video stream size as the projection display size of the video stream on the vehicle-mounted side screen. Figure 3 is an example diagram of the second projection mode in the execution of a projection display method provided in Embodiment 1 of this application. As shown in Figure 3, the second projection mode uses the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle-mounted side screen, and the reduction result obtained by multiplying the video stream size by the vertical axis scaling factor is the projection display size of the video stream to be projected on the vehicle-mounted side screen. Figure 4 is an example diagram of the third projection mode in the execution of a projection display method according to Embodiment 1 of this application. As shown in Figure 4, the third projection mode uses the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle-mounted side screen, and the projection display size of the video stream to be projected on the vehicle-mounted side screen is the result of multiplying the video stream size by the horizontal axis scaling factor. Figure 5 is an example diagram of the fourth projection mode in the execution of a projection display method according to Embodiment 1 of this application. As shown in Figure 5, the fourth projection mode uses the enlarged result of multiplying the video stream size by the vertical axis scaling factor as the projection display size of the video stream to be projected on the vehicle-mounted side screen, and the left and right black borders are filled. Figure 6 is an example diagram of the fifth projection mode in the execution of a projection display method according to Embodiment 1 of this application. As shown in Figure 6, the fifth projection mode uses the enlarged result of multiplying the video stream size by the horizontal axis scaling factor as the projection display size of the video stream to be projected on the vehicle-mounted side screen, and the top and bottom black borders are filled. Figure 7 is an example diagram of the sixth projection mode in the execution of a projection display method provided in Embodiment 1 of this application. As shown in Figure 7, the sixth projection mode is to use the video stream size multiplied by the horizontal axis scaling factor to obtain the reduced display size of the video stream to be projected on the vehicle-mounted side screen, and the top and bottom black borders are filled. Figure 8 is an example diagram of the seventh projection mode in the execution of a projection display method provided in Embodiment 1 of this application. As shown in Figure 8, the seventh projection mode is to use the video stream size multiplied by the vertical axis scaling factor to obtain the reduced display size of the video stream to be projected on the vehicle-mounted side screen, and the left and right black borders are filled.

[0042] When casting a video stream from a mobile terminal to the vehicle's infotainment system, it's necessary to determine the origin coordinates of the projected display on the vehicle's screen, as well as the actual width and height on the screen, to ensure complete display of the projected content. If the user selects a non-full-screen display mode, the user also needs to set the starting position for the projected display. If the user selects a full-screen display mode, the starting position is automatically calculated and does not require user input.

[0043] To avoid inappropriate projection origin settings, such as setting it to the upper right / lower right corner, which could cause problems with the projected content, the projection origin needs to be set within a reasonable range of the vehicle-mounted screen to ensure proper display of the projected content. In this embodiment, the horizontal coordinate of the projection origin is less than the origin validity coefficient multiplied by the screen width, and the vertical coordinate is less than the origin validity coefficient multiplied by the screen height. The origin validity coefficient is determined based on the ratio of the video stream size to the screen size, and is greater than zero and less than the critical value of the origin validity coefficient. A critical value can be defined based on the best video effect in the actual project interface design, denoted as the origin validity coefficient critical value, which can be expressed as α. An appropriate origin validity coefficient can be selected based on the ratio of the video stream size to the vehicle-mounted screen size. This origin validity coefficient is greater than 0 and less than α, for example, α can be 1 / 2 or 3 / 5, etc. When the set origin validity coefficient is greater than the critical value of the origin validity coefficient, the projection origin cannot be set and will revert to the original size. The projection origin critical value can be set according to the actual project.

[0044] As described above, an appropriate origin validity coefficient is selected based on the ratio of the video stream size to the vehicle-side screen size to ensure optimal video display on the vehicle-side screen. For example, a smaller ratio indicates a larger vehicle-side screen size relative to the mobile terminal, meaning the selected origin point will clearly display the video stream content even when positioned relatively to the right and bottom of the vehicle-side screen; thus, a larger origin validity coefficient can be chosen. Conversely, a larger ratio indicates a smaller vehicle-side screen size relative to the mobile terminal, meaning the selected origin point may not clearly display the video stream content when positioned relatively to the right and bottom of the vehicle-side screen; therefore, a smaller origin validity coefficient is required. The origin validity coefficient ranges from 0 to a critical value. For instance, when the ratio of the video stream size to the screen size is small, the origin validity coefficient can be 1 / 2; when the ratio is large, it can be 1 / 3. In addition, optimizations can be made to prevent the set projection origin from becoming invalid and reverting to the original video stream size when it exceeds a reasonable range. The system can also provide feedback to the user via the vehicle's side screen, prompting them to reset the projection origin to a suitable value.

[0045] For example, if the selected screen projection display method is non-full-screen display, the user needs to set the coordinates of the projection origin on the vehicle-side screen. Then, based on the horizontal and vertical coordinates of the projection origin, the width and height of the video stream, and the size relationship between the width and height of the screen, the scaling of the video stream to be projected on the horizontal and vertical axes is determined. Based on the video stream size, screen size, projection origin coordinates, horizontal scaling factor, and vertical scaling factor, the target projection mode of the video stream to be projected on the mobile terminal side is determined by adopting the principle of proportional scaling on the horizontal and vertical axes.

[0046] If the selected screen mirroring display mode is full-screen display, the user does not need to set the coordinates of the screen mirroring origin on the vehicle-side screen; instead, the coordinates of the screen mirroring origin are automatically calculated. Based on the horizontal and vertical coordinates of the screen mirroring origin, the width and height of the video stream, and the size relationship between the width and height of the screen, the scaling of the video stream to be mirrored on the horizontal and vertical axes is determined. Based on the video stream size, screen size, horizontal scaling factor, and vertical scaling factor, the target screen mirroring mode of the video stream to be mirrored on the mobile terminal is determined using the principle of proportional scaling on the horizontal and vertical axes.

[0047] S103. Cast the video stream to be cast to the vehicle's side screen according to the target casting mode.

[0048] In this embodiment, when it is determined which screen casting mode needs to be used, the video stream to be cast can be cast to the vehicle-mounted screen based on the target screen casting mode.

[0049] The aforementioned technical solution includes seven projection modes. Based on the video stream size on the mobile terminal and the screen size on the vehicle's infotainment system, the projection mode is determined through proportional scaling. For different projection scenarios, a suitable mode is selected from the seven modes as the target projection mode. This allows for flexible display transformations even on mobile terminals with different resolutions, ensuring the projection effect remains unchanged without distortion, stretching, compression, out-of-bounds display, or loss of quality, maintaining optimal display quality.

[0050] Example 2

[0051] Figure 9 is a flowchart illustrating another screen projection method provided in Embodiment 2 of this application. In this embodiment, the limitation and optimization of "determining the target screen projection mode of the video stream to be projected on the mobile terminal side based on the video stream size and the screen size, combined with a preset proportional scaling rule" is optimized.

[0052] As shown in Figure 9, this embodiment 2 provides a screen projection display method, including the following steps:

[0053] S201. Obtain the video stream size of the video stream to be projected on the mobile terminal side and the screen size of the screen on the vehicle side.

[0054] S202. If the selected screen projection display mode is non-full-screen display, then based on the set screen projection origin coordinates, video stream size and screen size, combined with the set first scaling factor determination method, determine the horizontal axis scaling factor and vertical axis scaling factor, and determine the target screen projection mode based on the video stream size, screen size, screen projection origin coordinates, horizontal axis scaling factor and vertical axis scaling factor.

[0055] In this embodiment, if the selected screen projection display method is non-full-screen display, the user needs to set the coordinates of the projection origin on the vehicle-side screen. Then, based on the horizontal and vertical coordinates of the projection origin, the width and height of the video stream, and the size relationship between the screen width and height, the scaling of the video stream to be projected on the horizontal and vertical axes is determined. Based on the video stream size, screen size, projection origin coordinates, horizontal scaling factor, and vertical scaling factor, the target projection mode of the video stream to be projected on the mobile terminal side is determined using the principle of proportional scaling on the horizontal and vertical axes. If the user selects a non-full-screen display method, the corresponding projection mode is one of the first projection mode, the second projection mode, or the third projection mode.

[0056] In one embodiment, the step of determining the horizontal and vertical scaling factors based on the set projection origin coordinates, video stream size, and screen size, combined with a set first scaling factor determination method, can be optimized, including:

[0057] a1) Subtract the x-coordinate of the projection origin from the screen width and use the quotient of the video stream width as the x-axis scaling factor.

[0058] In this embodiment, if the selected screen projection display method is non-full-screen display, the horizontal scaling factor is calculated based on the screen width of the vehicle-mounted system, the horizontal coordinate of the projection origin set by the user, and the video stream width of the video stream to be projected on the mobile terminal. The coordinate system of the projection origin is: the upper left corner of the vehicle-mounted system screen is the origin, and the top and left sides of the vehicle-mounted system screen are the horizontal and vertical axes, respectively. The formula for calculating the horizontal scaling factor can be expressed as:

[0059] ,in, Indicates the scaling factor on the horizontal axis. This indicates the width of the vehicle's infotainment screen. This represents the x-coordinate of the projection origin. This indicates the width of the video stream to be projected onto the mobile terminal.

[0060] b1) Subtract the ordinate of the projection origin from the screen height and divide it by the video stream height to use as the scaling factor on the vertical axis.

[0061] In this embodiment, if the selected screen projection display method is non-full-screen display, the vertical scaling factor is calculated based on the screen height on the vehicle-mounted system, the vertical coordinate of the projection origin set by the user, and the video stream height of the video stream to be projected on the mobile terminal. The formula for calculating the vertical scaling factor can be expressed as:

[0062] ,in, Indicates the scaling factor on the vertical axis. Indicates the height of the vehicle's side screen. This represents the ordinate of the projection origin. This indicates the height of the video stream to be projected onto the mobile terminal.

[0063] The above technical solution specifies the calculation method of the horizontal and vertical scaling factors when the selected screen projection display method is non-full-screen display, providing a basis for subsequent screen projection.

[0064] In one embodiment, if the selected screen projection display method is non-full-screen display, the step of determining the target screen projection mode based on the video stream size, screen size, projection origin coordinates, horizontal scaling factor, and vertical scaling factor can be optimized, including:

[0065] a2) The sum of the horizontal coordinate of the projection origin and the width of the video stream is taken as the theoretical width of the screen, the sum of the vertical coordinate of the projection origin and the height of the video stream is taken as the theoretical height of the screen, and the theoretical width and theoretical height of the screen are taken as the theoretical size of the screen.

[0066] For example, the video stream size is represented as Screen size is expressed as The origin of the coordinate system is set by the user. The sum of the x-coordinate of the projection origin and the width of the video stream is taken as the theoretical screen width, expressed as: The theoretical screen height is defined as the sum of the vertical coordinate of the projection origin and the height of the video stream, expressed as: The theoretical width and theoretical height of the screen are used as the theoretical screen dimensions.

[0067] b2) If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, then the target projection mode is determined based on the relationship between the theoretical screen size and the screen size.

[0068] For non-full-screen display methods, if the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, the user sets the coordinates of the projection origin and determines which projection mode to use as the target projection mode based on the relationship between the theoretical screen size and the screen size.

[0069] For example, when and At that time, the origin of the coordinate system is set by the user. ,according to and The size relationship, and and Based on the size relationship, determine the target projection mode.

[0070] It can optimize the determination of the target projection mode based on the relationship between the theoretical screen size and the actual screen size, including:

[0071] b21) If the theoretical screen width is less than or equal to the screen width and the theoretical screen height is less than or equal to the screen height, then the first projection mode is used as the target projection mode.

[0072] For example, if the theoretical screen width is less than or equal to the screen width and the theoretical screen height is less than or equal to the screen height, then scaling of the video stream to be projected is not required; that is, the first projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position of the video stream to be projected on the vehicle's side screen, and the video stream size is taken as the projection display size of the video stream to be projected on the vehicle's side screen.

[0073] For example, continuing to refer to Figure 2, the video stream size is represented as Screen size is expressed as ,when and At that time, the original size of the video stream to be projected on the mobile terminal side will be used. To display the image on the screen.

[0074] b22) If the theoretical screen width is less than or equal to the screen width and the theoretical screen height is greater than the screen height, then the second screen casting mode is used as the target screen casting mode.

[0075] For example, if the theoretical screen width is less than the screen width and the theoretical screen height is greater than the screen height, the video stream to be projected needs to be compressed, with the vertical scaling factor used as the scaling basis. In other words, the second projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position for the video stream to be projected on the vehicle's side screen, and the reduction result obtained by multiplying the video stream size by the vertical scaling factor is the projection display size of the video stream on the vehicle's side screen.

[0076] For example, continuing to refer to Figure 3, when and At that time, the scaling factor of the vertical axis is calculated: The projection size is reduced to: To display, align the bottom edge of the projection screen with the bottom margin of the main screen.

[0077] b23) If the theoretical screen width is greater than the screen width and the theoretical screen height is less than or equal to the screen height, then the third screen casting mode is used as the target screen casting mode.

[0078] For example, if the theoretical screen width is greater than the screen width and the theoretical screen height is less than or equal to the screen height, the video stream to be projected needs to be compressed, with the horizontal scaling factor as the scaling basis. That is, the third projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position of the video stream to be projected on the vehicle's side screen, and the reduction result obtained by multiplying the video stream size by the horizontal scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen.

[0079] For example, continuing to refer to Figure 4, when and At that time, the horizontal scaling factor is calculated: The projection size is reduced to: To display, align the right side of the projection screen with the right margin of the screen.

[0080] The above technical solution specifies the steps for determining the target projection mode based on the relationship between the theoretical screen size and the actual screen size when the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height.

[0081] c2) If the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, then determine the target projection mode based on the relationship between the theoretical screen height and the screen height.

[0082] For example, for non-full-screen display, if the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, the user sets the coordinates of the projection origin and determines which projection mode to use as the target projection mode based on the relationship between the theoretical screen height and the screen height.

[0083] For example, when and At that time, the origin of the coordinate system is set by the user. ,according to and Based on the size relationship, determine the target projection mode.

[0084] The steps for determining the target projection mode based on the relationship between the theoretical screen height and the actual screen height can be optimized, including:

[0085] c21) If the theoretical screen height is less than or equal to the screen height, then the third screen casting mode is used as the target screen casting mode.

[0086] For example, if the theoretical screen height is less than or equal to the screen height, the video stream to be projected needs to be compressed, with the horizontal scaling factor used as the scaling basis. That is, the third projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position of the video stream to be projected on the vehicle's side screen, and the scaling result obtained by multiplying the video stream size by the horizontal scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen.

[0087] For example, continuing to refer to Figure 4, when and The origin of the coordinate system is set by the user. , At that time, according to the horizontal scaling factor: The projection size is reduced to: To display, align the right side of the projection screen with the right margin of the screen.

[0088] c22) If the theoretical screen height is greater than the screen height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second projection mode is used as the target projection mode.

[0089] For example, if the theoretical screen height is greater than the actual screen height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the video stream to be projected needs to be compressed, with the vertical scaling factor used as the scaling factor. In other words, the second projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position for the video stream to be projected on the vehicle's side screen, and the reduction result obtained by multiplying the video stream size by the vertical scaling factor is the projection display size of the video stream on the vehicle's side screen.

[0090] For example, continuing to refer to Figure 3, when When the scaling factor is: Small scaling factor As a scaling factor, the projection size is reduced to: To display, align the bottom edge of the projection screen with the bottom margin of the main screen.

[0091] c23) If the theoretical screen height is greater than the screen height and the horizontal scaling factor is less than the vertical scaling factor, then the third projection mode is used as the target projection mode.

[0092] For example, if the theoretical screen height is greater than the actual screen height, and the horizontal scaling factor is less than the vertical scaling factor, then the video stream to be projected needs to be compressed, with the horizontal scaling factor used as the scaling factor. In other words, the third projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position for the video stream to be projected on the vehicle's side screen, and the resulting reduction (multiplying the video stream size by the horizontal scaling factor) is the projection display size of the video stream on the vehicle's side screen.

[0093] For example, continuing to refer to Figure 4, when When the scaling factor is: When choosing, select the one with the smaller scaling factor. As a scaling factor, the projection size is reduced to: To display, align the right side of the projection screen with the right margin of the screen.

[0094] The above technical solution specifies the steps for determining the target projection mode based on the relationship between the theoretical screen height and the actual screen height when the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height.

[0095] d2) If the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, then the target projection mode is determined based on the relationship between the theoretical screen width and the screen width.

[0096] For example, for non-full-screen display, if the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, the user sets the coordinates of the projection origin and determines which projection mode to use as the target projection mode based on the relationship between the theoretical screen width and the screen width.

[0097] For example, when and At that time, the origin of the coordinate system is set by the user. ,according to and Based on the size relationship, determine the target projection mode.

[0098] The target projection mode can be optimized based on the relationship between the theoretical screen width and the actual screen width, including:

[0099] d21) If the theoretical screen width is less than the screen width, then the second projection mode is used as the target projection mode.

[0100] For example, if the theoretical screen width is less than or equal to the screen width, the video stream to be projected needs to be compressed, and the reduction is based on the vertical axis scaling factor, i.e., the second projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position of the video stream to be projected on the vehicle's side screen, and the reduction result obtained by multiplying the video stream size by the vertical axis scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen.

[0101] For example, continuing to refer to Figure 3, when At that time, according to the scaling factor on the vertical axis: The projection size is reduced to: To display, align the bottom edge of the projection screen with the bottom margin of the main screen.

[0102] d22) If the theoretical screen width is greater than the screen width, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second screen casting mode is used as the target screen casting mode.

[0103] For example, if the theoretical screen width is greater than the screen height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the video stream to be projected needs to be compressed, with the vertical scaling factor used as the scaling factor. In other words, the second projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position for the video stream to be projected on the vehicle's side screen, and the reduction result obtained by multiplying the video stream size by the vertical scaling factor is the projection display size of the video stream on the vehicle's side screen.

[0104] For example, continuing to refer to Figure 3, when When the scaling factor is: Choose the one with the smaller scaling factor As a scaling factor, the projection size is reduced to: To display, align the bottom edge of the projection screen with the bottom margin of the main screen.

[0105] d23) If the theoretical screen width is greater than the screen width and the horizontal scaling factor is less than the vertical scaling factor, then the third screen casting mode is used as the target screen casting mode.

[0106] For example, if the theoretical screen width is greater than the screen height, and the horizontal scaling factor is less than the vertical scaling factor, then the video stream to be projected needs to be compressed, with the horizontal scaling factor used as the scaling factor. In other words, the third projection mode is used as the target projection mode. The set projection origin coordinates are taken as the starting position for the video stream to be projected on the vehicle's side screen, and the resulting reduction (multiplying the video stream size by the horizontal scaling factor) is the projection display size of the video stream on the vehicle's side screen.

[0107] For example, continuing to refer to Figure 4, when hour, Choose the one with the smaller scaling factor As a scaling factor, the projection size is reduced to: To display, align the right side of the projection screen with the right margin of the screen.

[0108] The above technical solution specifies the steps for determining the target projection mode based on the relationship between the theoretical screen width and the screen width when the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height.

[0109] e2) If the screen width is less than the video stream width and the screen height is less than the video stream height, then the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

[0110] In this embodiment, for non-full-screen display, if the screen width is less than the video stream width and the screen height is less than the video stream height, the user sets the coordinates of the projection origin, and determines which projection mode to use as the target projection mode based on the relationship between the horizontal scaling factor and the vertical scaling factor.

[0111] For example, when At that time, the origin of the coordinate system is set by the user. Calculate the scaling factor: , ,according to and Based on the size relationship, determine the target projection mode.

[0112] The steps for determining the target projection mode based on the relationship between the horizontal and vertical scaling factors can be optimized, including:

[0113] e21) If the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second projection mode is used as the target projection mode.

[0114] In this embodiment, if the screen width is smaller than the video stream width and the screen height is smaller than the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the video stream to be projected needs to be compressed, with the vertical scaling factor used as the scaling factor. That is, the second projection mode is adopted as the target projection mode. The set projection origin coordinates are taken as the starting position for the video stream to be projected on the vehicle-mounted side screen, and the reduction result obtained by multiplying the video stream size by the vertical scaling factor is the projection display size of the video stream to be projected on the vehicle-mounted side screen.

[0115] For example, continuing to refer to Figure 3, when and When the scaling factor is: Choose the one with the smaller scaling factor As a scaling factor, the projection size is reduced to: To display, align the bottom edge of the projection screen with the bottom margin of the main screen.

[0116] e22) If the horizontal scaling factor is less than the vertical scaling factor, then the third projection mode is used as the target projection mode.

[0117] In this embodiment, if the screen width is smaller than the video stream width and the screen height is smaller than the video stream height, and the horizontal scaling factor is smaller than the vertical scaling factor, then the video stream to be projected needs to be compressed, with the horizontal scaling factor used as the scaling factor. That is, the third projection mode is adopted as the target projection mode. The set projection origin coordinates are taken as the starting position for the video stream to be projected on the vehicle-mounted side screen, and the reduction result obtained by multiplying the video stream size by the horizontal scaling factor is the projection display size of the video stream to be projected on the vehicle-mounted side screen.

[0118] For example, continuing to refer to Figure 4, when and Scaling factor: When choosing, select the one with the smaller scaling factor. As a scaling factor, the projection size is reduced to: To display, align the right side of the projection screen with the right margin of the screen.

[0119] The above technical solution specifies the steps for determining the target projection mode based on the relationship between the horizontal and vertical scaling factors when the screen width is smaller than the video stream width and the screen height is smaller than the video stream height.

[0120] S203. If the selected screen projection display method is full-screen display, then based on the video stream size and screen size, combined with the set second scaling factor determination method, determine the horizontal axis scaling factor and vertical axis scaling factor, and determine the target screen projection mode based on the video stream size, screen size, horizontal axis scaling factor and vertical axis scaling factor.

[0121] In this embodiment, if the selected screen projection display mode is full-screen display, the user does not need to set the projection origin coordinates on the vehicle-side screen; instead, the projection origin coordinates are automatically calculated. Based on the horizontal and vertical coordinates of the projection origin, the width and height of the video stream, and the size relationship between the screen width and height, the scaling of the video stream to be projected on the horizontal and vertical axes is determined. Based on the video stream size, screen size, projection origin coordinates, horizontal scaling factor, and vertical scaling factor, the target projection mode of the video stream to be projected on the mobile terminal side is determined using the principle of proportional scaling on the horizontal and vertical axes. If the user selects full-screen display, the corresponding projection mode is one of the fourth, fifth, sixth, or seventh projection modes.

[0122] In one embodiment, the determination of the horizontal and vertical scaling factors can be optimized based on the video stream size and screen size, combined with a set second scaling factor determination method, including:

[0123] a3) Use the ratio of screen width to video stream width as the horizontal scaling factor.

[0124] In this embodiment, if the selected screen projection display method is full-screen display, the horizontal scaling factor is calculated based on the screen width of the vehicle-mounted system and the video stream width of the video stream to be projected on the mobile terminal. The formula for calculating the horizontal scaling factor can be expressed as:

[0125] ,in, Indicates the scaling factor on the horizontal axis. This indicates the width of the vehicle's infotainment screen. This indicates the width of the video stream to be projected onto the mobile terminal.

[0126] b3) Use the ratio of screen height to video stream height as the scaling factor on the vertical axis.

[0127] In this embodiment, if the selected screen projection display method is full-screen display, the vertical scaling factor is calculated based on the screen height of the vehicle-mounted system and the video stream height of the video stream to be projected on the mobile terminal. The formula for calculating the vertical scaling factor can be expressed as:

[0128] ,in, Indicates the scaling factor on the horizontal axis. Indicates the height of the vehicle's side screen. This indicates the height of the video stream to be projected onto the mobile terminal.

[0129] The above technical solution specifies the calculation method of the horizontal and vertical scaling factors when the selected screen projection display method is full-screen display, providing a basis for subsequent screen projection.

[0130] In one embodiment, if the selected screen projection display method is full-screen display, the step of determining the target screen projection mode based on the video stream size, screen size, projection origin coordinates, horizontal scaling factor, and vertical scaling factor can be optimized, including:

[0131] a4) If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, then the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

[0132] In this embodiment, for full-screen display mode, if the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, the target screen casting mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

[0133] For example, when and At that time, the scaling factor is calculated: , ,according to and Based on the size relationship, determine the target projection mode.

[0134] If the screen width is greater than the video stream width and the screen height is greater than the screen height, the target projection mode is determined based on the relationship between the horizontal and vertical scaling factors, including:

[0135] a41) If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the fourth screen casting mode is used as the target screen casting mode.

[0136] In this embodiment, if the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the video stream to be projected needs to be enlarged, with the vertical scaling factor as the basis for enlargement; that is, the fourth projection mode is used as the target projection mode. The enlarged result obtained by multiplying the video stream size by the vertical scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen, with black borders added on the left and right sides.

[0137] For example, continuing to refer to Figure 5, when and hour, Small scaling factor As a scaling factor, the projection size is magnified as follows: The display is performed with black borders filling the blank areas on the left and right. When projecting, a projection origin and the actual projection size need to be selected to fully display the content. In full-screen display, the display size of the projected video stream must be ensured. The projection origin is located at the upper edge of the vehicle's side screen, and the selected origin must guarantee that the video stream can be displayed at the calculated size. In one embodiment, to accommodate user habits and ensure a good viewing experience, the projection origin coordinates can be optionally set as follows: The blank areas on the left and right are filled with black borders.

[0138] a42) If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is less than the vertical scaling factor, then the fifth screen casting mode is used as the target screen casting mode.

[0139] In this embodiment, if the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is less than the vertical scaling factor, then the video stream to be projected needs to be enlarged. The horizontal scaling factor is used as the basis for enlargement, i.e., the fifth projection mode is adopted as the target projection mode. The enlarged result obtained by multiplying the video stream size by the horizontal scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen, with black borders added at the top and bottom.

[0140] For example, continuing to refer to Figure 6, when and When scaling factor: Choose the one with the smaller scaling factor As a scaling factor, the projection size is magnified as follows: The display is performed with black borders filling the top and bottom blank areas. When projecting, a projection origin and the actual projection size need to be selected to fully display the content. In full-screen mode, the display size of the projected video stream must be ensured. The projection origin is located at the left edge of the vehicle's side screen, and the selected origin must guarantee that the video stream can be displayed at the calculated size. In one embodiment, to accommodate user habits and ensure a good viewing experience, the projection origin coordinates can be set to... The blank areas at the top and bottom are filled with black borders.

[0141] The above technical solution specifies the steps for determining the target projection mode based on the relationship between the horizontal and vertical scaling factors when the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the screen height.

[0142] b4) If the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, then the sixth screen casting mode is used as the target screen casting mode.

[0143] In this embodiment, if the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, the video stream to be projected needs to be compressed, with the horizontal scaling factor as the scaling basis, i.e., the sixth projection mode is used as the target projection mode. The reduction result obtained by multiplying the video stream size by the horizontal scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen, with black borders added at the top and bottom. For example, continuing to refer to Figure 7, when... and hour, Choose the one with the smaller scaling factor As a scaling factor, the projection size is reduced to: The display is performed with black borders filling the top and bottom blank areas. When projecting, a projection origin and the actual projection size need to be selected to fully display the content. In full-screen mode, the display size of the projected video stream must be ensured. The projection origin is located at the left edge of the vehicle's side screen, and the selected origin must guarantee that the video stream can be displayed at the calculated size. In one embodiment, to accommodate user habits and ensure a good viewing experience, the projection origin coordinates can be set to... The blank areas at the top and bottom are filled with black borders.

[0144] c4) If the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, then the seventh screen casting mode is used as the target screen casting mode.

[0145] In this embodiment, if the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, the video stream to be projected needs to be compressed, with the vertical scaling factor as the scaling basis, i.e., the seventh projection mode is used as the target projection mode. The reduction result obtained by multiplying the video stream size by the vertical scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen, with black borders on the left and right sides added. For example, continuing to refer to Figure 8, when... and hour, Choose the one with the smaller scaling factor As a scaling factor, the projection size is reduced to: The display is performed with black borders filling the blank areas on the left and right. When projecting, a projection origin and the actual projection size must be selected to fully display the content. In full-screen mode, the display size of the projected video stream must be ensured. The projection origin is located at the upper edge of the vehicle's side screen, and the selected origin must guarantee that the video stream can be displayed at the calculated size. In one embodiment, to accommodate user habits and ensure a good viewing experience, the projection origin coordinates can be set to... The blank areas on the left and right are filled with black borders.

[0146] d4) If the screen width is less than the video stream width and the screen height is less than the video stream height, the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

[0147] In this embodiment, if the screen width is less than the video stream width and the screen height is less than the video stream height, the target screen casting mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

[0148] For example, when and At that time, the scaling factor is calculated: , ,according to and Based on the size relationship, determine the target projection mode.

[0149] If the screen width is smaller than the video stream width and the screen height is smaller than the video stream height, the target projection mode can be determined based on the relationship between the horizontal and vertical scaling factors, including:

[0150] d41) If the screen width is less than the video stream width and the screen height is less than the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the seventh projection mode is used as the target projection mode.

[0151] In this embodiment, if the screen width is smaller than the video stream width and the screen height is smaller than the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the video stream to be projected needs to be scaled down, with the vertical scaling factor as the scaling criterion. That is, the seventh projection mode is used as the target projection mode. The scaled-down result obtained by multiplying the video stream size by the vertical scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen, with black borders added on the left and right sides.

[0152] For example, continuing to refer to Figure 8, when the user sets the screen mirroring to full-screen display, when and At that time, the scaling factor is calculated: , When scaling factor: Choose the one with the smaller scaling factor As a scaling factor, the projection size is reduced to: In one embodiment, to accommodate user habits and ensure a good viewing experience, the origin of the projection display coordinates can be set to... The blank areas on the left and right are filled with black borders.

[0153] d42) If the screen width is less than the video stream width and the screen height is less than the video stream height, and the horizontal scaling factor is less than the vertical scaling factor, then the sixth projection mode is used as the target projection mode.

[0154] In this embodiment, if the screen width is smaller than the video stream width and the screen height is smaller than the video stream height, and the horizontal scaling factor is smaller than the vertical scaling factor, then the video stream to be projected needs to be scaled down, with the horizontal scaling factor as the scaling criterion, i.e., the sixth projection mode is used as the target projection mode. The scaled-down result obtained by multiplying the video stream size by the horizontal scaling factor is the projection display size of the video stream to be projected on the vehicle's side screen, with black borders added at the top and bottom.

[0155] For example, continuing to refer to Figure 7, when the user sets the screen mirroring to full-screen display, when and At that time, the scaling factor is calculated: , When scaling factor: Choose the one with the smaller scaling factor As a scaling factor, the projection size is reduced to: In one embodiment, to accommodate user habits and ensure a good viewing experience, the origin of the projection display coordinates can be set to... The blank areas on the left and right are filled with black borders.

[0156] S204. According to the target projection mode, project the video stream to be projected onto the side screen of the vehicle's infotainment system.

[0157] The above technical solution specifies how to determine the target projection mode for the video stream from the mobile terminal to the vehicle's infotainment system when the projection display is either non-full-screen or full-screen. For non-full-screen displays, one of the first, second, or third projection modes is used as the target projection mode; for full-screen displays, one of the fourth, fifth, sixth, or seventh projection modes is used. This ensures that even when the mobile terminal and the vehicle's infotainment system are not compatible, the display can adaptively display a reasonable size without distortion or deformation, guaranteeing the best user experience. It also ensures compatibility with various mobile terminal models on the vehicle's infotainment system, adapting to different screen sizes for seamless projection display.

[0158] As an optional embodiment of this application, the method further includes: when the video stream to be projected on the mobile terminal side switches between landscape and portrait modes...

[0159] a5) If the screen projection display mode selected before switching between portrait and landscape modes is non-full-screen display, then after switching between portrait and landscape modes, the original coordinates of the projection point remain unchanged, and the steps to determine the target projection mode continue to be executed.

[0160] In this embodiment, when the video stream to be projected on the mobile terminal switches from landscape to portrait or vice versa, in non-full-screen mode, the coordinates of the projection origin are... The display size remains unchanged, based on the updated video stream size of the video stream to be projected. Follow the same steps as described above: determine the target casting mode and cast the screen according to the target casting mode. Use one of the first, second, or third casting modes as the target casting mode.

[0161] b5) If the screen projection display mode selected before switching between portrait and landscape modes is full-screen display, then after switching between portrait and landscape modes, the full-screen display mode will remain unchanged, and the steps to determine the target screen projection mode will continue to be executed.

[0162] In this embodiment, when the video stream to be projected on the mobile terminal switches from landscape to portrait or vice versa, it remains in full-screen mode and is processed in the same way as described above, i.e., the target projection mode is determined and projection is performed according to the target projection mode. One of the fourth, fifth, sixth, or seventh projection modes is used as the target projection mode.

[0163] Users can also choose to switch from non-fullscreen display to fullscreen display, or from fullscreen display to non-fullscreen display. In this case, the steps for determining the target projection mode described above will still be followed, and will not be repeated here.

[0164] The above steps add functionality for handling screen mirroring of mobile terminal video streams that need to be projected, including switching between portrait and landscape modes.

[0165] As another optional embodiment of this application, after casting the video stream to be cast to the vehicle side screen, the method further includes: if the selected casting display mode is non-full-screen display, then receiving the user's scaling operation on the cast video stream on the vehicle side screen, wherein the scaling operation is to drag any corner vertex of the cast video stream to enlarge or shrink the video stream.

[0166] In this embodiment, if the selected screen projection display method is non-full-screen display, the user can also adjust the size of the projected video stream on the vehicle-mounted screen, such as dragging any corner vertex of the projected video stream to zoom in or out. This operation is called a scaling operation. It should be noted that if the projected video stream on the vehicle-mounted screen is being zoomed in, it cannot be dragged any further when the dragged corner vertex reaches a certain boundary on the vehicle-mounted screen.

[0167] The above technical solution adds the ability for users to drag the projected video stream, thus meeting users' personalized needs.

[0168] Example 3

[0169] Figure 10 is a schematic diagram of a screen projection display device provided in Embodiment 3 of this application. This device is suitable for projecting video streams from a mobile terminal onto a vehicle infotainment system. The screen projection display device can be implemented in hardware and / or software and is generally integrated into an electronic device. As shown in Figure 10, the system includes: a size acquisition module 31, a mode determination module 32, and a screen projection display module 33; wherein,

[0170] Size acquisition module 31 is used to acquire the video stream size of the video stream to be projected on the mobile terminal side and the screen size of the screen on the vehicle side;

[0171] The mode determination module 32 is used to determine the target projection mode of the video stream to be projected on the mobile terminal side based on the video stream size and screen size, combined with the preset proportional scaling rules. The target projection mode is one of the first projection mode, the second projection mode, the third projection mode, the fourth projection mode, the fifth projection mode, the sixth projection mode, or the seventh projection mode.

[0172] The screen projection module 33 is used to project the video stream to be projected onto the vehicle's side screen according to the target screen projection mode.

[0173] This application provides a screen projection display device with seven projection modes. Based on the video stream size of the video stream to be projected on the mobile terminal and the screen size of the vehicle-mounted screen, the device determines which projection mode to use by proportional scaling. For different projection scenarios, a suitable projection mode is selected from the seven modes as the target projection mode. This allows for flexible transformation of the projection display using mobile terminals with different resolutions, ensuring that the projection effect is not distorted, stretched, compressed, or out of bounds, maintaining optimal display quality.

[0174] Optionally, the first projection mode is to take the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle side screen, and take the video stream size as the projection display size of the video stream to be projected on the vehicle side screen;

[0175] The second projection mode uses the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle side screen, and the reduction result obtained by multiplying the video stream size by the vertical axis scaling factor is the projection display size of the video stream to be projected on the vehicle side screen.

[0176] The third projection mode uses the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle side screen, and the reduction result obtained by multiplying the video stream size by the horizontal axis scaling factor is the projection display size of the video stream to be projected on the vehicle side screen.

[0177] The fourth projection mode is to multiply the video stream size by the vertical axis scaling factor to obtain the projection display size of the video stream to be projected on the side screen of the vehicle, and fill the left and right black borders.

[0178] The fifth projection mode is to multiply the video stream size by the horizontal scaling factor to obtain the projection display size of the video stream on the side screen of the vehicle, and fill the top and bottom black borders.

[0179] The sixth projection mode is to multiply the video stream size by the horizontal scaling factor to obtain the reduced size of the video stream to be projected onto the vehicle's side screen, and fill the top and bottom black borders.

[0180] The seventh projection mode is to multiply the video stream size by the vertical axis scaling factor to obtain the projection display size of the video stream on the side screen of the vehicle, and fill the black borders on the left and right sides.

[0181] The horizontal coordinate of the projection origin is less than the origin validity coefficient multiplied by the screen width, and the vertical coordinate of the projection origin is less than the origin validity coefficient multiplied by the screen height. The origin validity coefficient is determined according to the ratio of the video stream size to the screen size. The origin validity coefficient is greater than zero and less than the origin validity coefficient threshold value.

[0182] Optionally, the pattern determination module 32 includes:

[0183] The non-full-screen determination unit is used to determine the horizontal and vertical scaling factors based on the set projection origin coordinates, video stream size, and screen size, combined with the set first scaling factor determination method, if the selected projection display mode is non-full-screen display, and to determine the target projection mode based on the video stream size, screen size, projection origin coordinates, horizontal scaling factor, and vertical scaling factor.

[0184] The full-screen determination unit is used to determine the horizontal and vertical scaling factors based on the video stream size and screen size, combined with the set second scaling factor determination method, if the selected screen projection display method is full-screen display, and to determine the target screen projection mode based on the video stream size, screen size, screen projection origin coordinates, horizontal scaling factor, and vertical scaling factor.

[0185] Optionally, the non-full-screen determination unit includes a first factor determination subunit, used for:

[0186] The horizontal scaling factor is calculated by subtracting the horizontal coordinate of the projection origin from the screen width and then dividing the result by the video stream width.

[0187] The vertical scaling factor is calculated by subtracting the ordinate of the projection origin from the screen height and then dividing it by the video stream height.

[0188] Optionally, the full-screen determination unit includes a second factor determination subunit, used for:

[0189] Use the ratio of screen width to video stream width as the horizontal scaling factor;

[0190] Use the ratio of screen height to video stream height as the scaling factor on the vertical axis.

[0191] Optionally, the non-full-screen determination unit further includes a first mode determination subunit, which determines the mode if the selected screen projection display method is non-full-screen display.

[0192] The first mode determines the sub-unit, specifically used for:

[0193] The sum of the horizontal coordinate of the projection origin and the width of the video stream is taken as the theoretical screen width, the sum of the vertical coordinate of the projection origin and the height of the video stream is taken as the theoretical screen height, and the theoretical screen width and theoretical screen height are taken as the theoretical screen size.

[0194] If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, then the target projection mode is determined based on the relationship between the theoretical screen size and the screen size.

[0195] If the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, the target projection mode is determined based on the relationship between the theoretical screen height and the screen height.

[0196] If the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, then the target projection mode is determined based on the relationship between the theoretical screen width and the screen width.

[0197] If the screen width is less than the video stream width and the screen height is less than the video stream height, the target projection mode is determined based on the relationship between the horizontal and vertical scaling factors.

[0198] Optionally, the target projection mode is determined based on the relationship between the theoretical screen size and the actual screen size, including:

[0199] If the theoretical screen width is less than or equal to the screen width and the theoretical screen height is less than or equal to the screen height, then the first screen casting mode will be used as the target screen casting mode.

[0200] If the theoretical screen width is less than or equal to the screen width and the theoretical screen height is greater than the screen height, then the second screen casting mode will be used as the target screen casting mode.

[0201] If the theoretical screen width is greater than the screen width and the theoretical screen height is less than or equal to the screen height, then the third screen casting mode will be used as the target screen casting mode.

[0202] Optionally, the target projection mode is determined based on the relationship between the theoretical screen height and the screen height, including:

[0203] If the theoretical screen height is less than or equal to the screen height, then the third screen casting mode will be used as the target screen casting mode.

[0204] If the theoretical screen height is greater than the screen height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second screen casting mode is used as the target screen casting mode.

[0205] If the theoretical screen height is greater than the screen height, and the horizontal scaling factor is less than the vertical scaling factor, then the third screen casting mode will be used as the target screen casting mode.

[0206] Optionally, the target projection mode is determined based on the relationship between the theoretical screen width and the screen width, including:

[0207] If the theoretical screen width is less than or equal to the screen width, the second screen casting mode will be used as the target screen casting mode.

[0208] If the theoretical screen width is greater than the screen width, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second screen casting mode is used as the target screen casting mode.

[0209] If the theoretical screen width is greater than the screen width and the horizontal scaling factor is less than the vertical scaling factor, then the third screen casting mode will be used as the target screen casting mode.

[0210] Optionally, the full-screen display unit includes a second scaling factor determining subunit, used for:

[0211] If the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second projection mode is used as the target projection mode.

[0212] If the horizontal scaling factor is less than the vertical scaling factor, then the third projection mode is used as the target projection mode.

[0213] Optionally, the non-fullscreen determination unit further includes a second mode determination subunit. If the selected screen projection display method is fullscreen display, the second mode determination subunit is used for:

[0214] If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

[0215] If the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, then the sixth screen casting mode will be used as the target screen casting mode.

[0216] If the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, then the seventh screen casting mode will be used as the target screen casting mode.

[0217] If the screen width is less than the video stream width and the screen height is less than the video stream height, the target projection mode is determined based on the relationship between the horizontal and vertical scaling factors.

[0218] Optionally, if the screen width is smaller than the video stream width and the screen height is smaller than the video stream height, the target projection mode is determined based on the relationship between the horizontal and vertical scaling factors, including:

[0219] If the screen width is less than the video stream width and the screen height is less than the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the seventh screen casting mode will be used as the target screen casting mode.

[0220] If the screen width is less than the video stream width and the screen height is less than the video stream height, and the horizontal scaling factor is less than the vertical scaling factor, then the sixth screen casting mode will be used as the target screen casting mode.

[0221] Optionally, if the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the screen height, the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor, including:

[0222] If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is greater than the vertical scaling factor, then the fourth screen casting mode is used as the target screen casting mode.

[0223] If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is less than the vertical scaling factor, then the fifth screen casting mode will be used as the target screen casting mode.

[0224] Optionally, the device also includes a landscape / portrait switching module, used to: when the video stream to be projected on the mobile terminal side switches between landscape and portrait modes,

[0225] If the selected screen projection display mode before switching between landscape and portrait modes is non-full-screen display, then after switching between landscape and portrait modes, the original coordinates of the projection point will remain unchanged, and the steps to determine the target projection mode will continue to be executed.

[0226] If the selected screen mirroring mode before switching between portrait and landscape orientations is full-screen display, then after switching between portrait and landscape orientations, the full-screen display mode will remain unchanged, and the steps to determine the target screen mirroring mode will continue.

[0227] Optionally, the device also includes a projection adjustment module, which, after projecting the video stream to be projected onto the vehicle's side screen, is used for:

[0228] If the selected screen projection display method is non-full-screen display, the system will receive zoom operations from the user on the projected video stream on the vehicle's side screen. The zoom operation involves dragging any corner vertex of the projected video stream to enlarge or reduce the video stream.

[0229] The screen projection display device provided in this application embodiment can execute the screen projection display method provided in any embodiment of this application, and has the corresponding functional modules and effects of the execution method.

[0230] Example 4

[0231] Figure 11 is a schematic diagram of the structure of an electronic device provided in Embodiment 4 of this application. Electronic devices include, for example, in-vehicle systems and televisions. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or claimed herein.

[0232] As shown in Figure 11, the electronic device 40 includes at least one processor 41 and a memory, such as a read-only memory (ROM) 42 or a random access memory (RAM) 43, communicatively connected to the at least one processor 41. The memory stores computer programs executable by the at least one processor. The processor 41 can perform various appropriate actions and processes based on the computer program stored in the ROM 42 or loaded from storage unit 48 into the RAM 43. The RAM 43 can also store various programs and data required for the operation of the electronic device 40. The processor 41, ROM 42, and RAM 43 are interconnected via a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0233] Multiple components in electronic device 40 are connected to I / O interface 45, including: input unit 46, such as keyboard, mouse, etc.; output unit 47, such as various types of monitors, speakers, etc.; storage unit 48, such as disk, optical disk, etc.; and communication unit 49, such as network card, modem, wireless transceiver, etc. Communication unit 49 allows electronic device 40 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0234] Processor 41 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 41 performs the various methods and processes described above, such as screen projection display methods.

[0235] In some embodiments, the screen projection method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 40 via ROM 42 and / or communication unit 49. When the computer program is loaded into RAM 43 and executed by processor 41, one or more steps of the screen projection method described above may be performed. Alternatively, in other embodiments, processor 41 may be configured to perform the screen projection method by any other suitable means (e.g., by means of firmware).

[0236] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0237] Computer programs used to implement the methods of this application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0238] In the context of this application, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A machine-readable storage medium may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0239] To provide interaction with the user, the systems and technologies described herein can be implemented in a vehicle having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the vehicle. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0240] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or middleware components (e.g., application servers), or frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0241] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. The client-server relationship is established by running computer programs on the respective computers that establish this relationship. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service ecosystem. This addresses the shortcomings of traditional physical hosting and VPS services, such as high management difficulty and weak business scalability.

[0242] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the screen projection display method provided in any embodiment of this application.

[0243] In implementing a computer program product, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0244] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

Claims

1. A screen projection display method, comprising: Obtain the video stream size of the video stream to be projected from the mobile terminal and the screen size of the in-vehicle screen; Based on the video stream size and the screen size, and combined with the preset proportional scaling rules, the target projection mode of the video stream to be projected on the mobile terminal side is determined. The target projection mode is one of the following: the first projection mode, the second projection mode, the third projection mode, the fourth projection mode, the fifth projection mode, the sixth projection mode, or the seventh projection mode. According to the target projection mode, the video stream to be projected is projected onto the vehicle's side screen.

2. The method according to claim 1, wherein, The first projection mode is to use the set projection origin coordinates as the starting position of the display of the video stream to be projected on the vehicle side screen, and use the video stream size as the projection display size of the video stream to be projected on the vehicle side screen; The second projection mode uses the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle side screen, and the reduction result obtained by multiplying the video stream size by the vertical axis scaling factor is the projection display size of the video stream to be projected on the vehicle side screen. The third projection mode uses the set projection origin coordinates as the starting position of the video stream to be projected on the vehicle side screen, and the reduction result obtained by multiplying the video stream size by the horizontal axis scaling factor is the projection display size of the video stream to be projected on the vehicle side screen. The fourth projection mode is to multiply the video stream size by the vertical axis scaling factor to obtain the projection display size of the video stream to be projected on the vehicle side screen, and fill the left and right black borders. The fifth projection mode is to use the magnified result obtained by multiplying the video stream size by the horizontal scaling factor as the projection display size of the video stream to be projected on the vehicle side screen, and to fill the top and bottom black borders. The sixth projection mode is to use the video stream size multiplied by the horizontal scaling factor to obtain the reduced size of the video stream to be projected onto the vehicle's side screen, and to fill the top and bottom black borders. The seventh projection mode is to use the video stream size multiplied by the vertical axis scaling factor to obtain the projection display size of the video stream to be projected on the vehicle's side screen, and to fill the left and right black borders. The horizontal coordinate of the projection origin is less than the origin validity coefficient multiplied by the screen width, and the vertical coordinate of the projection origin is less than the origin validity coefficient multiplied by the screen height. The origin validity coefficient is determined according to the ratio of the video stream size to the screen size. The origin validity coefficient is greater than zero and less than the origin validity coefficient threshold value.

3. The method according to claim 1, wherein, The step of determining the target projection mode of the video stream to be projected on the mobile terminal side based on the video stream size and the screen size, combined with a preset proportional scaling rule, includes: If the selected screen projection display method is non-full-screen display, then based on the set screen projection origin coordinates, the video stream size, and the screen size, combined with the set first scaling factor determination method, the horizontal axis scaling factor and the vertical axis scaling factor are determined, and based on the video stream size, the screen size, the screen projection origin coordinates, the horizontal axis scaling factor, and the vertical axis scaling factor, the target screen projection mode is determined; If the selected screen projection display method is full-screen display, then based on the video stream size and the screen size, combined with the set second scaling factor determination method, the horizontal axis scaling factor and the vertical axis scaling factor are determined, and based on the video stream size, the screen size, the horizontal axis scaling factor and the vertical axis scaling factor, the target screen projection mode is determined.

4. The method according to claim 3, wherein, The step of determining the horizontal and vertical scaling factors based on the set projection origin coordinates, the video stream size, and the screen size, combined with the set first scaling factor determination method, includes: The horizontal scaling factor is calculated by subtracting the horizontal coordinate of the projection origin from the screen width and then dividing the result by the video stream width. The vertical scaling factor is calculated by subtracting the ordinate of the projection origin from the screen height and then dividing it by the video stream height.

5. The method according to claim 3, wherein, The step of determining the horizontal and vertical scaling factors based on the video stream size and the screen size, combined with a set second scaling factor determination method, includes: Use the ratio of screen width to video stream width as the horizontal scaling factor; Use the ratio of screen height to video stream height as the scaling factor on the vertical axis.

6. The method according to claim 3, wherein, If the selected screen mirroring display method is non-full-screen display; The step of determining the target projection mode based on the video stream size, the screen size, the projection origin coordinates, the horizontal scaling factor, and the vertical scaling factor includes: The sum of the horizontal coordinate of the projection origin and the width of the video stream is taken as the theoretical screen width, and the sum of the vertical coordinate of the projection origin and the height of the video stream is taken as the theoretical screen height. The theoretical screen width and theoretical screen height are taken as the theoretical screen size. If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, then the target projection mode is determined based on the relationship between the theoretical screen size and the screen size. If the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, then the target projection mode is determined based on the relationship between the theoretical screen height and the screen height. If the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, then the target projection mode is determined based on the relationship between the theoretical screen width and the screen width. If the screen width is less than the video stream width and the screen height is less than the video stream height, then the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

7. The method according to claim 6, wherein, Determining the target projection mode based on the relationship between the theoretical screen size and the screen size includes: If the theoretical screen width is less than or equal to the screen width and the theoretical screen height is less than or equal to the screen height, then the first projection mode is adopted as the target projection mode. If the theoretical screen width is less than or equal to the screen width and the theoretical screen height is greater than the screen height, then the second screen projection mode is used as the target screen projection mode. If the theoretical screen width is greater than the screen width and the theoretical screen height is less than or equal to the screen height, then the third screen projection mode is used as the target screen projection mode.

8. The method according to claim 6, wherein, The step of determining the target projection mode based on the relationship between the theoretical screen height and the screen height includes: If the theoretical screen height is less than or equal to the screen height, then the third projection mode is used as the target projection mode. If the theoretical screen height is greater than the screen height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second projection mode is adopted as the target projection mode. If the theoretical screen height is greater than the screen height, and the horizontal scaling factor is less than the vertical scaling factor, then the third projection mode is adopted as the target projection mode.

9. The method according to claim 6, wherein, The step of determining the target projection mode based on the relationship between the theoretical screen width and the screen width includes: If the theoretical screen width is less than or equal to the screen width, then the second projection mode is used as the target projection mode. If the theoretical screen width is greater than the screen width, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second projection mode is adopted as the target projection mode. If the theoretical screen width is greater than the screen width, and the horizontal scaling factor is less than the vertical scaling factor, then the third projection mode is adopted as the target projection mode.

10. The method according to claim 6, wherein, Determining the target projection mode based on the relationship between the horizontal and vertical scaling factors includes: If the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the second projection mode is adopted as the target projection mode. If the horizontal scaling factor is less than the vertical scaling factor, then the third projection mode is used as the target projection mode.

11. The method according to claim 3, wherein, If the selected screen mirroring display method is full-screen display; Determining the target projection mode based on the video stream size, the screen size, the horizontal scaling factor, and the vertical scaling factor includes: If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, then the target projection mode is determined according to the relationship between the horizontal scaling factor and the vertical scaling factor. If the screen width is less than the video stream width and the screen height is greater than or equal to the video stream height, then the sixth projection mode is adopted as the target projection mode. If the screen width is greater than or equal to the video stream width and the screen height is less than the video stream height, then the seventh projection mode is adopted as the target projection mode. If the screen width is less than the video stream width and the screen height is less than the video stream height, then the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor.

12. The method according to claim 11, wherein, If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the screen height, then the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor, including: If the screen width is greater than or equal to the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the fourth projection mode is adopted as the target projection mode. If the screen width is greater than the video stream width and the screen height is greater than or equal to the video stream height, and the horizontal scaling factor is less than the vertical scaling factor, then the fifth projection mode is adopted as the target projection mode.

13. The method according to claim 11, wherein, If the screen width is less than the video stream width and the screen height is less than the video stream height, then the target projection mode is determined based on the relationship between the horizontal scaling factor and the vertical scaling factor, including: If the screen width is less than the video stream width and the screen height is less than the video stream height, and the horizontal scaling factor is greater than or equal to the vertical scaling factor, then the seventh projection mode is adopted as the target projection mode. If the screen width is less than the video stream width and the screen height is less than the video stream height, and the horizontal scaling factor is less than the vertical scaling factor, then the sixth projection mode is adopted as the target projection mode.

14. The method according to claim 1, further comprising: When the video stream to be projected on the mobile terminal side switches between landscape and portrait modes. If the selected screen projection display mode before switching between landscape and portrait modes is non-full-screen display, then after switching between landscape and portrait modes, the original coordinates of the projection point remain unchanged, and the step of determining the target projection mode continues to be executed. If the selected screen projection display mode before switching between portrait and landscape orientations is full-screen display, then after switching between portrait and landscape orientations, the full-screen display mode will remain unchanged, and the step of determining the target screen projection mode will continue to be executed.

15. The method according to claim 1, further comprising, after casting the video stream to be projected to the vehicle-mounted screen: If the selected screen projection display method is non-full-screen display, then the user's zoom operation on the projected video stream on the vehicle side screen is received. The zoom operation is to drag any corner vertex of the projected video stream to enlarge or reduce the video stream.

16. A projection display device, comprising: The size acquisition module is configured to acquire the video stream size of the video stream to be projected on the mobile terminal side and the screen size of the screen on the vehicle side. The mode determination module is configured to determine the target projection mode of the video stream to be projected on the mobile terminal side based on the video stream size and the screen size, combined with a preset proportional scaling rule. The target projection mode includes at least one of the following: a first projection mode, a second projection mode, a third projection mode, a fourth projection mode, a fifth projection mode, a sixth projection mode, or a seventh projection mode. The screen projection module is configured to project the video stream to be projected onto the vehicle-mounted side screen according to the target screen projection mode.

17. An electronic device comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the screen projection display method as described in any one of claims 1-15.

18. A computer-readable storage medium, wherein, The computer-readable storage medium stores computer instructions that cause a processor to execute the screen projection display method as described in any one of claims 1-15.

Images