Screen projection method and device

By obtaining and judging the screen projection conditions of the display module on the vehicle, projecting the screen projection information on the terminal device to the appropriate display module, the problem of distraction when the driver uses the terminal device during driving is solved, and driving is improved Security.

CN112861638BActive Publication Date: 2025-02-18HUAWEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110048469.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-14
Publication Date
2025-02-18
Estimated Expiration
2041-01-14

AI Technical Summary

Technical Problem

In the prior art, when a driver uses terminal devices such as mobile phones during driving, he or she needs to frequently turn his head to view the central control screen, resulting in distraction and increasing driving risks.

Method used

By obtaining the screen projection conditions when the display module on the vehicle is projected, including driving speed, traffic scene type, number of passengers, driver fatigue status and obstacle distance, etc., we can determine whether the screen projection conditions are met, and the projection conditions on the terminal device is cast The screen information is cast to the corresponding display module.

Benefits of technology

It realizes the rational allocation of screen projection information on the terminal device to different display modules on the vehicle, so that the driver can quickly obtain information, reduce the probability of distraction, and improve driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112861638B_ABST
    Figure CN112861638B_ABST
Patent Text Reader

Abstract

An embodiment of the present application discloses a screen projection method and device, which can be applied in the automotive field. The method includes: a terminal device (or a vehicle) obtains multiple screen projection conditions for projecting multiple display modules on the vehicle, and one display module corresponds to one screen projection condition. The screen projection condition can be set according to the vehicle's driving information (such as the vehicle's driving speed, the type of traffic scene it is in, etc.), or according to the characteristic information of the application (such as the application type of the first application running on the terminal device, the first application reaching a preset usage frequency, etc.). When the first screen projection condition is met, the screen projection information of the first application is projected to the first display module corresponding to the first screen projection condition, thereby realizing the reasonable distribution of the screen projection information on the terminal device to different display modules of the vehicle, so that the driver can quickly obtain the information on the terminal device, reduce the probability of the driver's attention being distracted, and reduce the interference of the screen projection information on the driver's driving, thereby improving driving safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of screen projection display, and in particular to a screen projection method and device. Background Art

[0002] With the improvement of the overall economic level of society and the rapid development of automobile technology, in the field of automobile consumption, people have shifted from traditional consumption that satisfies the functional use of automobiles to new consumption that pursues automobile life experience. The number of screens (also called display modules) in cars has also increased, while the number of physical buttons has decreased. Most of the information and functions will be carried on the car's central control screen, such as Figure 1 In addition, the rapid development of intelligent terminal devices (such as mobile phones) has made people more and more dependent on mobile phones and other terminal devices. When people are driving a car, they will inevitably encounter situations where they need to use terminal devices, such as Figure 1 The diagram (b) in the figure shows that the driver uses a mobile phone for navigation. However, the law stipulates that drivers are not allowed to use mobile phones or other terminal devices while driving, as this will bring danger to driving.

[0003] Therefore, the existing solution is to project the information to be displayed on terminal devices such as mobile phones directly onto the central control screen of the car, and users can directly obtain relevant information through the information displayed on the central control screen.

[0004] However, the central control screen is not the best viewing area for the driver in all circumstances. Viewing the central control screen requires the driver to turn his head and shift his gaze. Frequent viewing can easily distract the driver and bring danger to the driving process. Summary of the invention

[0005] An embodiment of the present application provides a screen projection method and device, which obtains the projection conditions that need to be met when the display module on the vehicle is projected (such as the vehicle's driving speed, the type of traffic scene, the type of application running on the terminal device, the preset usage frequency, etc.). When the projection conditions are met, the projection information of the application running on the terminal device is projected to the corresponding display module, thereby realizing the reasonable distribution of the projection information on the terminal device to different display modules on the vehicle, so that the driver can quickly obtain the information on the terminal device, reducing the probability of the driver's attention being distracted, reducing the interference of the projection information on the driver's driving, and thus improving driving safety.

[0006] Based on this, the embodiments of the present application provide the following technical solutions:

[0007] In the first aspect, the embodiment of the present application first provides a projection method, which can be used in the field of automobile consumption. The method includes: first, the terminal device (or target vehicle) will obtain the first projection condition for the first display module on the target vehicle to be projected. The first projection condition can be related to the driving information of the target vehicle, or it can be related to the characteristic information of the application to be projected. The specific information is not limited here. Specifically, since the driving information of the vehicle can be characterized by a variety of parameters, for example, the driving speed of the vehicle, the type of traffic scene in which the vehicle is located, the number of passengers in the vehicle, the fatigue state of the vehicle driver, the distance between the vehicle and the obstacle, etc. Therefore, in the embodiment of the present application, the first projection condition can be set according to the driving information of the target vehicle. In this case, when the first projection condition is met, it includes: when the driving information of the target vehicle meets the first projection condition; the first projection condition can be set based on the driving information of the target vehicle, and can also be set according to the characteristic information of the application to be projected. In this case, when the first projection condition is met, it includes: when the characteristic information of the first application to be projected on the terminal device meets the first projection condition. When the first projection condition is met and a communication connection is established between the terminal device and the vehicle, the projection information of the first application to be projected on the terminal device is projected to the first display module. For example, the judgment method for satisfying the first projection condition may be that the characteristic information of the first application to be projected on the terminal device satisfies the first projection condition, or that the driving information of the target vehicle satisfies the first projection condition. The specific details are not limited here. In an embodiment of the present application, the first display module is one of multiple display modules on the target vehicle, and different display modules on the target vehicle have different projection conditions. For example, assuming that there are 2 different display modules on the target vehicle A, namely the instrument panel screen and the central control screen, then there is a corresponding projection condition for each display module, and there are 2 projection conditions in total, namely projection condition 1 and projection condition 2.

[0008] It should be noted here that the application to be projected can refer to the application to be projected on the terminal device that has established a communication connection with the target vehicle. However, if multiple terminal devices have established connections with the target vehicle, the terminal device with an earlier establishment time can be selected as the terminal device to be projected, and the application to be projected on this terminal device can be called the application to be projected; the terminal device that has been set as the default terminal device can also be selected as the terminal device to be projected, and the user can also choose which terminal device to be projected as the terminal device to be projected according to actual needs, which is not limited here. It should also be noted that the application to be projected on the terminal device can refer to an application that displays an application interface on the display interface of the terminal device, or it can refer to an application that runs in the background of the terminal device (that is, the application interface is not displayed on the display interface of the terminal device), which is not limited here.

[0009] In the above-mentioned embodiment of the present application, by obtaining the first projection condition that needs to be met when the first display module on the vehicle is projected, when the first projection condition is met (such as the driving speed of the vehicle, the type of traffic scene, the type of application to be projected on the terminal device, the preset usage frequency, etc.), the projection information of the application to be projected on the terminal device is projected to the corresponding first display module, thereby realizing the reasonable allocation of the projection information on the terminal device to the corresponding display module on the vehicle based on the projection condition, so that the driver can quickly obtain the information on the terminal device, reduce the probability of the driver's attention being distracted, reduce the interference of the projection information on the driver's driving, thereby improving driving safety.

[0010] In a possible design of the first aspect, the specific way for the terminal device (or target vehicle) to obtain the first projection condition for the first display module on the target vehicle to be projected can be: the terminal device (or target vehicle) obtains the first projection condition for the first display module to be projected from the local device, that is, the multiple projection conditions pre-stored by the terminal device (or target vehicle). Multiple projection conditions can be obtained at the same time, or they can be obtained in a preset order for comparison; it can also be received across devices, for example, the terminal device obtains the projection condition information from the target vehicle, or the target vehicle obtains the projection condition information from the terminal device of the owner. The projection condition can be a default setting, or it can be set by the user according to his driving habits or other needs. Therefore, the acquisition mentioned in this article may also refer to accepting the user's input settings.

[0011] In a possible design of the first aspect, the specific manner in which the terminal device (or target vehicle) obtains the first projection condition for the first display module on the target vehicle to be projected may be: the terminal device (or target vehicle) first obtains multiple projection conditions for the projection of multiple display modules on the target vehicle. In the embodiment of the present application, one display module corresponds to one projection condition. For example, assuming that there are three different display modules on the target vehicle A, namely, the instrument panel screen, the steering wheel screen and the central control screen, then there is a corresponding projection condition for each display module, and there are three projection conditions in total, namely, projection condition 1, projection condition 2, and projection condition 3. After the terminal device (or target vehicle) obtains multiple projection conditions for the projection of multiple display modules on the target vehicle, when the projection condition (which may be referred to as the first projection condition) for a certain display module (which may be referred to as the first display module) on the target vehicle is met, and when the terminal device and the vehicle have established a communication connection, the projection information of the first application to be projected on the terminal device is projected to the first display module.

[0012] In the above-mentioned embodiment of the present application, by obtaining the projection conditions that need to be met when each display module on the vehicle is projected, when the projection conditions are met, the display information of the first application to be projected on the terminal device is projected to the corresponding display module, thereby realizing the reasonable distribution of the projection information on the terminal device to different display modules on the vehicle, so that the driver can quickly obtain the information on the terminal device, reducing the probability of the driver's attention being distracted, reducing the interference of the projection information on the driver's driving, and thus improving driving safety.

[0013] In a possible design of the first aspect, when the driving information of the vehicle is characterized by different parameters, the conditions to be met by the projection screen are also different. In one case, the driving information of the target vehicle may include: the driving speed of the target vehicle. At this time, the first projection screen condition includes that the driving speed of the target vehicle is within the first driving speed range. Since different driving speeds are actually aimed at driving safety, a principle to be followed is: in the case of low safety, the projection screen information should be presented on the display module that the driver needs to spend the least cost to see and is easiest to see. For example, when the driving speed is fast, the driver needs to have a high level of attention at this time, so the projection screen information can be projected to the screen that the driver can see with the least attention (such as steering wheel screen, head-up display (head-up display, HUD), etc.), when the driving speed is slow, because the speed is slow, the driver does not need such high attention, so the projection screen information can be projected to the screen that the driver can see with a slight turn of his head (such as the central control screen).

[0014] In the above-mentioned implementation mode of the present application, the projection information of the application to be projected on the terminal device is projected onto different display modules based on different driving speeds, thereby improving driving safety.

[0015] In a possible design of the first aspect, the driving information of the target vehicle may include: the type of traffic scene in which the target vehicle is located. At this time, the first projection condition includes that the type of traffic scene in which the target vehicle is located belongs to the first traffic scene type. It should be noted that in the embodiment of the present application, the traffic scene refers to a scene composed of traffic participants (such as vehicles, pedestrians, etc.) and objects (such as traffic signs, obstacle signs, etc.) on the traffic road network. The traffic scene can be divided into different types of traffic scenes according to pre-set division rules. For example, one division method can be based on traffic signs, and the traffic scene type can be divided into "crossroads", "T-shaped intersections", "traffic light intersections (displaying red lights)", "turning intersections", "straight roads", etc.; a division method can also be based on road conditions and surrounding traffic participants. The traffic scene type can be divided into "highways", "mountain roads", "rural roads", "urban roads", etc. In the embodiment of the present application, there is no limitation on the principle on which the traffic scene type is divided. Similarly, since the different types of traffic scenarios in which the vehicle is located are actually aimed at driving safety, a principle that should be followed is: in situations where safety is not high, the projection information should be presented on the display module that the driver can see with the least effort and is easiest to see. For example, when the vehicle is at an intersection with a red light, the driver has stopped the vehicle and is waiting for the red light to change to a street light. At this time, the driver does not need such high attention, so the projection information can be projected to the screen that the driver can see by slightly turning his head (such as the central control screen). When the vehicle is at a turning intersection, since turning intersections are generally areas with a high incidence of traffic accidents, the driver needs to have sufficiently high attention at this time, so the projection information can be projected to the screen that the driver can see with the least attention (such as the steering wheel screen, HUD, etc.).

[0016] In the above-mentioned implementation mode of the present application, the projection information of the application to be projected on the terminal device is selected to be projected onto different display modules based on the different traffic scene types in which the vehicle is located, thereby improving driving safety.

[0017] In a possible design of the first aspect, the driving information of the target vehicle may include: the number of passengers in the target vehicle. At this time, the first projection condition includes that the number of passengers in the target vehicle is within the first passenger number range. It should be noted that in the embodiment of the present application, the number of passengers in the vehicle does not include the driver. For example, when there is only a driver in the vehicle, the number of passengers in the vehicle = 0. The different number of passengers in the vehicle is actually aimed at the privacy and sharing of the projection information. When the application to be projected on the terminal device is a high-privacy application (such as WeChat), in order to avoid other passengers from seeing the projection information, the high-privacy application can be projected to the dashboard screen or steering wheel screen that only the driver can see. When the application to be projected on the terminal device is a low-privacy application (such as Tencent Video), considering the need for common use, such low-privacy applications can be projected to the central control screen that both the driver and the passengers can see when running.

[0018] In the above-mentioned implementation mode of the present application, based on considerations of application privacy and sharing, the number of passengers in the vehicle is different, and the projection information of the application to be projected on the terminal device can be selected to be projected onto different display modules, thereby improving the user experience.

[0019] In a possible design of the first aspect, the driving information of the target vehicle may include: the fatigue state of the driver of the target vehicle. At this time, the first projection condition includes that the fatigue state of the driver of the target vehicle belongs to the first fatigue state. It should be noted that in the embodiment of the present application, the fatigue state of the vehicle driver can be calculated by the human state information detected by the sensor module deployed in the vehicle, or it can be calculated by the human state information detected by the wearable device (such as a smart bracelet, a smart watch, etc.) worn by the driver. In some embodiments of the present application, the driver's fatigue state can be graded, and it can be graded according to the number of vehicle display modules. For example, assuming that there are 3 display modules on the vehicle, the driver's fatigue state can be divided into 3 levels of "fatigue", "sub-fatigue" and "mental"; assuming that there are 2 display modules on the vehicle, the driver's fatigue state can be divided into 2 levels of "fatigue" and "mental", etc. Based on the different fatigue states of the driver, it can be known whether the corresponding driving behavior is safe. Different driving speeds are actually aimed at driving safety. Therefore, a principle that should be followed is: when the driver's fatigue state is at a high fatigue level, it means that the driving behavior at this time is not safe. The projection information should be presented on the display module that the driver can see with the least cost and is easiest to see. For example, when the driver's fatigue state is "fatigue", the driver needs to use little energy and attention on driving the vehicle. Then the projection information can be projected to the screen that the driver can see with the least attention (such as steering wheel screen, HUD, etc.). When the driver's fatigue state is "spirited", it means that the driver is more energetic at this time. Then the projection information can be projected to the screen that the driver can see with a slight turn of his head (such as the central control screen).

[0020] In the above-mentioned implementation mode of the present application, the projection information of the application to be projected on the terminal device is selected to be projected onto different display modules based on the different fatigue states of the driver, thereby improving driving safety.

[0021] In a possible design of the first aspect, the driving information of the target vehicle may include: the distance between the target vehicle and the obstacle. At this time, the first projection condition includes that the distance between the target vehicle and the obstacle is within a first distance range. It should be noted that in an embodiment of the present application, the distance between the vehicle and the obstacle can be calculated based on the perception information collected by sensors deployed on the vehicle (such as lidar, cameras, etc.), and based on the collected perception information, the distance between the vehicle and each obstacle and the orientation and position of the obstacle relative to the vehicle can be obtained. The different distances between vehicles and obstacles actually target driving safety. Therefore, a principle that should be followed is: when the distance between the vehicle and the obstacle is closer, it means that the driver has less time to react, then the risk of a collision between the vehicle and the obstacle is greater, indicating that the driving environment of the vehicle is unsafe. At this time, the driver needs to concentrate and drive carefully to avoid collision with the obstacle. Then the projection information can be projected to the screen that the driver can see with the least attention (such as the steering wheel screen, HUD, etc.); when the distance between the vehicle and the obstacle is farther, it means that the driving environment of the vehicle is safer, then the projection information can be projected to the screen that the driver can see with a slight turn of his head (such as the central control screen).

[0022] In the above-mentioned embodiment of the present application, the projection information of the application to be projected on the terminal device is selected to be projected to different display modules based on the different distances between the vehicle and the obstacle, thereby reducing the probability of collision between the vehicle and the obstacle and improving driving safety.

[0023] In a possible design of the first aspect, the characteristic information of the application to be projected may include the application type to which the application to be projected belongs, that is, the projection condition is that a specific application type corresponds to a specific display module. In this case, the first application to be projected on the terminal device satisfies the first projection condition for the first display module on the vehicle to be projected, which includes: the first projection condition includes that the application type of the application is a first application type (such as a social type), and the first application to be projected on the terminal device belongs to the first application type. It can also be said that the application type to which the first application to be projected on the terminal device belongs belongs to the application type required in the first projection condition.

[0024] In the above-mentioned embodiment of the present application, it is explained that the screen projection conditions are divided based on the application type to which the application belongs, and different screen projection conditions correspond to different application types, so that applications belonging to different application types can be projected to their respective corresponding display modules, thereby realizing differentiated screen projection from the perspective of application type and improving user experience.

[0025] In a possible design of the first aspect, the characteristic information of the application may include the frequency of use information of the application, that is, the projection condition is that the specific frequency range of use of the application on the terminal device corresponds to a specific display module, and the frequency of use information of the application on the terminal device can be obtained from the "healthy use of mobile phone" and other similar functions of the terminal device. In this case, the first projection condition that the first display module on the vehicle is projected by the first application to be projected on the terminal device includes: the first projection condition includes that the frequency of use information of the application is within the first frequency range (such as a high frequency range), and the frequency of use of the first application to be projected on the terminal device is within the first frequency range, which can also be called the frequency of use of the first application to be projected on the terminal device on the terminal device is within the frequency range required in the first projection condition. In the embodiment of the present application, a principle followed is: the projection information of the application with higher frequency of use is presented on the display module that the user can see or see most easily at the least cost. For example: the projection information of the application with high frequency of use is presented on the steering wheel screen or HUD of the vehicle, and the projection information of the application with low frequency of use is presented on the central control screen of the vehicle.

[0026] In the above-mentioned embodiment of the present application, it is explained that the projection conditions are divided based on the usage frequency information of the application on the terminal device, and different projection conditions correspond to different usage frequency ranges, so that applications with different usage frequencies can be projected to their respective corresponding display modules, thereby realizing differentiated projection from the perspective of the usage frequency of the application. The projection information of the more frequently used applications is presented on the display module that the user can see with the least cost or is easiest to see, thereby indirectly improving the user's driving attention.

[0027] In a possible design of the first aspect, the characteristic information of the application may include both the application type to which the application belongs and the usage frequency information of the application. In this case, the first application to be projected on the terminal device satisfies the first projection condition for the first display module on the vehicle to be projected, which includes: the application type to which the first application to be projected on the terminal device belongs belongs to the application type required in the first projection condition, and the usage frequency information of the first application to be projected on the terminal device is within the usage frequency range required in the first projection condition.

[0028] In the above-mentioned implementation mode of the present application, each single factor (for example, the application type is a single factor, and the frequency information of the application program usage is a single factor) is combined with each other to obtain a division result based on the combined factors, so that the conditions required to be met for screen projection are more diverse, thereby improving the user experience.

[0029] In a possible design of the first aspect, the frequency information of application usage on the terminal device can be characterized in the following ways: 1) the usage time of the application on the terminal device, for example, it can be the total time spent by the user on the terminal device since the application was downloaded, or it can be the time spent by the application on the terminal device within a time period such as one day, one week or one month. The specific method for calculating the usage time is not limited here; 2) the number of times the application is started and run on the terminal device, for example, it can be the number of times the application is started and run on the terminal device since the user downloaded the application, or it can be the number of times the application is started and run on the terminal device within a time period such as one day, one week or one month. The specific method for calculating the number of starts and runs is not limited here.

[0030] In the above-mentioned implementation manner of the present application, several representation methods of frequency information used by an application on a terminal device are specifically described, which are selective and flexible.

[0031] In a possible design of the first aspect, the application type to which the application belongs can be divided in multiple ways, wherein one way of division can be to classify the application type into social, travel navigation, audio and video, tools, information, games, travel accommodation, shopping, education, sports and health, and financial management. Any application must be classified into one of the above application types. This division method is based on the fact that when a terminal device downloads an application from the "application market" or "App Store" of the terminal device (the name may be different due to different manufacturers of the terminal device, which is not limited here), the application market has already classified each application (i.e., the classification information determined by the application market label, and each application downloaded from the application market has its own classification), i.e., the above-mentioned classification.

[0032] In the above-mentioned implementation mode of the present application, a method of dividing application types is specifically described. This method of dividing application types is easy to obtain, can cover most application programs, and is feasible.

[0033] In a possible design of the first aspect, an application can simultaneously satisfy the characteristic information of the application required in multiple projection conditions. For example, the application type "social" (such as "WeChat", "QQ", "short message", etc.) to which the application belongs can be the application type required in projection condition 1, or the application type required in projection condition 2. That is to say, when the first application to be projected on the terminal device simultaneously satisfies the first projection condition that the first display module on the vehicle is projected and the second projection condition that the second display module on the vehicle is projected, in this case, the projection information of the first application to be projected can be simultaneously projected to the first display module and the second display module, and the first display module and the second display module are two different ones of the multiple display modules on the vehicle. It should be noted that in the embodiment of the present application, the premise for simultaneously projecting the projection information of the first application to be projected to the first display module and the second display module is that both the first display module and the second display module are not occupied by projection.

[0034] In the above-mentioned implementation mode of the present application, it is specifically explained that when a certain application meets the screen projection conditions of multiple display modules, the application will be projected onto these multiple display modules, and the user can choose which display module to view the projection information, which has flexibility.

[0035] In a possible design of the first aspect, an application can simultaneously satisfy the characteristic information of the application required in multiple projection conditions. That is, when the first application to be projected on the terminal device simultaneously satisfies the first projection condition that the first display module on the vehicle is projected and the second projection condition that the second display module on the vehicle is projected, in this case, the terminal device can also divide the projection information of the first application to be projected into the first projection sub-information and the second projection sub-information in a preset manner, and the first display module and the second display module are two different ones of the multiple display modules on the vehicle, and then, the first projection sub-information and the second projection sub-information are projected to the first display module and the second display module respectively.

[0036] In the above-mentioned embodiment of the present application, it is specifically explained that when an application meets the screen projection conditions for projecting multiple display modules, the projection information of the application is split into multiple projection sub-information, and one projection sub-information is projected onto one display module. The user can choose which display module to view the projection sub-information, which is flexible.

[0037] In a possible design of the first aspect, an application can simultaneously satisfy the characteristic information of the application required in multiple projection conditions. That is, when the first application to be projected on the terminal device satisfies both the first projection condition that the first display module on the vehicle is projected and the second projection condition that the second display module on the vehicle is projected, then when the projection priority of the first display module is higher than the projection priority of the second display module, the projection information of the first application to be projected is only projected to the first display module with a higher priority.

[0038] In the above implementation of the present application, it is specifically explained that when a certain application meets the projection conditions for multiple display modules, selective projection can be further performed based on priority, and the projection information is preferentially projected to the display module with high priority. The method of projecting according to priority ensures that the user can view the projection information in real time in the most appropriate way, minimizing the impact of the user's attention being distracted.

[0039] In a possible design of the first aspect, the screen projection information of the first application to be projected is projected to the second display module only when the first display module with a higher priority is occupied by the projection.

[0040] In the above-mentioned implementation mode of the present application, it is specifically explained that only when a display module with a higher priority is occupied by screen projection, the screen will be projected to a display module with a next priority, thereby ensuring that the user can view the projection information in real time in the most appropriate manner.

[0041] In a possible design of the first aspect, the projection information of the first application to be projected may be the entire application interface of the first application, or may be a part of the application interface of the first application to be projected.

[0042] In the above-mentioned embodiments of the present application, it is explained which components the projection information may be, and it is flexible to selectively project a part or parts of the display interface based on user needs.

[0043] In a possible design of the first aspect, the display module on the target vehicle may at least include: a central control screen, a dashboard screen, a steering wheel screen, a HUD, a front windshield screen (for example, it may include a left field of view screen, a right field of view screen, etc. of the vehicle), a rear windshield screen, a co-pilot screen, a window screen (for example, a left window screen, a right window screen, etc.), a sunroof screen, etc., or the display module on the vehicle may also include: any surface area inside / outside the vehicle wrapped or coated with a material having a display function (such as a flexible display screen), such as a vehicle body, a door, a sun visor inside the vehicle, a sunroof, etc. That is to say, in the embodiment of the present application, any area or device inside the vehicle to which the terminal device can project a screen may be referred to as a display module on the vehicle described in the embodiment of the present application.

[0044] In the above-mentioned embodiments of the present application, several specific expressions of the display module of the vehicle are described, which are extensive and flexible.

[0045] The second aspect of the embodiment of the present application also provides a display information switching method, which includes: first, the vehicle can obtain the vehicle's own driving information, and then the vehicle will determine whether its own driving information meets the first driving condition. When the vehicle's driving information does not meet the first driving condition, it indicates that the projection information of the first application displayed on the first display module will be switched to the second display module for display, wherein the first display module and the second display module are two different display modules on the vehicle, respectively, and the first driving condition is a condition that must be met when the first display module is projected.

[0046] In the above-mentioned embodiment of the present application, after the projection information on the terminal device has been projected to the first display module on the vehicle side, the vehicle can further determine whether the first projection condition corresponding to the first display module is consistent with the vehicle's own driving conditions in combination with the vehicle's own driving information. If not, it is necessary to switch the projection information to other display modules on the vehicle (such as the second display module) for display, which has flexibility and improves the user experience.

[0047] It should be noted that, in some embodiments of the present application, in addition to the projection information of the first application, other information may also be displayed on the first display module. For example, it may be the running interface of the application installed on the vehicle itself, or it may be a part of the running interface, etc., which can be collectively referred to as target information. In this case, what is displayed on the first display module is not the projection information. In this case, a way to implement screen switching is: the vehicle obtains the vehicle's own driving information, and then determines whether its own driving information meets the first driving condition. When the vehicle's driving information does not meet the first driving condition, the target information displayed on the first display module is switched to the second display module for display, wherein the first display module and the second display module are two different display modules on the vehicle, and the first driving condition is the condition that must be met when the first display module is projected.

[0048] In a possible design of the second aspect, when the vehicle's driving information does not meet the first driving condition, the specific method of instructing the screen projection information of the first application displayed on the first display module to be switched to the second display module for display may be: when the vehicle's driving information does not meet the first driving condition, and the vehicle's driving information meets the second driving condition, the specific method of instructing the screen projection information of the first application displayed on the first display module to be switched to the second display module for display, and the second driving condition is a condition that must be met when the second display module is projected.

[0049] In the above-mentioned embodiment of the present application, after the projection information on the terminal device has been projected to the first display module on the vehicle side, the vehicle can further determine whether it is necessary to switch the screen display in different driving scenarios in combination with the vehicle's own driving information. Only when the first projection condition corresponding to the first display module does not meet the current driving conditions of the vehicle and other display modules (such as the second display module) meet the current driving conditions of the vehicle, it is indicated that the projection information of the first application displayed on the first display module will be switched to the second display module for display. In other words, dynamic switching between different display modules can be performed in combination with the vehicle's own driving status, so that under any driving conditions, the user can view the projection information in the best way, thereby improving the user experience.

[0050] In a possible design of the second aspect, the driving information of the vehicle may include: the driving speed of the vehicle. In this case, the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition, which includes: the first driving condition includes the driving speed being within the first driving speed range, and the second driving condition includes the driving speed being within the second driving speed range; the driving speed of the vehicle is not within the first driving speed range, and the driving speed of the vehicle is within the second driving speed range. It should be noted that since different driving speeds are actually aimed at driving safety, the principles to be followed are similar to those of the first aspect above. Please refer to the description of the first aspect above for details, which will not be repeated here.

[0051] In the above-mentioned embodiment of the present application, based on the driving speed of the vehicle, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that meet the driving speed of the vehicle, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the real-time driving speed of the vehicle, thereby improving driving safety.

[0052] In a possible design of the second aspect, the driving information of the vehicle may include: the type of traffic scene in which the vehicle is located. In this case, the driving information of the vehicle does not comply with the first driving condition, and the driving information of the vehicle complies with the second driving condition, including: the first driving condition includes that the traffic scene type belongs to the first traffic scene type, and the second driving condition includes that the traffic scene type belongs to the second traffic scene type; the traffic scene type in which the vehicle is located does not belong to the first traffic scene type, and the traffic scene type in which the vehicle is located belongs to the second traffic scene type. It should be noted that in the embodiment of the present application, there is no limitation on the principle on which the traffic scene types are divided. For details, please refer to the above-mentioned explanation of the first aspect, which will not be elaborated here; in addition, since the different traffic scene types in which the vehicle is located are actually aimed at driving safety, the principles to be followed are similar to those of the above-mentioned first aspect, and for details, please refer to the above-mentioned explanation of the first aspect, which will not be elaborated here.

[0053] In the above-mentioned embodiment of the present application, based on the different traffic scene types in which the vehicle is located, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that conform to the traffic scene type in which the vehicle is located, thereby realizing that the display information on the terminal device is reasonably distributed to different display modules on the vehicle according to the real-time traffic scene type in which the vehicle is located, thereby improving driving safety.

[0054] In a possible design of the second aspect, the driving information of the vehicle may include: the number of passengers in the vehicle. In this case, the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition, including: the first driving condition includes that the number of passengers is within the first passenger number range, and the second driving condition includes that the number of passengers is within the second passenger number range; the number of passengers in the vehicle is not within the first passenger number range, and the number of passengers in the vehicle is within the second passenger number range. It should be noted that in the embodiment of the present application, the number of passengers in the vehicle does not include the driver. For example, when there is only a driver in the vehicle, the number of passengers in the vehicle = 0. The different number of passengers in the vehicle is essentially aimed at the privacy and sharing of the projection information. When the application running on the terminal device is a high-privacy application (such as WeChat), in order to avoid other passengers from seeing the projection information, the high-privacy application can be projected to the dashboard screen or steering wheel screen that only the driver can see. When the application running on the terminal device is a low-privacy application (such as Tencent Video), considering the need for common use, such low-privacy applications can be projected to the central control screen that both the driver and the passenger can see when running.

[0055] In the above-mentioned embodiment of the present application, based on considerations of application privacy and commonality, if the number of passengers in a vehicle is different, the projection information of the application running on the terminal device can be switched to a display module corresponding to the driving conditions that meet the number of passengers in the vehicle, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the number of passengers in the vehicle, thereby improving the user experience.

[0056] In a possible design of the second aspect, the driving information of the vehicle may include: the fatigue state of the vehicle driver. In this case, the driving information of the vehicle does not comply with the first driving condition, and the driving information of the vehicle complies with the second driving condition, including: the first driving condition includes that the driver's fatigue state belongs to the first fatigue state, and the second driving condition includes that the driver's fatigue state belongs to the second fatigue state; the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state. It should be noted that in the embodiment of the present application, the fatigue state of the vehicle driver can be calculated from the human body state information detected by the sensor module deployed in the vehicle, and can also be calculated from the human body state information detected by a wearable device worn by the driver (such as a smart bracelet, smart watch, etc.). In some embodiments of the present application, the driver's fatigue state can be graded, and can be graded according to the number of vehicle display modules. For example, assuming that there are 3 display modules on the vehicle, the driver's fatigue state can be divided into 3 levels: "fatigue", "sub-fatigue", and "mental"; assuming that there are 2 display modules on the vehicle, the driver's fatigue state can be divided into 2 levels: "fatigue" and "mental", etc. Based on the different fatigue states of the driver, it can be known whether the corresponding driving behavior is safe. Different driving speeds are actually aimed at driving safety. Therefore, the principles to be followed are similar to those of the first aspect above. Please refer to the description of the first aspect above for details, which will not be repeated here.

[0057] In the above-mentioned embodiment of the present application, based on the different fatigue states of the driver, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that meet the fatigue state of the vehicle driver, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the fatigue state of the vehicle driver, thereby improving driving safety.

[0058] In a possible design of the second aspect, the driving information of the vehicle may include: the distance between the vehicle and the obstacle. In this case, the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition, which includes: the first driving condition includes that the distance between the vehicle and the obstacle is within the first distance range, and the second driving condition includes that the distance between the vehicle and the obstacle is within the second distance range; the distance between the vehicle and the obstacle is not within the first distance range, and the distance between the vehicle and the obstacle is within the second distance range. It should be noted that in the embodiment of the present application, the distance between the vehicle and the obstacle can be calculated based on the perception information collected by the sensor (such as laser radar, camera, etc.) deployed on the vehicle, and the distance between the vehicle and each obstacle and the orientation and position of the obstacle relative to the vehicle can be obtained based on the perception information collected. The different distances between the vehicle and the obstacle are actually aimed at driving safety. Therefore, the principles to be followed are similar to those of the first aspect above. Please refer to the description of the first aspect above for details, which will not be repeated here.

[0059] In the above-mentioned embodiment of the present application, based on the different distances between the vehicle and the obstacle, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that meet the distance between the vehicle and the obstacle, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the distance between the vehicle and the obstacle, reducing the probability of collision between the vehicle and the obstacle and improving driving safety.

[0060] In a possible design of the second aspect, the process in which the vehicle switches the projection information to the second display module for display may specifically be: the vehicle first generates a switching instruction (which may be referred to as a first switching instruction), and the first switching instruction is used to instruct the vehicle to switch the projection information to the second display module. Thereafter, the vehicle switches the projection information to the second display module for display according to the first switching instruction.

[0061] In the above-mentioned implementation mode of the present application, how to switch screens for display is specifically described, which is feasible.

[0062] In a possible design of the second aspect, the projection information of the first application may be the entire application interface of the first application, or may be a portion of the application interface of the first application.

[0063] In the above-mentioned embodiments of the present application, it is explained which components the projection information may be, and it is flexible to selectively project a part or parts of the display interface based on user needs.

[0064] In a possible design of the second aspect, the display module on the vehicle may at least include: a central control screen, a dashboard screen, a steering wheel screen, a HUD, a front windshield screen (for example, it may include a left field of view screen, a right field of view screen, etc. of the vehicle), a rear windshield screen, a co-pilot screen, a window screen (for example, a left window screen, a right window screen, etc.), a sunroof screen, etc., or the display module on the vehicle may also include: any surface area inside / outside the vehicle wrapped or coated with a material having a display function (such as a flexible display screen), such as a vehicle body, a door, a sun visor inside the vehicle, a sunroof, etc. That is to say, in the embodiment of the present application, any area or device inside the vehicle to which the terminal device can project a screen may be referred to as the display module on the vehicle described in the embodiment of the present application.

[0065] In the above-mentioned embodiments of the present application, several specific expressions of the display module of the vehicle are described, which are extensive and flexible.

[0066] The third aspect of the embodiment of the present application also provides a screen projection method, which includes: the terminal device first sends a first instruction to the vehicle, and the first instruction is used to instruct the projection information of the first application to be displayed on the first display module of the vehicle. In addition, the terminal device will periodically receive the driving information of the vehicle sent by the vehicle. When the driving information of the vehicle does not meet the first driving condition and the driving information of the vehicle meets the second driving condition, a second instruction is sent to the vehicle, and the second instruction is used to instruct the information of the first application to be displayed on the second display module of the vehicle (such as the running interface of the first application, or the first part of the running interface), wherein the first driving condition is a condition that must be met when the first display module is projected, and the second driving condition is a condition that must be met when the second display module is projected, and the first display module and the second display module are two different display modules on the vehicle.

[0067] In the above-mentioned embodiment of the present application, after the projection information on the terminal device has been projected to the display module on the vehicle side, the terminal device can also determine whether it is necessary to switch the screen display in different driving scenes in combination with the vehicle's own driving information. In other words, the terminal device can dynamically switch between different display modules in combination with the vehicle's own driving status, so that under any driving conditions, the user can view the projection information in the best way, thereby improving the user experience.

[0068] In a possible design of the third aspect, the driving information of the vehicle may include: the driving speed of the vehicle. In this case, the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition, which includes: the first driving condition includes the driving speed being within the first driving speed range, and the second driving condition includes the driving speed being within the second driving speed range; the driving speed of the vehicle is not within the first driving speed range, and the driving speed of the vehicle is within the second driving speed range. Since different driving speeds are essentially aimed at driving safety, the principles to be followed are similar to those of the first aspect above. Please refer to the description of the first aspect above for details, which will not be repeated here.

[0069] In the above-mentioned embodiment of the present application, based on the driving speed of the vehicle, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that meet the driving speed of the vehicle, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the real-time driving speed of the vehicle, thereby improving driving safety.

[0070] In a possible design of the third aspect, the driving information of the vehicle may include: the type of traffic scene in which the vehicle is located. In this case, the driving information of the vehicle does not comply with the first driving condition, and the driving information of the vehicle complies with the second driving condition, including: the first driving condition includes that the traffic scene type belongs to the first traffic scene type, and the second driving condition includes that the traffic scene type belongs to the second traffic scene type; the traffic scene type in which the vehicle is located does not belong to the first traffic scene type, and the traffic scene type in which the vehicle is located belongs to the second traffic scene type. It should be noted that in the embodiment of the present application, there is no limitation on the principle on which the traffic scene types are divided. For details, please refer to the above-mentioned explanation of the first aspect, which will not be elaborated here; in addition, since the different traffic scene types in which the vehicle is located are actually aimed at driving safety, the principles to be followed are similar to those of the above-mentioned first aspect. For details, please refer to the above-mentioned explanation of the first aspect, which will not be elaborated here.

[0071] In the above-mentioned embodiment of the present application, based on the different traffic scene types in which the vehicle is located, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that conform to the traffic scene type in which the vehicle is located, thereby realizing that the display information on the terminal device is reasonably distributed to different display modules on the vehicle according to the real-time traffic scene type in which the vehicle is located, thereby improving driving safety.

[0072] In a possible design of the third aspect, the driving information of the vehicle may include: the number of passengers in the vehicle. In this case, the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition, including: the first driving condition includes that the number of passengers is within the first passenger number range, and the second driving condition includes that the number of passengers is within the second passenger number range; the number of passengers in the vehicle is not within the first passenger number range, and the number of passengers in the vehicle is within the second passenger number range. It should be noted that in the embodiment of the present application, the number of passengers in the vehicle does not include the driver. For example, when there is only a driver in the vehicle, the number of passengers in the vehicle = 0. The different number of passengers in the vehicle is actually aimed at the privacy and sharing of the projection information. When the application running on the terminal device is a high-privacy application (such as WeChat), in order to avoid other passengers from seeing the projection information, the high-privacy application can be projected to the dashboard screen or steering wheel screen that only the driver can see. When the application running on the terminal device is a low-privacy application (such as Tencent Video), considering the need for common use, such low-privacy applications can be projected to the central control screen that both the driver and the passenger can see when running.

[0073] In the above-mentioned embodiment of the present application, based on considerations of application privacy and commonality, the number of passengers in the vehicle is different, and the projection information of the application running on the terminal device can be selected to be switched to the display module corresponding to the driving conditions that meet the number of passengers in the vehicle, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the number of passengers in the vehicle, thereby improving the user experience.

[0074] In a possible design of the third aspect, the driving information of the vehicle may include: the fatigue state of the vehicle driver. In this case, the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition, including: the first driving condition includes that the driver's fatigue state belongs to the first fatigue state, and the second driving condition includes that the driver's fatigue state belongs to the second fatigue state; the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state. It should be noted that in the embodiment of the present application, the fatigue state of the vehicle driver can be calculated by the human state information detected by the sensor module deployed in the vehicle, or it can be calculated by the human state information detected by the wearable device (such as a smart bracelet, a smart watch, etc.) worn by the driver. In some embodiments of the present application, the driver's fatigue state can be graded, and it can be graded according to the number of vehicle display modules. Based on the different fatigue states of the driver, it can be known whether the corresponding driving behavior is safe. Different driving speeds are actually aimed at driving safety. Therefore, the principles to be followed are similar to those of the first aspect above. Please refer to the description of the first aspect above for details, which will not be repeated here.

[0075] In the above-mentioned embodiment of the present application, based on the different fatigue states of the driver, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that meet the fatigue state of the vehicle driver, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the fatigue state of the vehicle driver, thereby improving driving safety.

[0076] In a possible design of the third aspect, the driving information of the vehicle may include: the distance between the vehicle and the obstacle. In this case, the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition, which includes: the first driving condition includes that the distance between the vehicle and the obstacle is within the first distance range, and the second driving condition includes that the distance between the vehicle and the obstacle is within the second distance range; the distance between the vehicle and the obstacle is not within the first distance range, and the distance between the vehicle and the obstacle is within the second distance range. It should be noted that in the embodiment of the present application, the distance between the vehicle and the obstacle can be calculated based on the perception information collected by the sensor (such as laser radar, camera, etc.) deployed on the vehicle, and the distance between the vehicle and each obstacle and the orientation and position of the obstacle relative to the vehicle can be obtained based on the perception information collected. The different distances between the vehicle and the obstacle are actually aimed at driving safety. Therefore, the principles to be followed are similar to those of the first aspect above. Please refer to the description of the first aspect above for details, which will not be repeated here.

[0077] In the above-mentioned embodiment of the present application, based on the different distances between the vehicle and the obstacle, the projection information of the application running on the terminal device is switched to the display module corresponding to the driving conditions that meet the distance between the vehicle and the obstacle, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle according to the distance between the vehicle and the obstacle, reducing the probability of collision between the vehicle and the obstacle and improving driving safety.

[0078] In a possible design of the third aspect, the projection information of the first application may be the entire application interface of the first application, or may be a portion of the application interface of the first application.

[0079] In the above-mentioned embodiments of the present application, it is explained which components the projection information may be, and it is flexible to selectively project a part or parts of the display interface based on user needs.

[0080] In a possible design of the third aspect, the display module on the vehicle may at least include: a central control screen, a dashboard screen, a steering wheel screen, a head-up display (HUD), a front windshield screen (for example, it may include a left field of view screen, a right field of view screen, etc. of the vehicle), a rear windshield screen, a co-pilot screen, a window screen (for example, a left window screen, a right window screen, etc.), a sunroof screen, etc., or the display module on the vehicle may also include: any surface area inside / outside the vehicle wrapped or coated with a material having a display function (such as a flexible display screen), such as a vehicle body, a door, a sun visor inside the vehicle, a sunroof, etc. That is to say, in the embodiment of the present application, any area or device inside the vehicle to which the terminal device can project a screen may be referred to as a display module on the vehicle described in the embodiment of the present application.

[0081] In the above-mentioned embodiments of the present application, several specific expressions of the display module of the vehicle are described, which are extensive and flexible.

[0082] The fourth aspect of the embodiment of the present application provides a device, which has the function of implementing the method of the first aspect or any possible implementation of the first aspect. The function can be implemented by hardware, or the corresponding software can be implemented by hardware. The hardware or software includes one or more modules corresponding to the above functions. In some embodiments of the present application, the device can be a terminal device or a vehicle, which is not specifically limited here.

[0083] A fifth aspect of the embodiments of the present application provides a device having the function of implementing the method of the second aspect or any possible implementation of the second aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In some embodiments of the present application, the device can be a vehicle.

[0084] The sixth aspect of the embodiment of the present application further provides a device, which has the function of implementing the method of the third aspect or any possible implementation of the third aspect. The function can be implemented by hardware, or the corresponding software can be implemented by hardware. The hardware or software includes one or more modules corresponding to the above functions. In some embodiments of the present application, the device can be a terminal device.

[0085] The seventh aspect of the embodiments of the present application provides a device, which may include a memory, a processor and a bus system, wherein the memory is used to store programs, and the processor is used to call the program stored in the memory to execute the method of the first aspect of the embodiments of the present application or any possible implementation of the first aspect, or the processor is used to call the program stored in the memory to execute the method of the second aspect of the embodiments of the present application or any possible implementation of the second aspect, or the processor is used to call the program stored in the memory to execute the method of the third aspect of the embodiments of the present application or any possible implementation of the third aspect.

[0086] In an eighth aspect, the present application provides a computer-readable storage medium, which stores instructions. When the computer-readable storage medium is run on a computer, the computer can execute the method of the first aspect or any possible implementation of the first aspect, or the computer can execute the method of the second aspect or any possible implementation of the second aspect, or the computer can execute the method of the third aspect or any possible implementation of the third aspect.

[0087] A ninth aspect of an embodiment of the present application provides a computer program, which, when executed on a computer, enables the computer to execute the method of the first aspect or any possible implementation of the first aspect, or enables the computer to execute the method of the second aspect or any possible implementation of the second aspect, or enables the computer to execute the method of the third aspect or any possible implementation of the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0088] Figure 1 A schematic diagram of a driver using a central control screen and a terminal device in a vehicle;

[0089] Figure 2A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application;

[0090] Figure 3 A schematic diagram of a software structure of a terminal device provided in an embodiment of the present application;

[0091] Figure 4 Block diagram of several typical terminal devices provided in the embodiments of the present application;

[0092] Figure 5 A block diagram of a foldable mobile phone in an unfolded state provided by an embodiment of the present application;

[0093] Figure 6 A block diagram of a foldable mobile phone provided in an embodiment of the present application in a folded state;

[0094] Figure 7 A schematic diagram of different display modules in a vehicle provided by an embodiment of the present application;

[0095] Figure 8 A schematic diagram of a flow chart of a screen projection method provided in an embodiment of the present application;

[0096] Fig. 9 A schematic diagram of a method for a terminal device provided in an embodiment of the present application to obtain multiple screen projection conditions for multiple display modules on a vehicle to be projected;

[0097] Fig.10 A schematic diagram of a user selecting to obtain identification information corresponding to a target vehicle display module on a terminal device provided in an embodiment of the present application;

[0098] Fig.11 A schematic diagram of another method for a terminal device provided in an embodiment of the present application to obtain multiple screen projection conditions for multiple display modules on a vehicle to be projected;

[0099] Fig.12 Another schematic diagram of a user selecting to obtain identification information corresponding to a display module of a target vehicle on a terminal device provided in an embodiment of the present application;

[0100] Fig.13 A schematic diagram of adding the name of an application running on a terminal device to a target screen projection condition provided in an embodiment of the present application;

[0101] Fig.14 A schematic diagram of a terminal device provided in an embodiment of the present application adding the name of an application running on the terminal device to a target screen projection condition by way of a voice prompt;

[0102] Fig.15 A schematic diagram of a screen projection method provided in an embodiment of the present application;

[0103] Fig.16 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0104] Fig.17 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0105] Fig.18 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0106] Fig.19 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0107] Fig. 20 A schematic diagram of the relationship between various screen projection conditions provided in the embodiment of the present application;

[0108] Fig.21 Another schematic diagram of the relationship between various screen projection conditions provided in the embodiment of the present application;

[0109] Fig. 22 Another schematic diagram of the relationship between various screen projection conditions provided in the embodiment of the present application;

[0110] Fig.23 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0111] Fig.24 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0112] Fig.25 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0113] Fig.26 Another schematic diagram of a flow chart of a method for switching display information provided in an embodiment of the present application;

[0114] Fig. 27 A schematic diagram of another screen projection method provided in an embodiment of the present application;

[0115] Fig.28 A schematic diagram of a traffic scene at a crossroad provided in an embodiment of the present application;

[0116] Fig.29 A schematic diagram of the distance between a vehicle traveling on a highway and surrounding obstacles provided in an embodiment of the present application;

[0117] Fig.30 Another schematic diagram of a flow chart of a method for switching display information provided in an embodiment of the present application;

[0118] Fig.31 A schematic diagram of the structure of the device provided in the embodiment of the present application;

[0119] Fig.32 Another schematic diagram of the structure of the device provided in the embodiment of the present application;

[0120] Fig.33 Another schematic diagram of the structure of the device provided in the embodiment of the present application;

[0121] Fig.34 A schematic structural diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0122] The following will describe the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0123] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0124] The screen projection method provided in the embodiments of the present application can be applied to various terminal devices, and various types of terminal devices can be used to implement the terminal devices proposed in the present application. For example, the terminal devices in the present application may include but are not limited to: smart phones (such as mobile phones), laptop computers, personal computers (PCs), tablet computers, board computers, ultrabooks, wearable devices (such as smart bracelets, smart watches, smart glasses, head-mounted display devices (HMDs), etc.), augmented reality (AR) devices, mixed reality (MR) devices, cellular phones, personal digital assistants (PDAs), digital broadcast terminals, etc. Of course, in the following embodiments, there is no limitation on the specific form of the terminal device.

[0125] Only by way of non-limiting example, the structure of the terminal device provided by the present application is exemplified below by taking a specific structure as an example. Figure 2 , Figure 2 A schematic structural diagram of the terminal device 100 is shown.

[0126] The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0127] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0128] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0129] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0130] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0131] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0132] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the terminal device 100.

[0133] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0134] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0135] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0136] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the terminal device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the terminal device 100.

[0137] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0138] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device 100, and can also be used to transmit data between the terminal device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other terminal devices, such as AR devices, etc.

[0139] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0140] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the terminal device 100. While the charging management module 140 is charging the battery 142, it may also power the terminal device through the power management module 141.

[0141] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0142] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0143] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0144] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0145] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0146] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) applied on the terminal device 100, such as wireless fidelity (Wi-Fi) network, bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0147] In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0148] The terminal device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0149] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0150] The terminal device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0151] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0152] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0153] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the terminal device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0154] Video codecs are used to compress or decompress digital videos. The terminal device 100 may support one or more video codecs. Thus, the terminal device 100 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0155] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the terminal device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0156] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0157] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the terminal device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the terminal device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0158] The terminal device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0159] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0160] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The terminal device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0161] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the terminal device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the ear.

[0162] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The terminal device 100 can be provided with at least one microphone 170C. In other embodiments, the terminal device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the terminal device 100 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording function, etc.

[0163] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0164] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the terminal device 100 detects the touch operation intensity according to the pressure sensor 180A. The terminal device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0165] The gyroscope sensor 180B can be used to determine the motion posture of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the terminal device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0166] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0167] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the terminal device 100 is a flip phone, the terminal device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.

[0168] The acceleration sensor 180E can detect the magnitude of the acceleration of the terminal device 100 in various directions (generally three axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal device and applied to applications such as horizontal and vertical screen switching and pedometers.

[0169] The distance sensor 180F is used to measure the distance. The terminal device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the terminal device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0170] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 100 emits infrared light outward through the light emitting diode. The terminal device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 can use the proximity light sensor 180G to detect that the user holds the terminal device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, and pocket mode automatically unlocks and locks the screen.

[0171] The ambient light sensor 180L is used to sense the ambient light brightness. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in a pocket to prevent accidental touch.

[0172] The fingerprint sensor 180H is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0173] The temperature sensor 180J is used to detect temperature. In some embodiments, the terminal device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the terminal device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the terminal device 100 heats the battery 142 to avoid abnormal shutdown of the terminal device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the terminal device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0174] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the terminal device 100, which is different from the position of the display screen 194.

[0175] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0176] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The terminal device 100 may receive key input and generate key signal input related to user settings and function control of the terminal device 100.

[0177] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0178] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0179] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the terminal device 100 by inserting the SIM card interface 195 or pulling it out from the SIM card interface 195. The terminal device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the terminal device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

[0180] The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes the Android system of the layered architecture as an example to illustrate the software structure of the terminal device 100. Figure 3 , Figure 3 A schematic diagram of the software structure of the terminal device 100 provided in an embodiment of the present application.

[0181] The layered architecture divides the software into several layers, each layer has a clear role and division of labor, and the layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the system library of the Android Runtime, and the kernel layer.

[0182] The application layer may include a series of application packages, that is, the application described in the embodiment of the present application, such as Figure 3 As shown, the application package may include: camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0183] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0184] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0185] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0186] The view system includes visual controls, such as controls for displaying text and images. The view system can be used to build applications. The display interface can be composed of one or more views, for example, it can include a display interface for a text notification icon, a view for displaying text, and a view for displaying images.

[0187] The phone manager is used to provide communication functions of the terminal device 100, such as management of call status (including connecting, hanging up, etc.).

[0188] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0189] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window, such as a text message prompt in the status bar, a prompt sound, a terminal device vibration, a flashing indicator light, etc.

[0190] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system. The core library contains two parts: one is the function that the Java language needs to call, and the other is the Android core library.

[0191] The application layer and the application framework layer run in a virtual machine, which executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0192] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0193] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of multiple common audio and video formats as well as static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0194] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0195] The following is an exemplary description of the software and hardware workflow of the terminal device 100 in conjunction with the capture and photo shooting scene:

[0196] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch single-click operation and the control corresponding to the single-click operation as the control of the camera application icon as an example, the application "camera" calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer to capture static images or videos through the camera 193.

[0197] Since the screen projection method provided in the embodiment of the present application can be applied to various types of terminal devices, the following uses the block diagrams of several typical terminal devices as examples to illustrate the terminal devices provided in the embodiment of the present application. Figure 4 As shown, Figure 4 The (a) sub-schematic diagram and (b) sub-schematic diagram of the smart phone and the smart watch are block diagrams respectively. Figure 2 The hardware structure of the corresponding terminal equipment and Figure 3 The corresponding software structure can be installed on Figure 4 On the block diagram of the terminal device, the screen projection method provided in the embodiment of the present application is implemented.

[0198] In addition, the screen projection method provided in the embodiment of the present application can be applied to various foldable terminal devices, such as foldable mobile phones, foldable personal computers, foldable tablet computers, foldable glasses, etc. The following takes a foldable mobile phone as an example to illustrate the foldable terminal device provided in the embodiment of the present application. Figure 5 As shown, Figure 5The block diagram of the unfolded state of the smart foldable mobile phone is shown. The screen of the foldable mobile phone is a flexible screen. The user can watch videos and images and input touch events on the flexible screen through the flexible screen. When the user finishes using the foldable mobile phone, the foldable mobile phone can be folded for easy carrying. Figure 6 As shown, Figure 6 The diagram shows the folded state of the foldable mobile phone obtained after the foldable mobile phone is folded by a rotating device.

[0199] It should be noted that Figure 5 and Figure 6 What is shown is one of the unfolding and folding methods, that is, folding or unfolding by handling the rotating device of the central axis of the folding mobile phone. In some embodiments of the present application, the rotating device can be in any position of the folding mobile phone, and there can be more than one folding device. The present application does not limit the specific folding method.

[0200] The screen projection method provided in the embodiment of the present application is to project the screen projection information of the application running on the terminal device to a display module that meets the corresponding screen projection conditions on a vehicle (such as an ordinary car, a smart car, an autonomous driving car, a connected car, etc.). Due to factors such as vehicles produced by different car companies and different models, the display modules on the vehicle are not the same. In the embodiment of the present application, the display module on the vehicle can be a display device installed or placed at any position of the vehicle, such as Figure 7 As shown, Figure 7 For ease of understanding, we take the example of various display modules being concentrated on one vehicle. Figure 7 The display module deployed on the vehicle is displayed from different perspectives. The display module on the vehicle may include at least: a central control screen 101, a dashboard screen 102, a steering wheel screen 103, a head-up display (HUD) 104, a front windshield screen 105 (for example, it may include a left field of view screen 1051, a right field of view screen 1052, etc. of the vehicle), a rear windshield screen 106, a co-pilot screen 107, a window screen (for example, a left window screen 108, a right window screen 109, etc.), a sunroof screen 110, etc., or the display module on the vehicle may also include: any surface area inside / outside the vehicle wrapped or coated with a material having a display function (such as a flexible display screen), such as a vehicle body, a door, a sun visor, a sunroof, etc. In other words, in the embodiment of the present application, any area or device inside the vehicle to which the terminal device can project a screen may be referred to as a display module on the vehicle described in the embodiment of the present application.

[0201] In addition, it should be noted that in some embodiments of the present application, the display interface corresponding to the display module on the vehicle can be an interface of any shape, for example: a rectangle (such as Figure 7The display interfaces of some display modules shown in ), square, circle, ellipse, trapezoid and any irregular shape. The shape of the display interface of the display module is not specifically limited here.

[0202] It should be noted that in some embodiments of the present application, the vehicle may be a sedan (such as Figure 7 As shown in the figure), trucks, motorcycles, buses, ships, airplanes, helicopters, recreational vehicles, amusement park vehicles, construction equipment, trams, golf carts, trains, etc., the present application embodiment does not make any special limitation. Therefore, the display module on the vehicle described in the embodiment of the present application can be a display module on any of the above-mentioned types of vehicles.

[0203] After introducing the terminal device and the display module on the vehicle described in the embodiment of the present application, the screen projection method provided in the embodiment of the present application is introduced below. It should be noted that the following embodiments can all be based on the above Figures 2 to 6 For details, please refer to Figure 8 , Figure 8 A flowchart of a screen projection method provided in an embodiment of the present application may include the following steps:

[0204] 801. Obtain a first projection condition for projecting a first display module on a vehicle, where the first projection condition is related to driving information of a target vehicle, or the first projection condition is related to feature information of an application to be projected.

[0205] First, the terminal device will obtain the first projection condition for projecting the first display module on the vehicle, and the first projection condition is related to the driving information of the target vehicle (that is, the first projection condition can be set according to the driving information of the target vehicle), or the first projection condition is related to the characteristic information of the application to be projected (that is, the first projection condition can also be set according to the characteristic information of the application to be projected), which is not specifically limited here.

[0206] It should be noted that different display modules on the vehicle have different projection conditions. Therefore, in some embodiments of the present application, the specific method for the terminal device to obtain the first projection condition for the first display module on the target vehicle to be projected can be: the terminal device will first obtain multiple projection conditions for multiple display modules on the vehicle to be projected, and one display module corresponds to one projection condition. For example, as shown in Table 1, assuming that there are 3 different display modules on the target vehicle A, namely the instrument panel screen, the steering wheel screen and the central control screen, then there is a corresponding projection condition for each display module, and there are a total of 3 projection conditions, namely projection condition 1, projection condition 2, and projection condition 3. The projection conditions are set according to the characteristic information of the application. For example, different projection conditions can be composed of different division results obtained by dividing the characteristic information of the application.

[0207] Table 1. Correspondence between the display module on the target vehicle A and the projection conditions

[0208]

[0209] It should be noted that in some embodiments of the present application, the terminal device can obtain all projection conditions for all display modules on the vehicle. As shown in Table 1 above, the terminal device can obtain three projection conditions corresponding to each of the three display modules on the target vehicle A. The terminal device can also obtain partial projection conditions (at least 2) for some display modules on the vehicle. As shown in Table 1 above, the terminal device can only obtain two projection conditions corresponding to any two display modules or two specified display modules on the target vehicle A (e.g., the central control screen and instrument panel screen on the specified target vehicle A). For ease of understanding, in the following embodiments of the present application, the example in which the terminal device obtains all projection conditions for all display modules on the vehicle is used for illustration.

[0210] It should be noted that, in some embodiments of the present application, the terminal device obtains multiple projection conditions for projecting multiple display modules on the vehicle based on the projection conditions corresponding to various display modules stored in advance on the terminal device. These display modules may exist on vehicles of the same model or on vehicles of different models. The number and type of display modules on the vehicle may be different for different vehicle models, as shown in Table 2. Regardless of the vehicle on which the display module is located, the corresponding projection conditions are formulated only based on the type of different display modules and their positions on the vehicle.

[0211] For example, it is assumed that vehicle B has 3 display modules, namely the instrument panel screen, steering wheel screen, and central control screen; vehicle C has 5 display modules, namely the instrument panel screen, steering wheel screen, central control screen, HUD, and co-pilot screen; vehicle D has 6 display modules, namely the instrument panel screen, steering wheel screen, central control screen, left window screen, right window screen, and sunroof screen; vehicle E has 8 display modules, namely the instrument panel screen, steering wheel screen, central control screen, HUD, front windshield screen, rear windshield screen, left view screen, right view screen, etc. Then, according to the corresponding relationship in Table 2, the projection conditions corresponding to the display modules on each vehicle can be obtained. For example: assuming that the corresponding relationship between the display modules and the projection conditions shown in Table 2 is stored on the terminal device, the terminal device can obtain the projection conditions corresponding to the three display modules of the instrument panel screen, steering wheel screen, and central control screen on vehicle B, which are projection condition 1, projection condition 2, and projection condition 3.

[0212] Table 2. Correspondence between different display module types and projection conditions

[0213]

[0214]

[0215] It should be noted that, as the field of automotive human-machine interface is experiencing a technological boom in automotive design and autonomous driving systems are developing rapidly, Table 2 above does not exhaust all possible display modules that may exist on the vehicle. When new types of display modules appear, users can update the correspondence in Table 2 as needed, so that the correspondence between the types of different display modules and the projection conditions in Table 2 can be as perfect as possible.

[0216] It should also be noted that in some embodiments of the present application, the correspondence between the types of different display modules and the projection conditions shown in Table 2 is not static. In actual applications, users can adjust the correspondence between the display modules and the projection conditions according to driving habits, screen viewing habits, etc.

[0217] It should also be noted that, in the embodiment of the present application, there are several implementation methods for the terminal device to obtain multiple projection conditions for multiple display modules on the vehicle to be projected, including but not limited to:

[0218] A. The terminal device receives identification information of the display module sent by the vehicle, and obtains multiple screen projection conditions for projecting multiple display modules on the vehicle based on the identification information.

[0219] In an implementation manner of the present application, a communication connection needs to be established between the terminal device and the vehicle first. When the communication connection is successfully established, the terminal device receives identification information of multiple display modules sent by the vehicle, wherein each of the multiple display modules corresponds to an identification information, and the identification information is used to uniquely characterize the corresponding display module. The terminal device can identify the corresponding display module based on the received identification information. Since the terminal device has pre-stored the correspondence between the type of display module and the projection condition (as shown in Table 2 above), based on the correspondence, the terminal device can obtain multiple projection conditions for projecting multiple display modules on the vehicle.

[0220] It should be noted that, in some embodiments of the present application, the identification information of the display module may be directly the name of the display module, such as the "central control screen", "steering wheel screen", "instrument panel screen", etc. described in Table 2 above; the identification information of the display module may also be a self-named identifier, such as the central control screen, steering wheel screen, instrument panel screen, etc. described in Table 2 above may be named "projection mark 1", "projection mark 2", "projection mark 3", etc., as shown in Table 3; the identification information of the display module may also be a self-defined letter identifier (such as a, b, c, etc.), a digital identifier (such as 11, 22, 33, etc.), a special identifier (such as @, &, #, etc.), as long as it has an identifier that uniquely identifies the function of the corresponding display module, it can be called the identification information of the display module described in the embodiment of the present application.

[0221] Table 3. Correspondence between different display modules, identification information, and projection conditions

[0222]

[0223]

[0224] For ease of understanding, the following uses a mobile phone as an example to illustrate how the terminal device obtains multiple projection conditions for multiple display modules on the vehicle to be projected. Please refer to Fig. 9 :First, the corresponding relationship between the different types of display modules and identification information and projection conditions corresponding to the above Table 3 (which can be called mapping relationship table 1) is stored in the mobile phone. When the mobile phone carried by the user establishes a communication connection with vehicle A, it can be a wired connection (such as through USB connection) or a wireless connection (such as through wifi, ultra wide band (UWB), Bluetooth, etc.), which is not limited here. Assuming that there are three display modules deployed on the vehicle A, namely the central control screen, the steering wheel screen, and the instrument panel screen, the mobile phone will receive the "projection mark 1", "projection mark 2", and "projection mark 3" sent by vehicle A (the identification information corresponding to each display module is pre-stored on vehicle A). Afterwards, the mobile phone searches in the mapping relationship table 1 based on the received "projection mark 1", "projection mark 2", and "projection mark 3", so as to obtain the "projection condition 1", "projection condition 2", and "projection condition 3" corresponding to the "projection mark 1", "projection mark 2", and "projection mark 3" respectively.

[0225] In some implementations of the present application, the mobile phone may receive the central control screen, steering wheel screen, and instrument panel screen sent by vehicle A, and then the mobile phone recognizes the corresponding identification information based on the central control screen, steering wheel screen, and instrument panel screen. That is to say, in the embodiments of the present application, the identification information may be recognized by vehicle A or by the mobile phone, which is not limited here.

[0226] It should be noted that in some embodiments of the present application, when the terminal device is connected to the vehicle for the first time via wired or wireless means, identification information corresponding to multiple display modules on the vehicle is obtained from the vehicle and stored in a storage module of the terminal device. If the terminal device subsequently establishes a communication connection with the vehicle again, the vehicle may no longer need to send identification information corresponding to the multiple display modules on the vehicle to the terminal device.

[0227] It should also be noted that in some embodiments of the present application, the terminal device may store identification information corresponding to the display modules of more than one vehicle (for example, identification information corresponding to the display modules of different vehicles sent by different vehicles at different times). In this case, the user can choose on the terminal device which vehicle's display module to obtain the identification information corresponding to. Fig.10 As shown, taking a mobile phone as an example, assuming that the mobile phone stores the identification information corresponding to the display module of vehicle A, the identification information corresponding to the display module of vehicle B, and the identification information corresponding to the display module of vehicle C, if the user carries the mobile phone and is ready to drive vehicle A, then the user can choose to obtain the identification information corresponding to the display module of vehicle A from the mobile phone without establishing a communication connection with vehicle A. It should be noted that Fig.10 This is only an illustrative operation method. In the specific application process, there may be a variety of operation methods for selecting to obtain the identification information corresponding to the display module of vehicle A from the mobile phone, which is not limited here.

[0228] B. The terminal device obtains the vehicle model of the vehicle, and obtains multiple screen projection conditions for projecting multiple display modules on the vehicle based on the vehicle model.

[0229] In an implementation manner of the present application, the terminal device can also obtain the vehicle model of the vehicle. Since the type and quantity of display modules deployed on the vehicle corresponding to each vehicle model are the same, knowing the vehicle model of the vehicle means knowing which display modules the corresponding vehicle has, and then obtaining multiple projection conditions for projecting multiple display modules on the vehicle based on the vehicle model.

[0230] For ease of understanding, the following still takes the terminal device as a mobile phone as an example to explain how the above terminal device obtains multiple projection conditions for multiple display modules on the vehicle to be projected. Please refer to Fig.11: First, the correspondence between the different types of display modules and identification information and screen projection conditions corresponding to the above Table 3 (which can be called mapping relationship table 1) is stored in the mobile phone. In addition, in addition to the mapping relationship table, the terminal device also has a correspondence between the vehicle model and the display module (which can be called mapping relationship table 2). For example, Table 4 shows the specific types of display modules possessed by certain vehicle models in the mapping relationship table 2. When the mobile phone carried by the user establishes a communication connection with vehicle B, it can be a wired connection (such as through a USB connection) or a wireless connection (such as through wifi, ultra wide band (UWB), Bluetooth, etc.), which is not limited here. The mobile phone can receive the vehicle model of vehicle B sent by vehicle B. Assuming that the model of vehicle B is "Volvo XC60", the mobile phone finds from mapping relationship table 2 that the "Volvo XC60" model vehicle has two display modules, namely the central control screen and the instrument panel screen, and the corresponding identification information is "screen projection condition 1" and "screen projection condition 3" respectively. Then the mobile phone obtains the "screen projection condition 1" and "screen projection condition 3" corresponding to the "screen projection mark 1" and "screen projection mark 3" respectively based on mapping relationship table 1.

[0231] Table 4. Correspondence between vehicle models and display module types

[0232]

[0233] Similarly, when a new vehicle model appears, the correspondence between the vehicle model and the display module shown in Table 4 above can be upgraded and updated at any time according to user needs. Similarly, when an existing vehicle model upgrades the display module on the corresponding vehicle (such as increasing the number of display modules, adding new display modules, replacing display modules, etc.), the correspondence in Table 4 above can also be upgraded and maintained in a timely manner.

[0234] It should be noted that in some embodiments of the present application, when the terminal device is connected to the vehicle for the first time by wired or wireless means, the vehicle model of the vehicle is obtained from the vehicle and stored in the storage module of the terminal device. If the terminal device subsequently establishes a communication connection with the vehicle, the vehicle may no longer need to send the vehicle model of the vehicle to the terminal device.

[0235] It should also be noted that in some embodiments of the present application, the terminal device may store more than one vehicle model (for example, the vehicle models of different vehicles sent by different vehicles at different times). In this case, the user can choose to obtain the vehicle model of which vehicle on the terminal device. Fig.12As shown, taking a mobile phone as an example, assuming that the mobile phone stores the vehicle model of vehicle A, vehicle B and vehicle C, if the user carries the mobile phone and is ready to drive vehicle B, the user can select the vehicle model of vehicle A from the mobile phone before the mobile phone establishes a communication connection with vehicle B. It should be noted that Fig.12 This is only an illustrative operation method. In the specific application process, there may be a variety of operation methods for selecting the vehicle model to which vehicle A belongs from the mobile phone, which are not specifically limited here.

[0236] It should be noted that in the embodiment of the present application, one display module corresponds to one projection condition, and the projection condition can be set according to the driving information of the vehicle (such as the driving speed of the vehicle, the type of traffic scene, the number of passengers in the vehicle, the fatigue state of the vehicle driver, etc.), and the projection condition can also be set according to the characteristic information of the application (such as the application type to be projected on the terminal device, the preset usage frequency, etc.), and the specific setting method of the projection condition is not limited here. They are introduced below.

[0237] 1. Screen projection conditions are set according to the characteristic information of the application

[0238] First, the implementation method of setting the projection conditions according to the characteristic information of the application is introduced. Different division results obtained by dividing the characteristic information of the application constitute different projection conditions. However, the characteristic information of the application includes multiple forms of expression, for example: it can be the application type to which the application belongs, the frequency of use of the application on the terminal device, the power consumption of the application when running on the terminal device, etc. Different divisions based on different characteristic information of the application can obtain different division results, and these division results constitute the different projection conditions described in the embodiments of the present application. The following will be explained separately. For ease of understanding, in the following implementation of the present application, there are three display modules on the vehicle, and these three display modules are respectively "central control screen", "steering wheel screen" and "instrument panel screen", and the corresponding display module identification information is respectively "projection mark 1", "projection mark 2" and "projection mark 3". Examples are given for illustration:

[0239] A. The characteristic information of the application is the application name, that is, the screen projection condition is that a specific application corresponds to a specific display module.

[0240] In an embodiment of the present application, the projection conditions are divided based on the application name, and different projection conditions correspond to different application names. Table 5 shows the correspondence between each type of display module and the corresponding projection condition. For example, if the name of the application to be projected on the terminal device is "WeChat", according to the various projection conditions obtained by dividing based on the application name in Table 5, it can be seen that "WeChat" belongs to the application name required in projection condition 1, and the display module corresponding to projection condition 1 is the dashboard screen. Therefore, when the terminal device establishes a communication connection with the vehicle, the terminal device can project the projection information of the application "WeChat" to the dashboard screen of the vehicle; similarly, if the name of the application to be projected on the terminal device is "Navigation", according to the various projection conditions obtained by dividing based on the application name in Table 5, it can be seen that "Navigation" belongs to the application name required in projection condition 3, and the display module corresponding to projection condition 3 is the central control screen. Therefore, when the terminal device establishes a communication connection with the vehicle, the terminal device can project the projection information of the application "Navigation" to the central control screen of the vehicle. Similarly, the various projection conditions obtained by dividing based on the application name determine which projection condition the application to be projected on the terminal device meets. If one of the projection conditions is met, the projection information of the application will be projected to the display module corresponding to the projection condition. The details are not repeated here.

[0241] It should be noted that Table 5 is only an illustration of how to obtain various projection conditions based on the application name. In actual application, there may be more division methods. For example, the application "WeChat" can be divided into projection condition 2. No specific limitation is made here.

[0242] Table 5. Correspondence between different types of display modules and corresponding projection conditions

[0243] Display Module Identification Information Screen projection conditions Screen casting conditions include application name Dashboard screen Screen projection mark 1 Screen projection conditions 1 WeChat, phone, Welink,... Steering wheel screen Screencast Mark 2 Screen projection conditions 2 NetEase Cloud Music, QQ Music, ... Central control screen Screencast Mark 3 Screen projection conditions 3 Navigation, video conferencing, Tencent Video, Honor of Kings, ... …… …… …… ……

[0244] It should be noted that in some embodiments of the present application, users can modify the corresponding projection conditions as needed. For example, the above Table 5 shows that the application names "WeChat", "Phone", and "Welink" can project the projection information to the dashboard screen. If a new application is installed on the terminal device, such as "QQ", the user can add the new application to projection condition 1. Alternatively, after the terminal device establishes a communication connection with the vehicle, the terminal device detects that an application running on the terminal device does not belong to any of the application names in the above projection conditions. At this time, the terminal device can display the interface or voice prompt the user to confirm which display module on the vehicle is connected (that is, the user can set it manually). After the user confirms the connection, the terminal device saves the application name to the projection condition corresponding to the display module for the next call.

[0245] For ease of understanding, the following Fig.13 Take this as an example to show how to add the name of the application to be projected on the terminal device to a certain projection condition, such as Fig.13 As shown, the application "QQ" is running on the mobile phone, and the mobile phone detects that "QQ" does not belong to any of the projection conditions in the stored mapping relationship table 1. At this time, the mobile phone reminds the user to confirm which of the three display modules on the vehicle (i.e., "central control screen", "steering wheel screen", and "instrument panel screen") "QQ" will be projected to through the display interface. Assuming that the user confirms to project the screen to the "instrument panel screen", the mobile phone will automatically save the application name "QQ" in the projection condition 1 corresponding to the "steering wheel screen". In this way, the next time the mobile phone establishes a connection with the vehicle and the application is running on the mobile phone, the mobile phone can automatically project the projection information of "QQ" to the corresponding instrument panel screen. It should be noted that Fig.13 It is shown that the mobile phone reminds the user to confirm by displaying a text message on the display interface. In some embodiments of the present application, the user can also be reminded to confirm by voice prompts, such as Fig.14 As shown, Fig.14 The illustration shows how to use voice prompts (such as the mobile phone voice plays "QQ has no corresponding relationship with the vehicle display module, please add it") to enable the user to add the name of the application to be projected on the terminal device to a certain projection condition. The details are not repeated here.

[0246] It should be noted that this application Fig.13 , Fig.14 These are just two of the operation modes shown. In a specific application, there may be a variety of display interface modes to remind the user to confirm, which are not limited here.

[0247] B. The characteristic information of the application is the application type to which the application belongs, that is, the screen projection condition is that a specific application type corresponds to a specific display module.

[0248] In an embodiment of the present application, the screen projection conditions are divided based on the application type to which the application belongs. Different screen projection conditions correspond to different application types. In one implementation of the present application, when a terminal device downloads an application from the "application market", "App Store", etc. of the terminal device (the names may be different due to different manufacturers of terminal devices, and are not limited here), the application market has already classified each application (that is, the classification information determined by the application market label, and each application downloaded from the application market has its own classification). For example, according to the classification label of the application market, application types can be classified into social, travel and navigation, audio and video, tools, information, games, travel and accommodation, shopping, education, sports and health, and financial management. Any application must be classified into one of the above application types. Table 6 shows the correspondence between each type of display module and the corresponding projection condition. For example, when a social application such as "WeChat", "QQ", "Short Message" is running on the terminal device, according to the various projection conditions obtained by dividing the application based on the application type to which the application belongs in Table 6, it can be seen that "WeChat", "QQ", "Short Message" and the like belong to the application type required in projection condition 1, and the display module corresponding to projection condition 1 is the instrument panel screen. Therefore, after the terminal device establishes a communication connection with the vehicle, the terminal device can project the projection information of the application "WeChat", "QQ", "Short Message" and the like to the instrument panel screen of the vehicle; similarly, if the application to be projected on the terminal device is "Dianping", the application type to which it belongs is "Information", according to the various projection conditions obtained by dividing the application based on the application type to which the application belongs in Table 6, it can be seen that "Dianping" belongs to the application type required in projection condition 3, and the display module corresponding to projection condition 3 is the central control screen. Therefore, after the terminal device establishes a communication connection with the vehicle, the terminal device can project the projection information of the application "Dianping" to the central control screen of the vehicle. Similarly, the various projection conditions obtained based on the application type to which the application belongs are divided to determine which projection condition the application to be projected on the terminal device meets. If one of the projection conditions is met, the projection information of the application is projected to the display module corresponding to the projection condition. The details are not repeated here.

[0249] Table 6. Correspondence between different types of display modules and corresponding projection conditions

[0250]

[0251] It should be noted that Table 6 is only an illustration of various projection conditions obtained by dividing based on application type. In actual application, there may be more division methods. For example, it can be directly classified into: first category, second category, third category, ..., and it is only necessary to ensure that each application belongs to only one of the above application types. This application does not specifically limit how to divide application types.

[0252] It should also be noted that in the above Table 6 of the present application, each projection condition includes at least 2 application types. In actual applications, the number of application types included in the projection condition is not limited. For example, projection condition 1 may only include social applications. Table 6 is only for illustration and is not a limitation on the embodiments of the present application.

[0253] It should be noted that in some embodiments of the present application, users can modify the corresponding projection conditions as needed. For example, Table 6 above shows that all social applications are projected to the dashboard screen of the vehicle. Users can also choose to project social applications to other screens based on usage habits, viewing habits, and driving habits. There is no specific limitation here.

[0254] It should also be noted that in the embodiment of the present application, when the terminal device downloads a new application from the application market, the terminal device can automatically classify the application according to the classification of the application by the application market, and the user does not need to classify it by himself. For example, if a new application is installed on the terminal device, such as "QQ", according to the classification of "QQ" by the application market, it can be known that "QQ" belongs to the social category. Alternatively, after the terminal device establishes a communication connection with the vehicle, the terminal device detects that an application running on the terminal device belongs to the social category; if the application type described in the embodiment of the present application is a user-defined application type, then when downloading a new application, the user can classify the newly downloaded application by himself, and upgrade and update the correspondence between different types of display modules and corresponding projection conditions. The update method is the same as the above. Fig.13 and Fig.14 The corresponding method types are not described in detail here.

[0255] C. The characteristic information of the application is the frequency range of use of the application, that is, the screen projection condition is that the specific frequency range of use of the application on the terminal device corresponds to a specific display module.

[0256] In an embodiment of the present application, the screen projection conditions are divided based on the frequency range of use of the application on the terminal device. Different screen projection conditions correspond to different frequency ranges of use. The frequency of use of the application on the terminal device can be obtained from similar functions of the terminal device such as "Healthy Use of Mobile Phone".

[0257] In the embodiments of the present application, a principle is followed: the projection information of the more frequently used applications is presented on the display module that the user can see with the least cost or is easiest to see. For example, the projection information of frequently used applications is presented on the steering wheel screen of the vehicle, and the projection information of less frequently used applications is presented on the central control screen of the vehicle.

[0258] It should be noted that, in some embodiments of the present application, the frequency range of application usage on the terminal device can be characterized in the following ways: 1) the usage time of the application on the terminal device, for example, it can be the total time spent by the user on the terminal device since the application was downloaded, or it can be the time spent by the application on the terminal device within a time period such as one day, one week or one month. The specific method for calculating the usage time is not limited here; 2) the number of times the application is started and run on the terminal device, for example, it can be the number of times the application is started and run on the terminal device since the user downloaded the application, or it can be the number of times the application is started and run on the terminal device within a time period such as one day, one week or one month. The specific method for calculating the number of starts and runs is not limited here.

[0259] The following takes the usage frequency as the duration that the application spends running on the terminal device within a week as an example to illustrate the correspondence between each type of display module and the corresponding projection condition. Please refer to Table 7, and divide the usage frequency into different levels, for example, "high", "medium" and "low". Each usage frequency level corresponds to a usage frequency range (i.e., usage time range), where the usage time within a week is represented by t, and the unit of h is hours. For example, when the application "WeChat" to be projected on the terminal device has been running on the terminal device for 48 hours within a week from the moment, according to the various projection conditions obtained by dividing based on the frequency range of use of the application on the terminal device in Table 7, it can be seen that "WeChat" is in the high frequency range of projection condition 2, and the display module corresponding to projection condition 2 is the steering wheel screen. Therefore, when the terminal device establishes a communication connection with the vehicle, the terminal device can project the projection information of the application "WeChat" to the dashboard screen of the vehicle; similarly, if the application "Honor of Kings" to be projected on the terminal device has been running on the terminal device for 5 hours within a week from the moment, according to the various projection conditions obtained by dividing based on the frequency range of use of the application on the terminal device in Table 7, it can be seen that "Honor of Kings" is in the low frequency range of projection condition 3, and the display module corresponding to projection condition 3 is the central control screen. Therefore, when the terminal device establishes a communication connection with the vehicle, the terminal device can project the projection information of the application "Honor of Kings" to the central control screen of the vehicle. Similarly, the various projection conditions obtained based on the frequency of use of the application on the terminal device are used to determine which projection condition the application to be projected on the terminal device satisfies. If one of the projection conditions is met, the projection information of the application is projected to the display module corresponding to the projection condition. The details are not repeated here.

[0260] Table 7. Correspondence between different types of display modules and corresponding projection conditions

[0261] Display Module Identification Information Screen projection conditions Screen projection conditions include usage frequency range (usage duration) Dashboard screen Screen projection mark 1 Screen projection conditions 1 Use frequency: t∈[20h,+∞] Steering wheel screen Screencast Mark 2 Screen projection conditions 2 High usage frequency: t∈[10h, 20h] Central control screen Screencast Mark 3 Screen projection conditions 3 Low usage frequency: t∈[0h,10h] …… …… …… ……

[0262] It should be noted that in some embodiments of the present application, the usage frequency range can be divided according to the number of display module types. Table 7 shows three display modules, so the usage frequency is divided into three ranges, corresponding to the three usage frequency levels of "high", "medium" and "low", and each range corresponds to a display module. If there are n display modules on the vehicle, then similarly, the usage frequency can be divided into n ranges, each range corresponds to a usage frequency level, and each range corresponds to a display module.

[0263] It should be noted that in some embodiments of the present application, users can modify the corresponding projection conditions as needed. For example, Table 7 above shows that high-frequency applications are projected to the vehicle's steering wheel screen. Users can also choose to project high-frequency applications to other screens based on usage habits, viewing habits, and driving habits. There is no specific limitation here.

[0264] D. The characteristic information of the application includes the application type and usage frequency range of the application, that is, the screen projection condition is that the specific usage frequency range of an application of a specific application type on the terminal device corresponds to a specific display module.

[0265] In the above-mentioned methods A, B, and C, the characteristic information of the application is divided based on a single factor of the application (such as the application name, application type, the frequency range of use of the application on the terminal device, etc.). In the embodiment of the present application, the single factors can also be combined with each other to obtain a division result based on the combined factors. The following projection conditions are constructed based on the two factors of the application type to which the application belongs and the frequency range of use of the application on the terminal device. Table 8 shows the correspondence between each type of display module and the corresponding projection conditions. For example, when the application "QQ" to be projected on the terminal device runs on the terminal device within one week from the moment for 17 hours, and according to the classification of "QQ" by the application market at the time of downloading, it can be known that the application type of "QQ" is a social type. According to the various projection conditions obtained by dividing based on the frequency range of use of the application on the terminal device and the application type to which the application belongs in Table 8, it can be known that "QQ" is in the social type. The frequency of use in projection condition 1 is in the range of social type, and the display module corresponding to projection condition 1 is the dashboard screen. Therefore, after the terminal device establishes a communication connection with the vehicle, the terminal device can project the screen information of the application "QQ" to the dashboard screen of the vehicle; similarly, if the application "Honor of Kings" to be projected on the terminal device has been running on the terminal device for 5 hours within a week from the time, and according to the classification of "Honor of Kings" in the application market at the time of download, it can be known that the application type of "Honor of Kings" is a game type. According to the various projection conditions obtained based on the frequency of use of the application on the terminal device and the application type to which the application belongs in Table 8, it can be known that "Honor of Kings" is in the low frequency range of projection condition 3 and is a game type, and the display module corresponding to projection condition 3 is the central control screen. Therefore, after the terminal device establishes a communication connection with the vehicle, the terminal device can project the screen information of the application "Honor of Kings" to the central control screen of the vehicle. Similarly, the various projection conditions obtained based on the frequency of use of the application on the terminal device and the application type to which the application belongs are used to determine which projection condition the application to be projected on the terminal device meets. If one of the projection conditions is met, the projection information of the application is projected to the display module corresponding to the projection condition. The details are not repeated here.

[0266] Table 8. Correspondence between different types of display modules and corresponding projection conditions

[0267]

[0268] Similarly, it should be noted that Table 8 is only an illustration of various projection conditions obtained by dividing the application based on the frequency of use of the application on the terminal device and the application type to which the application belongs. In the actual application process, there can be more ways of division. For example, the application type can be directly classified into: the first category, the second category, the third category, ..., and the frequency range can also be divided according to the number of display module types. Table 8 shows 3 display modules, so the frequency of use is divided into 3 ranges, corresponding to the three frequency levels of "high", "medium" and "low", and each range corresponds to a display module. If there are n display modules on the vehicle, then similarly, the frequency of use can be divided into n ranges, each range corresponds to a frequency level, and each range corresponds to a display module. In short, in the embodiment of the present application, it is only necessary to ensure that each application belongs to only one of the above-mentioned application types. Specifically, this application does not limit how to divide the application types. It should also be noted that in the above Table 8 of the present application, each screen projection condition includes at least 2 application types. In actual applications, the number of application types included in the screen projection conditions is not limited. For example, screen projection condition 1 may only include social applications. Table 8 is only for illustration and is not a limitation on the embodiments of the present application.

[0269] It should be noted that in some embodiments of the present application, users can modify the corresponding projection conditions as needed. For example, Table 8 above shows that applications whose application type is social and whose usage frequency on the terminal device is medium are all projected to the dashboard screen of the vehicle. Users can also choose to project social applications to other screens based on usage habits, viewing habits, driving habits, etc., which are not limited here.

[0270] It should also be noted that the above Table 8 is only an illustration of the division results based on the combined factors obtained by combining two individual factors (application type and frequency range of application usage on the terminal device). In some embodiments of the present application, it can also be a division result based on the combined factors obtained by combining any other two or more factors. The details will not be repeated here.

[0271] 2. Screen projection conditions are set according to the vehicle's driving information

[0272] Next, the implementation method of setting the projection condition according to the driving information of the vehicle is introduced. In an embodiment of the present application, the driving information of the vehicle can be characterized by a variety of parameters, for example, the driving speed of the vehicle, the type of traffic scene in which the vehicle is located (such as highways, rural roads, mountain roads, etc.), the number of passengers in the vehicle (such as 1 passenger in the co-pilot seat, 2 passengers in the back row, etc.), the fatigue state of the driver of the vehicle (such as fatigue, not fatigued, the fatigue state can be calculated by the human state information detected by the sensor module deployed in the vehicle or by the human state information detected by the wearable device worn by the driver), the distance between the vehicle and the obstacle (such as, how far is the nearest obstacle to the vehicle, to determine whether the driving environment is safe or unsafe), etc. Therefore, in an embodiment of the present application, the projection condition can be set according to the driving information of the vehicle. In this case, when the first projection condition for the first display module on the target vehicle to be projected is met, it includes: when the driving information of the target vehicle meets the first projection condition. When the driving information is represented by different parameters, the conditions that need to be met when projecting the screen information are also different, which are explained below. For ease of understanding, in the following embodiments of the present application, three display modules are used on the vehicle, and these three display modules are respectively "central control screen", "steering wheel screen" and "instrument panel screen" as examples for illustration:

[0273] A. The driving information of the vehicle is the driving speed of the vehicle.

[0274] In the embodiment of the present application, when the characterization parameter of the driving information is "driving speed", the first projection condition includes: the driving speed of the target vehicle is within the first driving speed range. For details, please refer to the A method in the following step 2602 and Table 10, which will not be repeated here.

[0275] Since different driving speeds are actually aimed at driving safety, a principle that should be followed is: when safety is not high, the projection information should be presented on the display module that the driver can see with the least effort and is easiest to see. For example, when driving at a fast speed, the driver needs to have higher attention, so the projection information can be projected to the screen that the driver can see with the least attention (such as the steering wheel screen, HUD, etc.); when driving at a slow speed, the driver does not need such high attention due to the slow speed, so the projection information can be projected to the screen that the driver can see with a slight turn of his head (such as the central control screen).

[0276] In the above-mentioned implementation mode of the present application, the projection information of the application to be projected on the terminal device is projected onto different display modules based on different driving speeds, thereby improving driving safety.

[0277] B. The driving information of the vehicle is the type of traffic scene in which the vehicle is located.

[0278] In the embodiment of the present application, when the characterization parameter of the driving information is "the type of traffic scene in which the vehicle is located", the first projection condition includes: the type of traffic scene in which the target vehicle is located belongs to the first traffic scene type. For details, please refer to the B method in the following step 2602 and Table 11, which will not be repeated here.

[0279] Similarly, since the different types of traffic scenarios in which the vehicle is located are actually aimed at driving safety, a principle that should be followed is: in situations where safety is not high, the projection information should be presented on the display module that the driver can see with the least effort and is easiest to see. For example, when the vehicle is at an intersection with a red light, the driver has stopped the vehicle and is waiting for the red light to change to a street light. At this time, the driver does not need such high attention, so the projection information can be projected to the screen that the driver can see by slightly turning his head (such as the central control screen). When the vehicle is at a turning intersection, since turning intersections are generally areas with a high incidence of traffic accidents, the driver needs to have sufficiently high attention at this time, so the projection information can be projected to the screen that the driver can see with the least attention (such as the steering wheel screen, HUD, etc.).

[0280] In the above-mentioned implementation mode of the present application, the projection information of the application to be projected on the terminal device is selected to be projected onto different display modules based on the different traffic scene types in which the vehicle is located, thereby improving driving safety.

[0281] C. The driving information of the vehicle is the number of passengers in the vehicle.

[0282] In the embodiment of the present application, when the characterization parameter of the driving information is "the number of passengers in the vehicle", the first projection condition includes: the number of passengers in the target vehicle is within the first passenger number range. The different number of passengers in the vehicle is actually aimed at the privacy and sharing of the projection information. For details, please refer to the C method in the following step 2602 and Table 12 and Table 13, which will not be repeated here.

[0283] In the above-mentioned implementation mode of the present application, based on considerations of application privacy and sharing, the number of passengers in the vehicle is different, and the projection information of the application to be projected on the terminal device can be selected to be projected onto different display modules, thereby improving the user experience.

[0284] D. The driving information of the vehicle is the fatigue status of the driver of the vehicle.

[0285] In the embodiment of the present application, when the characterization parameter of the driving information is "the fatigue state of the vehicle driver", the first projection condition includes: the fatigue state of the driver of the target vehicle belongs to the first fatigue state. For details, please refer to the D method in the following step 2602 and Table 14, which will not be repeated here.

[0286] In the above-mentioned implementation mode of the present application, the projection information of the application to be projected on the terminal device is selected to be projected onto different display modules based on the different fatigue states of the driver, thereby improving driving safety.

[0287] E. The driving information of the vehicle is the distance between the vehicle and the obstacle.

[0288] In the embodiment of the present application, when the characterization parameter of the driving information is "the distance between the vehicle and the obstacle", the first projection condition includes: the distance between the target vehicle and the obstacle is within the first distance range. For details, please refer to the E method in the following step 2602 and Table 15 and Table 16, which will not be repeated here.

[0289] In the above-mentioned embodiment of the present application, the projection information of the application to be projected on the terminal device is selected to be projected to different display modules based on the different distances between the vehicle and the obstacle, thereby reducing the probability of collision between the vehicle and the obstacle and improving driving safety.

[0290] 802. When the first screen projection condition is met, the screen projection information of the first application to be projected on the terminal device is projected to the first display module.

[0291] After the terminal device obtains multiple projection conditions for projecting multiple display modules on the vehicle, when the characteristic information of the application to be projected (which can be called the first application to be projected) on the terminal device meets the projection condition (which can be called the first projection condition) for a certain display module (which can be called the first display module) on the vehicle to be projected, or the driving information of the vehicle meets the first projection condition for the first display module on the vehicle to be projected, the terminal device will project the projection information of the first application to be projected to the first display module.

[0292] For ease of understanding, the following examples are given. Fig.15 As shown, taking the terminal device as a mobile phone as an example, assuming that the characteristic information of the application is the application type to which the application belongs (that is, the above-mentioned method B), and assuming that the application running on the mobile phone is "QQ", it can be seen from the above Table 6 that "QQ" belongs to the application type required in the projection condition 1, and the display module corresponding to the projection condition 1 is the dashboard screen. That is to say, the application "QQ" running on the mobile phone meets the projection condition 1 for the dashboard screen on the vehicle to be projected. Then, when the mobile phone establishes a communication connection with the vehicle, the mobile phone projects the projection information of the application "QQ" to the dashboard screen of the vehicle.

[0293] It should be noted that, in some embodiments of the present application, the projection information of the first application to be projected can be the entire application interface of the first application to be projected, or can be a part of the application interface of the first application to be projected. Fig.16 and Fig.17 Take this as an example: Assume that the first application to be projected is "Tencent Video", and "Tencent Video" meets the projection conditions for the central control screen on the vehicle. If "Tencent Video" is playing a video, Fig.16 This indicates that the entire application interface of the first application to be projected on the display interface of the mobile phone is projected onto the central control screen of the vehicle; Fig.17 What is illustrated is that a part of the application interface of the first application to be projected (such as only the video playback part) presented on the display interface of the mobile phone is projected onto the central control screen of the vehicle.

[0294] It should be noted that in the embodiment of the present application, due to the difference between the size of the display interface of the terminal device and the size of different display modules on the vehicle, the vehicle needs to adapt to the screen size during the screen projection process, such as changing from the 6.1-inch mobile phone to the 12-inch central control screen of the vehicle-mounted display screen, or even larger 17 inches.

[0295] It should also be noted that, in some embodiments of the present application, there may be more than one application to be projected on the terminal device, that is, there are multiple first applications to be projected, among which only one application's projection information is displayed on the display interface of the terminal device, and the other application is running in the background. In this case, if the multiple first applications to be projected running simultaneously on the terminal device respectively meet the projection conditions for different display modules on the vehicle to be projected, then there may be different projection modes, including but not limited to the following:

[0296] Method 1: Project the screen projection information of multiple first application programs to be projected onto display modules that meet the projection conditions respectively.

[0297] For example, Fig.18 As shown, assuming that the applications "QQ" and "Zhihu" are running on the mobile phone, and assuming that the characteristic information of the application is the application type to which the application belongs (that is, the above-mentioned method B), it can be seen from the above Table 6 that the application "QQ" belongs to the application type required in the projection condition 1, and the display module corresponding to the projection condition 1 is the instrument panel screen. The application "Zhihu" belongs to the application type required in the projection condition 3, and the display module corresponding to the projection condition 3 is the central control screen. In other words, "QQ" and "Zhihu" respectively meet the projection conditions of different display modules. In this case, the mobile phone can project the projection information of "QQ" and the projection information of "Zhihu" to the instrument panel screen and the central control screen respectively.

[0298] Method 2: Select the first application to be projected that is displayed on the terminal device display interface for projection. Fig.19As shown, assuming that the applications "QQ" and "Zhihu" are running on the mobile phone, and assuming that the characteristic information of the application is the application type to which the application belongs (that is, the above-mentioned method B), it can be seen from the above Table 6 that the application "QQ" belongs to the application type required in the projection condition 1, and the display module corresponding to the projection condition 1 is the instrument panel screen. The application "Zhihu" belongs to the application type required in the projection condition 3, and the display module corresponding to the projection condition 3 is the central control screen. However, the application "Zhihu" is running in the background of the mobile phone, and "QQ" is being displayed on the display interface of the mobile phone. In this case, the mobile phone can project the projection information of "QQ" to the instrument panel screen; if at a certain moment, the user switches the application "Zhihu" to the display interface of the mobile phone for display, then the mobile phone also needs to synchronously project the projection information of "Zhihu" to the central control screen.

[0299] It should be noted that there is no intersection between different projection conditions in the above implementation of the present application. For example, take Table 5 as an example: In Table 5, different applications can only be the application name required in one of the projection conditions, such as Fig. 20 As shown, there is no overlap between the applications required in each screen projection condition.

[0300] However, in some embodiments of the present application, an application can simultaneously meet the feature information of the application required in multiple projection conditions. Fig.21 As shown in the figure, the application "WeChat" can be both the application required in screen projection condition 1 and the application required in screen projection condition 2; the application "QQ" can be both the application required in screen projection condition 1 and the application required in screen projection condition 3, and so on. For another example, Fig. 22 As shown in the figure, the application type "social" (such as "WeChat", "QQ", "Short Message", etc.) to which the application belongs can be the application type required by screen projection condition 1, or the application type required by screen projection condition 2, and so on. Similarly, the frequency range of application usage on the terminal device can also be the usage range required by screen projection condition 1, or the usage range required by screen projection condition 2, and so on. Fig.21 and Fig. 22 In short, when an application meets the projection conditions for multiple display modules to be projected, there can be multiple projection methods in the embodiment of the present application, including but not limited to the following. For ease of understanding, the following example is used to illustrate the application meeting the projection conditions for two display modules to be projected at the same time, where the two display modules are the first display module and the second display module, and the projection conditions met are the first projection condition and the second projection condition:

[0301] A. Project the screen information of the application to be projected on the terminal device to both the first display module and the second display module.

[0302] In an embodiment of the present application, when the first application to be projected on the terminal device simultaneously satisfies the first projection condition for projecting the first display module on the vehicle and the second projection condition for projecting the second display module on the vehicle, and when the terminal device establishes a communication connection with the vehicle, the terminal device will simultaneously project the projection information of the first application to be projected to the first display module and the second display module of the vehicle, and the first display module and the second display module are two different ones of the multiple display modules on the vehicle.

[0303] It should be noted that in the embodiment of the present application, the premise that the terminal device simultaneously projects the screen projection information of the first application to be projected to the first display module and the second display module is that both the first display module and the second display module are not occupied by the projection. If any one of the first display module and the second display module is occupied by the projection, then the projection information of the first application to be projected can only be projected to the display module that is not occupied by the projection.

[0304] For ease of understanding, the following uses a mobile phone as an example. Fig.23 , assuming that the first application to be projected on the mobile phone is "QQ", and according to the mapping relationship table 1, it can be known that the application "QQ" satisfies the projection conditions of the central control screen and the steering wheel screen on the vehicle at the same time, then when the central control screen and the steering wheel screen are not occupied by the projection, the mobile phone can project the projection information of "QQ" to the central control screen and the steering wheel screen at the same time. In an embodiment of the present application, if any one of the central control screen and the steering wheel screen is occupied by the projection before the projection, for example, assuming that the central control screen is occupied by the projection, then the projection information of "QQ" can only be projected to the display module that is not occupied by the projection, for example, it can only be projected to the steering wheel screen.

[0305] B. Divide the projection information of the application to be projected on the terminal device into first projection sub-information and second projection sub-information according to a preset method, and project the first projection sub-information to the first display module, and project the second projection sub-information to the second display module.

[0306] In an embodiment of the present application, when the first application to be projected on the terminal device simultaneously satisfies the first projection condition for the first display module on the vehicle to be projected and the second projection condition for the second display module on the vehicle to be projected, and when the terminal device establishes a communication connection with the vehicle, the terminal device divides the projection information of the first application to be projected into first projection sub-information and second projection sub-information in a preset manner, and the first display module and the second display module are two different ones of the multiple display modules on the vehicle. Afterwards, the terminal device projects the first projection sub-information and the second projection sub-information to the first display module and the second display module, respectively.

[0307] It should be noted that, in some embodiments of the present application, the terminal device may divide the projection information of the first application to be projected into the first projection sub-information and the second projection sub-information in a preset manner in a variety of ways, including but not limited to the following:

[0308] a. Divide the application interface of the first application to be projected into a first part and a second part, wherein the first part is the first projection sub-information and the second part is the second projection sub-information.

[0309] For ease of understanding, the following uses a mobile phone as an example. Fig.24 , the application "Tencent Video" is being displayed on the mobile phone display interface. Assuming that the application "Tencent Video" meets the projection conditions for both the central control screen and the steering wheel screen, then according to the preset method, the video screen being played by "Tencent Video" can be projected to the central control screen (that is, the first projection sub-information is projected to the first display module), and the text part of "Tencent Video" can be projected to the steering wheel screen (that is, the second projection sub-information is projected to the second display module). It should be noted that in the embodiment of the present application, Fig.24 The projection information is only used as an example to illustrate the entire application interface of the application. In some embodiments of the present application, the projection information can also be a part of the application interface of the application. Fig.16 and Fig.17 The corresponding embodiment part will not be described in detail here.

[0310] b. Divide the program interfaces corresponding to the first functional module and the second functional module of the first application program to be projected into first projection sub-information and second projection sub-information.

[0311] For ease of understanding, the following still uses a mobile phone as an example. Fig.25As shown in Table 9, assuming that the first application to be projected on the mobile phone is "QQ", and the program interface of "QQ" has been divided into "message push module" and "message list module" according to the functions of the functional modules in advance, and assuming that the application "QQ" satisfies the projection conditions of both the central control screen and the steering wheel screen, then according to the preset method, the program interface corresponding to the "message push module" of "QQ" can be projected to the steering wheel screen of the vehicle (that is, the first projection sub-information is projected to the first display module), and the program interface corresponding to the "message list module" of "QQ" can be projected to the central control screen of the vehicle (that is, the second projection sub-information is projected to the second display module).

[0312] Table 9. Correspondence between projection sub-information and display modules based on different functional modules of the application program

[0313] app Functional modules Identification Information Display Module QQ Message push module Screen projection mark 1 Dashboard screen QQ Message list module Screencast Mark 2 Central control screen …… …… …… ……

[0314] It should be noted that in some embodiments of the present application, different functional modules can be divided according to their usage frequency and interactive behavior. For example, the projection sub-information of the program interface corresponding to the functional module with high-frequency display and low-frequency interaction is displayed on a display module that is conducive to the driver's reading at the most comfortable angle, such as displaying the projection sub-information corresponding to the message push module on the sub-dashboard screen; the projection sub-information of the program interface corresponding to the functional module with a certain interactive process (such as list sliding and interaction) is displayed on the display module that is easiest for the driver to operate with both hands, such as displaying the projection sub-information corresponding to the message list module on the steering wheel screen or the central control screen. By projecting the projection sub-information corresponding to different functional modules of the application onto different display modules on the vehicle, interference with the driver's driving is reduced and driving safety is improved.

[0315] It should be noted that in the embodiments of the present application, Fig.25 This is just an example. In some embodiments of the present application, different applications may be divided into different functional modules, which may be divided into 2 functional modules or more than 2 functional modules (each functional module corresponds to a program interface). The details are not elaborated here.

[0316] C. The terminal device determines the priority of the first display module and the second display module, and projects the screen projection information of the application to be projected on the terminal device to the display module with the higher priority.

[0317] In an embodiment of the present application, when the first application to be projected on the terminal device simultaneously satisfies the first projection condition that the first display module on the vehicle is projected and the second projection condition that the second display module on the vehicle is projected, and when the terminal device establishes a communication connection with the vehicle, the terminal device determines whether the first display module with a higher priority is occupied by projection according to a preset priority, wherein the first display module and the second display module are two different ones of the multiple display modules on the vehicle; if the first display module is not occupied by projection, the terminal device prioritizes projecting the projection information of the first application to be projected to the first display module, and only when the first display module is occupied by projection, the terminal device projects the projection information of the first application to be projected to the second display module.

[0318] To facilitate understanding, the following is an illustration taking a mobile phone as an example of the terminal device: the application "WeChat" is being displayed on the mobile phone display interface. Assuming that the application "WeChat" meets the projection conditions for both the central control screen and the steering wheel screen, the mobile phone will first determine the priority of the central control screen and the steering wheel screen being projected by the application "WeChat". Assuming that the priority of the central control screen is higher than that of the steering wheel screen, the mobile phone will further determine whether the central control screen is occupied by other applications (for example, whether a video is playing). If the central control screen is not occupied by projection, the mobile phone will project the projection information of "WeChat" to the central control screen. If the mobile phone determines that the central control screen is being projected by other applications (for example, a video is playing), the mobile phone will project the projection information of "WeChat" to the steering wheel screen (provided that the steering wheel screen is not occupied by other applications).

[0319] In the above-mentioned embodiment of the present application, it is specifically explained that: by obtaining the projection conditions that need to be met when each display module on the vehicle is projected (for example, the application to be projected on the terminal device belongs to a certain application type, reaches a preset usage frequency, etc.), when the projection conditions are met, the display information of the application to be projected on the terminal device is projected to the corresponding display module, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle, so that the driver can quickly obtain the information on the terminal device, reducing the probability of the driver's attention being distracted, reducing the interference of the projection information on the driver's driving, thereby improving driving safety.

[0320] It should be noted that the above Figure 8The execution subject of the projection method described in the corresponding embodiment is the terminal device, and the projection process is: the terminal device first obtains multiple projection conditions for the projection of multiple display modules of the vehicle, and then the terminal device determines whether the driving information of the vehicle (or the characteristic information of the application to be projected on the terminal device) meets the first projection condition. When the first projection condition is met, the terminal device then projects the projection information of the first application to be projected on the terminal device to the first display module corresponding to the first projection condition for display. In other words, it is the terminal device that performs the projection. However, in some embodiments of the present application, the execution subject of the projection method can also be the vehicle itself. In this case, the projection process is: the target vehicle obtains multiple projection conditions for the projection of multiple display modules of the target vehicle, and the target vehicle determines whether its own driving information (or the characteristic information of the application to be projected on the terminal device) meets the first projection condition. When the first projection condition is met, the target vehicle automatically projects the projection information of the first application to be projected on the terminal device received to the first display module corresponding to the first projection condition for display. In other words, it is the target vehicle itself that chooses which display module to project the projection information on itself.

[0321] In the above Figures 8 to 25 In the embodiment shown, it is described how the terminal device projects the screen information of the application to be projected on the terminal device to the display module that meets the corresponding projection conditions on the vehicle (such as ordinary car, smart car, self-driving car, networked car, etc.), where each display module on the vehicle corresponds to a projection condition. In some embodiments of the present application, when the terminal device projects the application to be projected on the terminal device based on the above projection conditions, Figures 8 to 25 After the screen projection method shown is completed, it can be further combined with the vehicle's own driving information to determine whether it is necessary to switch the screen display in different driving scenes. In other words, it can be combined with the vehicle's own driving status to switch between different display modules. The following is an introduction to another display information switching method provided in the embodiment of the present application. For details, please refer to Fig.26 , Fig.26 Another flowchart of the method for switching display information provided in an embodiment of the present application may include the following steps:

[0322] 2601. Obtain vehicle driving information.

[0323] First, the vehicle will obtain its own driving information. In the embodiment of the present application, the driving conditions of the vehicle can be characterized by a variety of parameters, for example, the driving speed of the vehicle, the type of traffic scene in which the vehicle is located (such as highways, rural roads, mountain roads, etc.), the number of passengers in the vehicle (such as 1 passenger in the front passenger seat and 2 passengers in the back row), the fatigue state of the driver of the vehicle (such as fatigue, not fatigued, the fatigue state can be calculated by the human state information detected by the sensor module deployed in the vehicle or by the human state information detected by the wearable device worn by the driver), the distance between the vehicle and the obstacle (such as, how far is the nearest obstacle to the vehicle, to determine whether the driving environment is safe or unsafe), etc.

[0324] It should be noted that in the embodiment of the present application, the vehicle may obtain its own driving information periodically. For example, the acquisition period may be set to 1 minute, that is, the vehicle will obtain its own driving information once every 1 minute. The vehicle may also obtain its own driving information only when the driving information changes. For example, assuming that the driving information is represented by the driving speed, when the driving speed changes by more than a preset value (e.g., the preset value is set to 20km / h), if the driving speed accelerates from 30km / h to 60km / h, when the driving speed accelerates from 30km / h to 50km / h (i.e., reaches the preset value of 20km / h), the vehicle will be triggered to obtain its own driving information. Specifically, this application does not limit the method of obtaining the vehicle's own driving information.

[0325] 2602. When the driving information of the vehicle does not meet the first driving condition, it is indicated that the projection information of the first application displayed on the first display module will be switched to be displayed on the second display module, wherein the first driving condition is a condition that needs to be met when the first display module is projected.

[0326] The vehicle can also further obtain a first driving condition that must be met by the first display module that is displaying the projection information. The first display module is one of multiple display modules on the vehicle. It should be noted that in the embodiment of the present application, the projection information of the first application can be the projection information of the application running on the terminal device to the first display module when the terminal device establishes a communication connection with the vehicle. It can also be the running interface of the application installed on the vehicle itself, or it can be a part of the running interface, etc., which can be collectively referred to as target information.

[0327] If the first display module on the vehicle is displaying the projection information of the first application running on the terminal device, the vehicle will also obtain the first driving condition that the first display module needs to meet.

[0328] For example, taking the terminal device as a mobile phone as an example, please refer to Table 10. Assuming that there are 3 display modules on the vehicle, namely "central control screen", "steering wheel screen" and "instrument panel screen", and the driving information is characterized by the parameter "driving speed", it is assumed that the driving condition that needs to be met when the central control screen is projected is "driving speed <30km / h", the driving condition that needs to be met when the instrument panel screen is projected is "30km / h≤driving speed <60km / h", and the driving condition that needs to be met when the steering wheel screen is projected is "60km / h≤driving speed <100km / h" (that is, the speed is higher than 100km / h, which is considered to be too fast and is not suitable for projection at this time). Assuming that the first display module of the vehicle is the central control screen, and the projection information of the application "QQ" running on the mobile phone is being displayed on the central control screen, the vehicle will obtain the driving conditions that need to be met when the central control screen is projected. For example, as shown in Table 10, the driving condition that needs to be met is "driving speed <30km / h".

[0329] Table 10. Driving conditions that need to be met when different display modules are projected (taking driving speed as an example)

[0330] Display Module Driving conditions to be met (driving speed) Central control screen Driving speed: <30km / h Dashboard screen 30km / h≤Driving speed<60km / h Steering wheel screen 60km / h≤Driving speed<100km / h …… ……

[0331] It should also be noted that, in some embodiments of the present application, the projection information of the first application may be the entire application interface of the first application, or may be a part of the application interface of the first application. Fig.16 and Fig.17 The details are shown and will not be described in detail here.

[0332] It should be noted that in the embodiment of the present application, due to the difference between the size of the display interface of the terminal device and the size of different display modules on the vehicle, the vehicle needs to adapt to the screen size during the screen projection process, such as changing from the 6.1-inch mobile phone to the 12-inch central control screen of the vehicle display, or even larger 17 inches.

[0333] After obtaining its own driving information and the first driving condition, the vehicle will further determine whether the vehicle's driving information is consistent with the first driving condition. If the vehicle's driving information is inconsistent with the first driving condition, the vehicle will switch the projection information to a second display module corresponding to the second driving condition that is consistent with the first driving condition for display, wherein the second display module is another one of the multiple display modules on the vehicle.

[0334] It should be noted that, in some embodiments of the present application, the process in which the vehicle switches the projection information to the second display module corresponding to the second driving condition that conforms to the first driving condition for display may specifically be: the vehicle first generates a switching instruction (which may be referred to as a first switching instruction), and the first switching instruction is used to instruct the vehicle to switch the projection information to the second display module. Thereafter, the vehicle switches the projection information to the second display module corresponding to the second driving condition that conforms to the vehicle's driving information for display according to the first switching instruction.

[0335] It should also be noted that, in some embodiments of the present application, in addition to the projection information of the first application, other information may be displayed on the first display module. For example, it may be the running interface of the application installed on the vehicle itself, or it may be a part of the running interface, etc., which can be collectively referred to as target information. At this time, what is displayed on the first display module is not the projection information. In this case, a way to implement screen switching is: the vehicle obtains the vehicle's own driving information, and then determines whether its own driving information meets the first driving condition. When the vehicle's driving information does not meet the first driving condition, and the vehicle's driving information meets the second driving condition, the target information displayed on the first display module is switched to the second display module for display, wherein the first display module and the second display module are two different display modules on the vehicle, respectively. The first driving condition is a condition that must be met when the first display module is projected, and the second driving condition is a condition that must be met when the second display module is projected.

[0336] It should also be noted that in the embodiments of the present application, the driving information of the vehicle can be characterized by a variety of parameters, such as the driving speed of the vehicle, the type of traffic scene the vehicle is in, the number of passengers in the vehicle, the fatigue state of the driver of the vehicle, the distance between the vehicle and the obstacle, etc. When the driving information is characterized by different parameters, the conditions that need to be met for switching the display are also different, which are explained below. For ease of understanding, in the following embodiments of the present application, the display modules on the vehicle are all three, and these three display modules are respectively "central control screen", "steering wheel screen" and "instrument panel screen" as examples for illustration:

[0337] A. The driving information of the vehicle is the driving speed of the vehicle.

[0338] In an embodiment of the present application, when the characterization parameter of the driving information is "driving speed", the driving information of the vehicle does not comply with the first driving condition, and the driving information of the vehicle complies with the second driving condition if: the first driving condition includes that the driving speed is within a first driving speed range, and the second driving condition includes that the driving speed is within a second driving speed range; the driving speed of the vehicle is not within the first driving speed range, and the driving speed of the vehicle is within the second driving speed range.

[0339] For ease of understanding, the following Fig. 27 Take this as an example for illustration: Assume that there are three display modules on the vehicle, namely "central control screen", "steering wheel screen" and "instrument panel screen", and the driving information is characterized by the parameter "driving speed", as shown in Table 10. Assume that the driving condition that needs to be met when the central control screen is projected is "driving speed <30km / h", the driving condition that needs to be met when the instrument panel screen is projected is "30km / h≤driving speed <60km / h", and the driving condition that needs to be met when the steering wheel screen is projected is "60km / h≤driving speed <100km / h" (that is, a speed higher than 100km / h is considered to be too fast, and it is not suitable for projection at this time). In an embodiment of the present application, assuming that the first display module of the vehicle is the central control screen, and the projection information of the application "QQ" running on the mobile phone is being displayed on the central control screen, then the vehicle will obtain the driving conditions that need to be met when the central control screen is projected. For example, as shown in Table 10, the driving condition that needs to be met is "driving speed <30km / h". When the vehicle's driving speed is less than 30km / h, the projection information of "QQ" continues to be projected on the central control screen. When the vehicle's driving speed is 55km / h, the vehicle determines that the driving speed does not meet the driving speed required in the driving conditions (i.e., "driving speed <30km / h"). The vehicle further determines that the driving speed of 55km / h is within the range of "30km / h≤driving speed <60km / h". It can be seen from Table 10 that the driving condition "30km / h≤driving speed <60km / h" is the driving condition that must be met when the instrument panel screen is projected. Therefore, the vehicle will switch the projection information of "QQ" to the instrument panel screen for display.

[0340] It should be noted that the above Fig. 27 The division based on driving speed range is for illustration only. Users can set the driving conditions that each display module on the vehicle must meet according to their driving habits, screen viewing habits, etc. (that is, the "driving speed" parameter is configurable). No specific restrictions are made here.

[0341] In the above-mentioned embodiment of the present application, the projection information of the application running on the terminal device is projected onto different display modules based on different driving speeds. The different driving speeds are actually aimed at driving safety. In the case of low safety, the projection information should be presented on the display module that the driver can see with the least cost and is easiest to see. For example, when the driving speed is fast, the driver needs to have higher attention. In this case, the projection information can be projected onto the screen that the driver can see with the least attention (such as the steering wheel screen). When the driving speed is slow, the driver does not need such high attention due to the slow speed. In this case, the projection information can be projected onto the screen that the driver can see with a slight turn of his head (such as the central control screen).

[0342] B. The driving information of the vehicle is the type of traffic scene in which the vehicle is located.

[0343] In an embodiment of the present application, when the characterization parameter of the driving information is "the traffic scene type in which the vehicle is located", then the driving information of the vehicle does not comply with the first driving condition, and the driving information of the vehicle complies with the second driving condition if: the first driving condition includes that the traffic scene type belongs to the first traffic scene type, and the second driving condition includes that the traffic scene type belongs to the second traffic scene type; the traffic scene type in which the vehicle is located does not belong to the first traffic scene type, and the traffic scene type in which the vehicle is located belongs to the second traffic scene type.

[0344] It should be noted that in the embodiments of the present application, the traffic scene refers to a scene composed of traffic participants (such as vehicles, pedestrians, etc.) and objects (such as traffic signs, obstacle signs, etc.) on the traffic road network. Fig.28 As shown, Fig.28 It is a typical traffic scene at a crossroads, in which traffic participants are various vehicles (pedestrians are not shown) and traffic lights, street lights, zebra crossings, etc. (i.e., objects). It should be noted that traffic scenes can be divided into different types of traffic scenes according to pre-set division rules. For example, one division method can be based on traffic signs, and the traffic scene types can be divided into "crossroads", "T-shaped intersections", "traffic light intersections (displaying red lights)", "turning intersections", "straight roads", etc.; another division method can also be based on road conditions and surrounding traffic participants, and the traffic scene types can be divided into "highways", "mountain roads", "rural roads", "urban roads", etc. In the embodiments of the present application, there is no limitation on the principles on which traffic scene types are divided.

[0345] For ease of understanding, the following example is used for illustration: Assume that there are a total of three display modules on the vehicle, namely, "central control screen", "steering wheel screen", and "instrument panel screen", and the driving information is characterized by the parameter "traffic scene type in which the vehicle is located", as shown in Table 11. Assume that the traffic scene types are divided according to traffic signs, and the traffic scene types are divided into "crossroads", "T-shaped intersection", "traffic light intersection (displaying red light)", "turning intersection", and "straight road", and assume that the driving conditions that need to be met when the central control screen is projected are that the traffic scene type of the vehicle is "traffic light intersection (displaying red light)" and "straight road", the driving conditions that need to be met when the instrument panel screen is projected are that the traffic scene type of the vehicle is "crossroads" and "T-shaped intersection", and the driving conditions that need to be met when the steering wheel screen is projected are that the traffic scene type of the vehicle is "turning intersection". In the embodiment of the present application, assuming that the first display module of the vehicle is the central control screen, and the central control screen is displaying the projection information of the application "WeChat" running on the mobile phone, then the vehicle will obtain the driving conditions that need to be met when the central control screen is projected. For example, as shown in Table 11, the driving conditions that need to be met are that the traffic scene type of the vehicle is "traffic light intersection (displaying red light)" or "straight road". When the driver drives the vehicle (or the autonomous driving vehicle drives itself) to a turning intersection, the vehicle determines that it is at a turning intersection through its own navigation positioning module and / or sensor module, then the vehicle will further determine that the traffic scene of the vehicle does not meet the traffic scene required in the driving conditions (i.e. "traffic light intersection (displaying red light)" or "straight road"). It can be seen from Table 10 that the vehicle further determines that the traffic scene of the vehicle belongs to the traffic scene type that needs to be met when the steering wheel screen is projected (i.e. "turning intersection"), so the vehicle will switch the projection information of the application "WeChat" to the steering wheel screen for display.

[0346] Table 11. Driving conditions that need to be met when different display modules are projected (taking the traffic scene type in which the vehicle is located as an example)

[0347] Display Module Driving conditions that need to be met (the type of traffic scene the vehicle is in) Central control screen Traffic light intersection (red light), straight road Dashboard screen Crossroads, T-junctions Steering wheel screen Turning intersection …… ……

[0348] It should be noted that the above classification based on the type of traffic scene the vehicle is in is only for illustration. Users can set the driving conditions that each display module on the vehicle must meet according to their driving habits, screen viewing habits, etc. (that is, the "vehicle traffic scene type" parameter is configurable), and no specific restrictions are made here.

[0349] In the above-mentioned embodiment of the present application, the projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different traffic scene types in which the vehicle is located. The different traffic scene types in which the vehicle is located are actually aimed at driving safety. In the case of low safety, the projection information should be presented on the display module that the driver can see with the least cost and is easiest to see. For example, when the vehicle is at an intersection with a red light, the driver has stopped the vehicle and is waiting for the red light to change to a street light. At this time, the driver does not need such high attention, so the projection information can be projected onto the screen that the driver can see by slightly turning his head (such as the central control screen). When the vehicle is at a turning intersection, since the turning intersection is generally a high-incidence area of ​​traffic accidents, the driver needs to have sufficiently high attention at this time, so the projection information can be projected onto the screen that the driver can see with the least attention (such as the steering wheel screen).

[0350] C. The driving information of the vehicle is the number of passengers in the vehicle.

[0351] In an embodiment of the present application, when the characterization parameter of driving information is "the number of passengers in the vehicle", the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition if: the first driving condition includes that the number of passengers is within a first passenger number range, and the second driving condition includes that the number of passengers is within a second passenger number range; the number of passengers in the vehicle is not within the first passenger number range, and the number of passengers in the vehicle is within the second passenger number range.

[0352] It should be noted that in the embodiment of the present application, the number of passengers in the vehicle does not include the driver. For example, when there is only the driver in the vehicle, the number of passengers in the vehicle = 0.

[0353] For ease of understanding, the following example is used for illustration: assuming that there are three display modules in the vehicle, namely, "central control screen", "steering wheel screen" and "instrument panel screen", and the driving information is represented by the parameter "number of passengers in the vehicle", as shown in Table 12. assuming that the driving condition that needs to be met when the central control screen is projected is that the number of passengers in the vehicle is ≥1 (for example, there are passengers sitting on the co-pilot seat of the vehicle), and the driving condition that needs to be met when the instrument panel screen is projected is that the number of passengers in the vehicle = 0, and the steering wheel screen is not projected. In an embodiment of the present application, assuming that the first display module of the vehicle is the central control screen, and the projection information of the application "WeChat" running on the mobile phone is being displayed on the central control screen, then the vehicle will obtain the driving conditions that need to be met when the central control screen is projected. For example, as shown in Table 12, the driving condition that needs to be met is that the number of passengers in the vehicle is ≥ 1. For example, if there is a passenger on the co-pilot seat of the vehicle, when the passenger on the co-pilot seat gets off at a certain moment, there is only the driver in the vehicle at this time (that is, the number of passengers in the vehicle = 0), then the vehicle will determine that the number of passengers in the vehicle does not meet the number of passengers in the vehicle required in the driving conditions (that is, "traffic light intersection (displaying red light)" or "straight road"). It can be seen from Table 12 that the vehicle further determines that the number of passengers in the vehicle belongs to the range of the number of passengers that needs to be met when the dashboard screen is projected (that is, the number of passengers in the vehicle = 0). Therefore, the vehicle will switch the projection information of the application "WeChat" to the dashboard screen for display.

[0354] Table 12. Driving conditions that need to be met when different display modules are projected (taking the number of passengers in the vehicle as an example)

[0355] Display Module Driving conditions that need to be met (number of passengers in the vehicle) Central control screen Number of passengers in the vehicle ≥ 1 Dashboard screen Number of passengers in vehicle = 0 Steering wheel screen No screen projection …… ……

[0356] It should be noted that in the embodiment of the present application, whether there are passengers in the vehicle, how many passengers there are, and what seats the passengers are sitting in the vehicle (for example, whether there is a passenger on the front passenger seat) can be obtained based on the cameras installed in the vehicle (i.e. based on image recognition), sensor devices installed on the seats, etc., and the details will not be elaborated here.

[0357] It should also be noted that in some embodiments of the present application, the number of passengers in the vehicle can also be combined with other parameters to jointly determine which display module the screen projection information of the application running on the terminal device is projected to. For example, it can be combined with the privacy level of the application, such as "WeChat", "QQ" and other programs are high-privacy applications. When the number of passengers in the vehicle is ≥1, that is, there are other people in the vehicle besides the driver, then such high-privacy applications are projected to the dashboard screen or steering wheel screen that only the driver can see when running; and "Tencent Video", "QQ Music" and other applications are low-privacy applications. When the number of passengers in the vehicle is ≥1, considering the need for common use, such low-privacy applications can be projected to the central control screen that both the driver and the passenger can see when running. For details, please refer to Table 13, which is only an illustrative method. In some embodiments of the present application, it is possible to determine which applications or application types are high-privacy applications (i.e., the privacy level is configurable) according to user needs, and no specific limitation is made here.

[0358] Table 13. Driving conditions that must be met when different display modules are projected (taking privacy into consideration)

[0359]

[0360] It should be noted that the above-mentioned divisions based on the number of passengers in the vehicle in Table 12 and Table 13 are for illustration only. Users can set the driving conditions that each display module on the vehicle must meet according to their driving habits, screen viewing habits, etc. (that is, the "number of passengers in the vehicle" parameter is configurable). There is no specific limitation here. For example, some users do not have high requirements for privacy and believe that passengers in the car can see any projection information of applications running on the terminal device, while some users believe that applications running on the terminal device are private.

[0361] In the above-mentioned embodiment of the present application, the projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different numbers of passengers in the vehicle. The different numbers of passengers in the vehicle are actually aimed at the privacy and sharing of the projection information. When the application running on the terminal device is a high-privacy application (such as WeChat), in order to avoid other passengers from seeing the projection information, the high-privacy application can be projected to the dashboard screen or steering wheel screen that only the driver can see. When the application running on the terminal device is a low-privacy application (such as Tencent Video), considering the need for common use, such low-privacy applications can be projected to the central control screen that both the driver and passengers can see when running.

[0362] D. The driving information of the vehicle is the fatigue status of the driver of the vehicle.

[0363] In an embodiment of the present application, when the characterization parameter of driving information is "fatigue state of the vehicle driver", the driving information of the vehicle does not conform to the first driving condition, and the driving information of the vehicle conforms to the second driving condition if: the first driving condition includes that the driver's fatigue state belongs to the first fatigue state, and the second driving condition includes that the driver's fatigue state belongs to the second fatigue state; the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state.

[0364] It should be noted that in the embodiments of the present application, the fatigue state of the vehicle driver can be calculated from the human state information detected by the sensor module deployed in the vehicle, or it can be calculated from the human state information detected by the wearable device worn by the driver (such as a smart bracelet, a smart watch, etc.). In some embodiments of the present application, the driver's fatigue state can be graded, and it can be graded according to the number of vehicle display modules. For example, assuming that there are 3 display modules on the vehicle, the driver's fatigue state can be divided into 3 levels of "fatigue", "sub-fatigue" and "mental"; assuming that there are 2 display modules on the vehicle, the driver's fatigue state can be divided into 2 levels of "fatigue" and "mental", etc. Based on the different fatigue states of the driver, it can be known whether the corresponding driving behavior is safe.

[0365] For ease of understanding, the following example is used for illustration: Assuming that there are three display modules on the vehicle, namely "central control screen", "steering wheel screen" and "instrument panel screen", and the driving information is characterized by the parameter "driver fatigue status", as shown in Table 14, assuming that the driving condition that needs to be met when the central control screen is projected is that the driver's fatigue status is "spirited", the driving condition that needs to be met when the instrument panel screen is projected is that the driver's fatigue status is "sub-fatigue", and the driving condition that needs to be met when the steering wheel screen is projected is that the driver's fatigue status is "fatigue". In an embodiment of the present application, assuming that the first display module of the vehicle is the central control screen, and the central control screen is displaying the projection information of the application "QQ" running on the mobile phone, then the vehicle will obtain the driving conditions that need to be met when the central control screen is projected. For example, as shown in Table 14, the driving condition that needs to be met is that the driver's fatigue status is "spirited". When the sensor module deployed in the vehicle calculates that the driver's fatigue state is "mental" (periodically calculated) based on the detected driver's body state information, or when the wearable device worn by the driver (such as a smart bracelet, smart watch, etc.) calculates that the driver's fatigue state is "mental" (periodically calculated) based on the detected driver's body state information, then the projection information of "QQ" continues to be projected on the central control screen. In a certain detection cycle, when the driver's fatigue state is calculated to be "sub-fatigue", the vehicle determines that the driver's fatigue state does not meet the driver's fatigue state required in the driving conditions (i.e., "mental"). It can be seen from Table 14 that the driver's fatigue state is the driver's fatigue state that must be met when the instrument panel screen is projected. Therefore, the vehicle will switch the projection information of "QQ" to the instrument panel screen for display.

[0366] Table 14. Driving conditions that need to be met when different display modules are projected (taking the driver's fatigue state as an example)

[0367] Display Module Driving conditions that need to be met (driver fatigue status) Central control screen Fatigue level is "mental" Dashboard screen Fatigue level is "sub-fatigue" Steering wheel screen Fatigue level is "Fatigue" …… ……

[0368] It should be noted that the above-mentioned classification based on the driver's fatigue state in Table 14 is only for illustration, and the user can set the driving conditions that each display module on the vehicle needs to meet according to driving habits, screen viewing habits, etc. (that is, the "driver's fatigue state" parameter is configurable), and the specifics are not limited here. For example, in some embodiments of the present application, if the driver's fatigue state is "fatigue", the driver's driving behavior can be considered unsafe at this time, and the screen projection information of the application running on the terminal device will not be projected, and the vehicle can also remind the driver to stop and rest through the voice module.

[0369] In the above-mentioned embodiment of the present application, the projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different fatigue states of the driver. Different driving speeds are actually aimed at driving safety. When the driver's fatigue state is at a high fatigue level, it means that the driving behavior safety at this time is not high. The projection information should be presented on the display module that the driver can see with the least cost and is easiest to see. For example, when the driver's fatigue state is "fatigue", the driver needs to use little energy and attention on driving the vehicle. Then the projection information can be projected to the screen that the driver can see with the least attention (such as the steering wheel screen). When the driver's fatigue state is "spirited", it means that the driver is more energetic at this time. Then the projection information can be projected to the screen that the driver can see with a slight turn of his head (such as the central control screen).

[0370] E. The driving information of the vehicle is the distance between the vehicle and the obstacle.

[0371] In an embodiment of the present application, when the characterization parameter of driving information is "the distance between the vehicle and the obstacle", the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition if: the first driving condition includes that the distance between the vehicle and the obstacle is within a first distance range, and the second driving condition includes that the distance between the vehicle and the obstacle is within a second distance range; the distance between the vehicle and the obstacle is not within the first distance range, and the distance between the vehicle and the obstacle is within the second distance range.

[0372] It should be noted that in the embodiment of the present application, the distance between the vehicle and the obstacle can be calculated based on the perception information collected by the sensors deployed on the vehicle (such as laser radar, camera, etc.). According to the collected perception information, the distance between the vehicle and each obstacle and the direction and position of the obstacle relative to the vehicle can be obtained. Fig.29 As shown, Fig.29 The traffic scene of a vehicle driving on a highway is shown in the figure. The area enclosed by a dotted line indicates the safe driving area of ​​the vehicle. If there are no obstacles (such as surrounding vehicles, pedestrians, roadblocks, etc.) in this area, it means that the driving environment of the vehicle is safe. Fig.29In the figure, the distances between the surrounding vehicles in front, behind, left and right of the vehicle and the vehicle are 23m, 21m, 2m and 3m respectively, all outside the safe area, indicating that the driving environment of the vehicle is safe. If an obstacle appears in the safe area during the driving process of the vehicle, it means that the driving environment of the vehicle is unsafe, and the driver needs to concentrate and drive carefully to avoid collision with the obstacle. The closer the obstacle is to the vehicle, the shorter the time left for the driver to react, and the greater the risk of collision between the vehicle and the obstacle. Therefore, in an embodiment of the present application, the screen projection information of the application running on the terminal device can be selected to be projected to different display modules based on the different distances between the vehicle and the obstacle.

[0373] It should be noted that, in some embodiments of the present application, the distance between the vehicle and an obstacle may be the distance between the vehicle and multiple obstacles. The more obstacles there are, the more the driver needs to concentrate on driving. The distance between the vehicle and an obstacle may also be the distance between the vehicle and the nearest obstacle. If the nearest obstacle to the vehicle is outside the vehicle's safe area, it means that other obstacles are also far away from the vehicle. At this time, the vehicle's driving environment is safe.

[0374] For ease of understanding, the following example is used for illustration: Assume that there are three display modules on the vehicle, namely "central control screen", "steering wheel screen" and "instrument panel screen", and the driving information is characterized by the parameter "distance between the vehicle and the obstacle", as shown in Table 15, where h is used to represent the distance between the vehicle and the obstacle. Assume that the driving condition that needs to be met when the central control screen is projected is "h≥20m", the driving condition that needs to be met when the instrument panel screen is projected is "15m≤h<20m", and the driving condition that needs to be met when the steering wheel screen is projected is "h<15m". In this embodiment of the present application, assuming that the first display module of the vehicle is the central control screen, and the central control screen is displaying the projection information of the application "QQ" running on the mobile phone, then the vehicle will obtain the driving conditions that need to be met when the central control screen is projected. For example, as shown in Table 15, the driving condition that needs to be met is "h≥20m". When the sensor module deployed in the vehicle periodically calculates h≥20m, the projection information of "QQ" continues to be projected on the central control screen. In a certain calculation cycle, when it is calculated to be 15m≤h<20m, the vehicle determines that the distance between the vehicle and the obstacle does not meet the distance between the vehicle and the obstacle required in the driving conditions (that is, "h≥20m"). It can be seen from Table 15 that the driver's fatigue state is the distance between the vehicle and the obstacle that must be met when the instrument panel screen is projected. Therefore, the vehicle will switch the projection information of "QQ" to the instrument panel screen for display.

[0375] Table 15. Driving conditions that need to be met when different display modules are projected (taking the distance between the vehicle and the obstacle as an example)

[0376] Display Module Driving conditions to be met (distance h between the vehicle and the obstacle) Central control screen h≥20m Dashboard screen 15m≤h<20m Steering wheel screen h<15m …… ……

[0377] It should be noted that, in some embodiments of the present application, the distance between the vehicle and the obstacle can be further subdivided in combination with the position of the obstacle in the vehicle. The distance requirements are different when the obstacle is located in different positions of the vehicle. For example, please continue to refer to Fig.29 When the obstacle is located on the left or right side of the vehicle, the required distance between the vehicle and the obstacle may be smaller (e.g., 1.5 m). When the obstacle is located in front of or behind the vehicle, since the vehicle may be traveling at a faster speed and there will be a braking distance, the required distance between the vehicle and the obstacle may be larger (e.g., 20 m). For details, please refer to Table 16. Table 16 is only an illustrative method. In some embodiments of the present application, the distance threshold between the vehicle and the obstacle when switching the screen display can be set according to user needs. The specific details are not limited here.

[0378] Table 16. Driving conditions that need to be met when different display modules are projected (considering the orientation between the vehicle and obstacles)

[0379]

[0380]

[0381] It should be noted that the division based on the distance h between the vehicle and the obstacle in the above Tables 15 and 16 is only for illustration. The user can set the driving conditions that each display module on the vehicle must meet according to driving habits, screen viewing habits, etc. (that is, the "distance between the vehicle and the obstacle" parameter is configurable), and no specific limitations are made here.

[0382] In the above-mentioned embodiment of the present application, the projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different distances between the vehicle and the obstacle. The different distances between the vehicle and the obstacle are actually aimed at driving safety. When the distance between the vehicle and the obstacle is closer, it means that the driver has less time to react, then the risk of a collision between the vehicle and the obstacle is greater, indicating that the driving environment of the vehicle is unsafe. At this time, the driver needs to concentrate and drive carefully to avoid a collision with the obstacle. Then the projection information can be projected to the screen that the driver can see with the least attention (such as the steering wheel screen); when the distance between the vehicle and the obstacle is farther, it means that the driving environment of the vehicle is safer, then the projection information can be projected to the screen that the driver can see by slightly turning his head (such as the central control screen).

[0383] In the above-mentioned methods A to E, the description is based on the vehicle driving information as a single parameter (such as "driving speed", "traffic scene type", "number of passengers in the vehicle", "driver fatigue status", "distance between the vehicle and obstacles", etc.). In some embodiments of the present application, the single parameters can also be combined with each other to obtain a screen switching display method based on the combined parameters. The screen switching display process of the combined parameters is similar to the single parameters in the above-mentioned methods A to E, and the details will not be repeated here.

[0384] In the above Figure 26 to Figure 29 In the embodiment shown, it is described that when the terminal device completes the screen projection of the application to be projected on the terminal device (e.g., based on the above Figures 8 to 25 How does the vehicle determine whether it needs to switch screens for display in different driving scenarios based on its own driving information? Fig.26 The corresponding embodiment provides a screen projection method for the vehicle to implement the screen switching display function. In some implementations of the present application, the screen switching display function can also be implemented by the terminal device. The following is an introduction to another display information switching method provided in the embodiment of the present application. For details, please refer to Fig.30 , Fig.30 Another flowchart of the method for switching display information provided in an embodiment of the present application may include the following steps:

[0385] 3001. The terminal device sends a first instruction to a vehicle, where the first instruction is used to instruct the display of projection information of a first application on a first display module of the vehicle.

[0386] First, the terminal device sends a first instruction to the vehicle, wherein the first instruction is used to instruct the display of projection information of a first application on a first display module of the vehicle, and the first application may be an application running on the terminal device.

[0387] 3002. The terminal device obtains the vehicle's driving information.

[0388] After the vehicle obtains its own driving information, it will further send the obtained vehicle driving information to the terminal device. If the vehicle periodically obtains its own vehicle driving information, the terminal device will also periodically receive the vehicle driving information sent by the vehicle.

[0389] 3003. When the driving information of the vehicle does not meet the first driving condition and meets the second driving condition, the terminal device sends a second instruction to the vehicle, and the second instruction is used to instruct to display the information of the first application on the second display module of the vehicle, wherein the first driving condition is a condition that must be met when the first display module is projected, and the second driving condition is a condition that must be met when the second display module is projected.

[0390] The terminal device obtains a first driving condition that must be met by a first display module that is displaying projection information. The first display module is one of multiple display modules on the vehicle. The projection information is projection information that, when a communication connection is established between the terminal device and the vehicle, the terminal device projects a first application running on the terminal device to the first display module.

[0391] If the first display module on the vehicle is displaying the projection information of the first application running on the terminal device, the terminal device will also obtain the first driving condition that the first display module needs to meet.

[0392] It should also be noted that, in some embodiments of the present application, the projection information of the first application may be the entire application interface of the first application, or may be a part of the application interface of the first application. Fig.16 and Fig.17 The details are shown and will not be described in detail here.

[0393] It should be noted that in the embodiment of the present application, due to the difference between the size of the display interface of the terminal device and the size of different display modules on the vehicle, the vehicle needs to adapt to the screen size during the screen projection process, such as changing from the 6.1-inch mobile phone to the 12-inch central control screen of the vehicle display, or even larger 17 inches.

[0394] After obtaining the vehicle's driving information and the first driving condition, the terminal device will further determine whether the vehicle's driving information complies with the first driving condition. If the vehicle's driving information does not comply with the first driving condition, the terminal device will send a second instruction to the vehicle. The second instruction is used to switch the information of the first application (such as the running interface of the first application, or a part of the running interface) to a second display module corresponding to a second driving condition that complies with the first driving condition for display, wherein the second display module is another one of the multiple display modules on the vehicle.

[0395] It should be noted that, in some embodiments of the present application, the process in which the terminal device switches the projection information to the second display module corresponding to the second driving condition that meets the first driving condition for display specifically includes but is not limited to the following methods:

[0396] Method 1: The terminal device first stops projecting the screen to the first display module on the vehicle, and then projects the projected screen information to the second display module corresponding to the second driving condition that meets the driving information of the vehicle. In other words, stop projecting the screen to the first display module, and then re-project the screen to the second display module.

[0397] Method 2: The terminal device generates a switching instruction (which may be called a second switching instruction) and sends the second switching instruction to the vehicle. The second switching instruction is used to instruct the vehicle to switch the projection information to a second display module corresponding to a second driving condition that conforms to the vehicle's driving information for display. After the vehicle receives the second switching instruction, it will switch the projection information to the second display module according to the second switching instruction.

[0398] It should be noted that in the embodiment of the present application, since the driving information of the vehicle can be represented by a variety of parameters, such as the driving speed of the vehicle, the type of traffic scene the vehicle is in, the number of passengers in the vehicle, the fatigue state of the driver of the vehicle, the distance between the vehicle and the obstacle, etc. When the driving information is represented by different parameters, the conditions that need to be met for switching display are also different, which are explained below respectively:

[0399] A. The driving information of the vehicle is the driving speed of the vehicle.

[0400] In an embodiment of the present application, when the characterization parameter of the driving information is "driving speed", the driving information of the vehicle does not comply with the first driving condition, and the driving information of the vehicle complies with the second driving condition if: the first driving condition includes that the driving speed is within a first driving speed range, and the second driving condition includes that the driving speed is within a second driving speed range; the driving speed of the vehicle is not within the first driving speed range, and the driving speed of the vehicle is within the second driving speed range.

[0401] For the specific process, please refer to method A in the above step 2602, which will not be repeated here.

[0402] B. The driving information of the vehicle is the type of traffic scene in which the vehicle is located.

[0403] In an embodiment of the present application, when the characterization parameter of the driving information is "the traffic scene type in which the vehicle is located", then the driving information of the vehicle does not comply with the first driving condition, and the driving information of the vehicle complies with the second driving condition if: the first driving condition includes that the traffic scene type belongs to the first traffic scene type, and the second driving condition includes that the traffic scene type belongs to the second traffic scene type; the traffic scene type in which the vehicle is located does not belong to the first traffic scene type, and the traffic scene type in which the vehicle is located belongs to the second traffic scene type.

[0404] For the specific process, please refer to method B in the above step 2602, which will not be repeated here.

[0405] C. The driving information of the vehicle is the number of passengers in the vehicle.

[0406] In an embodiment of the present application, when the characterization parameter of driving information is "the number of passengers in the vehicle", the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition if: the first driving condition includes that the number of passengers is within a first passenger number range, and the second driving condition includes that the number of passengers is within a second passenger number range; the number of passengers in the vehicle is not within the first passenger number range, and the number of passengers in the vehicle is within the second passenger number range.

[0407] For the specific process, please refer to method C in the above step 2602, which will not be repeated here.

[0408] D. The driving information of the vehicle is the fatigue status of the driver of the vehicle.

[0409] In an embodiment of the present application, when the characterization parameter of driving information is "fatigue state of the vehicle driver", the driving information of the vehicle does not conform to the first driving condition, and the driving information of the vehicle conforms to the second driving condition if: the first driving condition includes that the driver's fatigue state belongs to the first fatigue state, and the second driving condition includes that the driver's fatigue state belongs to the second fatigue state; the fatigue state of the driver of the vehicle does not belong to the first fatigue state, and the fatigue state of the driver of the vehicle belongs to the second fatigue state.

[0410] For the specific process, please refer to method D in the above step 2602, which will not be repeated here.

[0411] E. The driving information of the vehicle is the distance between the vehicle and the obstacle.

[0412] In an embodiment of the present application, when the characterization parameter of driving information is "the distance between the vehicle and the obstacle", the driving information of the vehicle does not meet the first driving condition, and the driving information of the vehicle meets the second driving condition if: the first driving condition includes that the distance between the vehicle and the obstacle is within a first distance range, and the second driving condition includes that the distance between the vehicle and the obstacle is within a second distance range; the distance between the vehicle and the obstacle is not within the first distance range, and the distance between the vehicle and the obstacle is within the second distance range.

[0413] For the specific process, please refer to method E in the above step 2602, which will not be repeated here.

[0414] 3004. The vehicle displays the projection information of the first application on the second display module according to the second instruction.

[0415] When the vehicle receives the second instruction, it displays the projection information of the first application on the second display module according to the second instruction.

[0416] Similarly, in the above-mentioned methods A to E, the description is based on the vehicle's driving information as a single parameter (such as "driving speed", "traffic scene type", "number of passengers in the vehicle", "driver fatigue status", "distance between the vehicle and obstacles", etc.). In some embodiments of the present application, the individual parameters can also be combined with each other to obtain a screen switching display method based on the combined parameters. The screen switching display process of the combined parameters is similar to the single parameters in the above-mentioned methods A to E, and the details will not be repeated here.

[0417] exist Figure 8 On the basis of the corresponding embodiments, in order to better implement the above scheme of the embodiments of the present application, the following also provides related devices for implementing the above scheme, for details, refer to Fig.31 , Fig.31 A structural schematic diagram of a device provided in an embodiment of the present application, the device can be a terminal device or a vehicle, which is not limited here. The device 3100 includes: an acquisition module 3101 and a projection module 3102, wherein the acquisition module 3101 is used to obtain a first projection condition for the first display module on the vehicle to be projected, the first projection condition can be related to the driving information of the target vehicle, or can be related to the characteristic information of the application to be projected, which is not limited here; the projection module 3102 is used to project the projection information of the first application to be projected on the terminal device to the first display module when the first projection condition is met, the first display module is one of the multiple display modules on the vehicle, and different display modules on the vehicle have different projection conditions. Specifically, when the first projection condition is set according to the driving information of the vehicle, when the first projection condition is met, it includes: when the driving information of the vehicle meets the first projection condition; when the first projection condition is set according to the characteristic information of the application to be projected, when the first projection condition is met, it includes: when the characteristic information of the first application to be projected on the terminal device meets the first projection condition.

[0418] In one possible design, the acquisition module 3101 is specifically used to: obtain multiple projection conditions for projecting multiple display modules on the vehicle, wherein one display module corresponds to one projection condition, and the projection condition is set according to the characteristic information of the application to be projected. For example, assuming that there are 3 different display modules on the target vehicle A, namely the instrument panel screen, the steering wheel screen and the central control screen, then there is a corresponding projection condition for each display module, and there are a total of 3 projection conditions, namely projection condition 1, projection condition 2, and projection condition 3; the projection module 3102 is used to project the projection information of the first application to be projected to the first display module when the application to be projected on the terminal device (which can be called the first application to be projected) meets the projection condition (which can be called the first projection condition) for a certain display module (which can be called the first display module) on the vehicle to be projected, and when a communication connection is established between the terminal device and the vehicle.

[0419] In the above-mentioned embodiment of the present application, the acquisition module 3101 obtains the projection conditions that need to be met when each display module on the vehicle is projected (for example, the application to be projected on the terminal device belongs to a certain application type, reaches a preset usage frequency, etc.). When the projection conditions are met, the projection module 3102 projects the display information of the application to be projected on the terminal device to the corresponding display module, thereby realizing the reasonable distribution of the display information on the terminal device to different display modules on the vehicle, so that the driver can quickly obtain the information on the terminal device, reducing the probability of the driver's attention being distracted, and reducing the interference of the projection information on the driver's driving, thereby improving driving safety.

[0420] In one possible design, the projection conditions can be set according to the vehicle's driving information. In this case, when the first projection condition for the first display module on the target vehicle to be projected is met, it includes: when the driving information of the target vehicle meets the first projection condition.

[0421] In a possible design, when the driving information of the vehicle is represented by different parameters, the conditions that need to be met for screen projection are also different. In one case, the driving information of the vehicle may include: the driving speed of the vehicle. At this time, the first screen projection condition includes that the driving speed of the target vehicle is within the first driving speed range.

[0422] In a possible design, the driving information of the vehicle may include: the type of traffic scene the vehicle is in. At this time, the first projection condition includes that the type of traffic scene the target vehicle is in belongs to the first traffic scene type.

[0423] In a possible design, the driving information of the vehicle may include: the number of passengers in the vehicle. At this time, the first projection condition includes that the number of passengers in the target vehicle is within a first passenger number range.

[0424] In a possible design, the driving information of the vehicle may include: the fatigue state of the driver of the vehicle. At this time, the first projection condition includes that the fatigue state of the driver of the target vehicle belongs to the first fatigue state.

[0425] In a possible design, the driving information of the vehicle may include: the distance between the vehicle and the obstacle. At this time, the first projection condition includes that the distance between the target vehicle and the obstacle is within a first distance range.

[0426] In a possible design of the first aspect, the projection condition can be set based on the characteristic information of the application program in addition to the vehicle's driving information. In this case, when the first projection condition for the first display module on the target vehicle to be projected is met, it includes: when the characteristic information of the first application program to be projected on the terminal device meets the first projection condition.

[0427] In one possible design, the characteristic information of an application may include the application type to which the application belongs, that is, the projection condition is that a specific application type corresponds to a specific display module. In this case, the first projection condition that the first display module on the vehicle is projected by the first application to be projected on the terminal device includes: the first projection condition includes that the application type of the application is a first application type (such as a social type), and the first application to be projected on the terminal device belongs to the first application type. It can also be said that the application type to which the first application to be projected on the terminal device belongs belongs to the application type required in the first projection condition.

[0428] In one possible design, the characteristic information of the application may include the frequency of use information of the application, that is, the projection condition is that a specific frequency range of use of the application on the terminal device corresponds to a specific display module, and the frequency of use of the application on the terminal device can be obtained from similar functions of the terminal device such as "Healthy Use of Mobile Phone". In this case, the first application to be projected on the terminal device satisfies the first projection condition for the first display module on the vehicle to be projected, which includes: the first projection condition includes that the frequency of use information of the application is within a first frequency range (e.g., a high frequency range), and at the same time, the frequency of use of the first application to be projected on the terminal device on the terminal device is within the first frequency range.

[0429] In one possible design, the characteristic information of an application may include both the application type to which the application belongs and the frequency of use of the application. In this case, the first application to be projected on the terminal device satisfies the first projection condition for the first display module on the vehicle to be projected, which includes: the application type to which the first application to be projected on the terminal device belongs belongs to the application type required in the first projection condition, and the frequency of use of the first application on the terminal device is within the range of usage frequencies required in the first projection condition.

[0430] In the above-mentioned implementation mode of the present application, each single factor (for example, the application type is a single factor, and the frequency range of application usage is a single factor) is combined with each other to obtain a division result based on the combined factors, so that the conditions required to be met for screen projection are more diverse, thereby improving the user experience.

[0431] In one possible design, the frequency range of application usage on the terminal device can be characterized by: 1) the duration of use of the application on the terminal device; 2) the number of times the application is started and run on the terminal device.

[0432] In the above-mentioned implementation manner of the present application, several representation methods of the frequency information used by the application on the terminal device are specifically described, which are selective and flexible.

[0433] In one possible design, an application can simultaneously satisfy the characteristic information of the application required in multiple projection conditions. For example, the application type "social" (such as "WeChat", "QQ", "short message", etc.) to which the application belongs can be the application type required in projection condition 1, or the application type required in projection condition 2. That is to say, when the first application to be projected on the terminal device simultaneously satisfies the first projection condition that the first display module on the vehicle is projected and the second projection condition that the second display module on the vehicle is projected, in this case, the projection module 3102 can be used to: project the projection information of the first application to the first display module and the second display module at the same time, and the first display module and the second display module are two different ones of the multiple display modules on the vehicle. It should be noted that in the embodiment of the present application, the premise that the terminal device simultaneously projects the projection information of the first application to be projected to the first display module and the second display module is that both the first display module and the second display module are not occupied by the projection.

[0434] In the above-mentioned implementation mode of the present application, it is specifically explained that when a certain application meets the screen projection conditions for multiple display modules, the screen projection module 3102 projects the application onto these multiple display modules, and the user can choose which display module to view the projection information, which has flexibility.

[0435] In one possible design, an application can simultaneously satisfy the characteristic information of the application required in multiple projection conditions. That is, when the first projection application on the terminal device satisfies the first projection condition that the first display module on the vehicle is projected and the second projection condition that the second display module on the vehicle is projected, in this case, the projection module 3102 can also be used to: divide the projection information of the first application into the first projection sub-information and the second projection sub-information according to a preset method, and the first display module and the second display module are two different ones of the multiple display modules on the vehicle, and then the terminal device projects the first projection sub-information and the second projection sub-information to the first display module and the second display module respectively.

[0436] In the above-mentioned embodiment of the present application, it is specifically explained that when an application meets the screen projection conditions for projecting multiple display modules, the screen projection module 3102 will split the screen projection information of the application into multiple screen projection sub-information. One screen projection sub-information is projected onto one display module, and the user can choose which display module to view the projection sub-information, which is flexible.

[0437] In one possible design, an application can simultaneously satisfy the characteristic information of the application required in multiple projection conditions. That is, when the first projection application on the terminal device satisfies the first projection condition that the first display module on the vehicle is projected and the second projection condition that the second display module on the vehicle is projected, in this case, the projection module 3102 can also be used to: determine whether the first display module with a high priority is occupied by projection according to a preset priority, wherein the first display module and the second display module are two different ones of the multiple display modules on the vehicle; if the first display module is not occupied by projection, the terminal device will prioritize the projection information of the first application to the first display module, and only when the first display module is occupied by projection, the terminal device will project the projection information of the first application to the second display module.

[0438] In the above-mentioned embodiment of the present application, it is specifically explained that when an application meets the screen projection conditions for multiple display modules to be projected, the screen projection module 3102 can further perform selective screen projection based on priority, and preferentially project the screen projection information to the display module with high priority. Only when the display module with high priority is occupied by the screen projection, the screen will be projected to the display module with the next priority. The method of projecting the screen according to priority ensures that the user can view the projection information in real time and in the most appropriate way, thereby minimizing the impact of the user's attention being distracted.

[0439] It should be noted that Fig.31 The information interaction, execution process, etc. between the modules / units in the device 3100 provided are the same as those in the present application. Figure 8The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.

[0440] The present application also provides a device, which may be a vehicle. Fig.32 , Fig.32 A structural schematic diagram of a device provided in an embodiment of the present application, the device 3200 includes: an acquisition module 3201 and a screen switching module 3202, wherein the acquisition module 3201 is used to obtain driving information of a vehicle; the screen switching module 3202 switches the projection information of a first application displayed on a first display module to a second display module for display when the driving information of the vehicle does not meet a first projection condition, wherein the first projection condition is a condition that must be met when the first display module is projected, and the first display module and the second display module are two different display modules among a plurality of display modules on the vehicle.

[0441] In the above-mentioned embodiment of the present application, after the projection information on the terminal device has been projected to the first display module on the vehicle side, the vehicle can further determine whether the first projection condition corresponding to the first display module is consistent with the vehicle's own driving conditions in combination with the vehicle's own driving information. If not, it is necessary to switch the projection information to other display modules on the vehicle (such as the second display module) for display, which has flexibility and improves the user experience.

[0442] In one possible design, the screen switching module 3202 is specifically used to: when the vehicle's driving information does not meet the first driving condition, and the vehicle's driving information meets the second driving condition, instruct to switch the projection information of the first application displayed on the first display module to the second display module for display, and the second driving condition is the condition that must be met when the second display module is projected.

[0443] In the above-mentioned embodiment of the present application, after the projection information on the terminal device has been projected to the first display module on the vehicle side, the vehicle can further determine whether it is necessary to switch the screen display in different driving scenes in combination with the vehicle's own driving information. Only when the first projection condition corresponding to the first display module does not meet the current driving conditions of the vehicle and other display modules (such as the second display module) meet the current driving conditions of the vehicle, the screen switching module 3202 instructs to switch the projection information of the first application displayed on the first display module to the second display module for display. In other words, dynamic switching between different display modules can be performed in combination with the vehicle's own driving status, so that under any driving conditions, the user can view the projection information in the best way, thereby improving the user experience.

[0444] In one possible design, the vehicle's driving information may include: the driving speed of the vehicle. In this case, the vehicle's driving information does not meet the first projection condition, and the vehicle's driving information meets the second projection condition, including: the first projection condition includes that the driving speed is within a first driving speed range, and the second projection condition includes that the driving speed is within a second driving speed range; the driving speed of the vehicle is not within the first driving speed range, and the driving speed of the vehicle is within the second driving speed range.

[0445] In the above-mentioned implementation mode of the present application, the screen projection information of the application running on the terminal device is projected onto different display modules based on different driving speeds, thereby improving driving safety.

[0446] In one possible design, the driving information of the vehicle may include: the type of traffic scene the vehicle is in. In this case, the driving information of the vehicle does not meet the first projection condition, and the driving information of the vehicle meets the second projection condition, which includes: the first projection condition includes that the traffic scene type belongs to the first traffic scene type, and the second projection condition includes that the traffic scene type belongs to the second traffic scene type; the traffic scene type where the vehicle is located does not belong to the first traffic scene type, and the traffic scene type where the vehicle is located belongs to the second traffic scene type.

[0447] In the above-mentioned implementation of the present application, the screen projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different traffic scene types in which the vehicle is located, thereby improving driving safety.

[0448] In a possible design, the driving information of the vehicle may include: the number of passengers in the vehicle. In this case, the driving information of the vehicle does not meet the first projection condition, and the driving information of the vehicle meets the second projection condition, which includes: the first projection condition includes that the number of passengers is within the first passenger number range, and the second projection condition includes that the number of passengers is within the second passenger number range; the number of passengers in the vehicle is not within the first passenger number range, and the number of passengers in the vehicle is within the second passenger number range.

[0449] In the above-mentioned implementation mode of the present application, based on considerations of application privacy and sharing, the number of passengers in the vehicle is different, and the screen projection information of the application running on the terminal device can be selected to be projected onto different display modules, thereby improving the user experience.

[0450] In a possible design, the vehicle's driving information may include: the fatigue state of the vehicle driver. In this case, the vehicle's driving information does not meet the first projection condition, and the vehicle's driving information meets the second projection condition, including: the first projection condition includes that the driver's fatigue state belongs to the first fatigue state, and the second projection condition includes that the driver's fatigue state belongs to the second fatigue state; the fatigue state of the vehicle driver does not belong to the first fatigue state, and the fatigue state of the vehicle driver belongs to the second fatigue state.

[0451] In the above-mentioned embodiments of the present application, the screen projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different fatigue states of the driver, thereby improving driving safety.

[0452] In a possible design, the vehicle's driving information may include: the distance between the vehicle and the obstacle. In this case, the vehicle's driving information does not meet the first projection condition, and the vehicle's driving information meets the second projection condition, which includes: the first projection condition includes that the distance between the vehicle and the obstacle is within a first distance range, and the second projection condition includes that the distance between the vehicle and the obstacle is within a second distance range; the distance between the vehicle and the obstacle is not within the first distance range, and the distance between the vehicle and the obstacle is within the second distance range.

[0453] In the above-mentioned embodiment of the present application, the screen projection information of the application running on the terminal device is selected to be projected to different display modules based on the different distances between the vehicle and the obstacle, thereby reducing the probability of collision between the vehicle and the obstacle and improving driving safety.

[0454] In one possible design, the screen switching module 3202 can be used to: first generate a switching instruction (which may be called a first switching instruction), wherein the first switching instruction is used to instruct the vehicle to switch the projection information to a second display module, and then, according to the first switching instruction, switch the projection information to a second display module corresponding to a second projection condition that meets the vehicle's driving information for display.

[0455] In the above-mentioned implementation mode of the present application, how the screen switching module 3202 performs screen switching display is specifically described, which is feasible.

[0456] It should be noted that Fig.32 The information interaction, execution process, etc. between the modules / units in the device 3200 provided are the same as those in the present application. Fig.26 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.

[0457] The present application also provides a device, which may be a terminal device. Fig.33 , Fig.33 A structural schematic diagram of a terminal device provided in an embodiment of the present application, the device 3300 includes: a first sending module 3301, an acquisition module 3302, and a second sending module 3303, wherein the first sending module 3301 is used to send a first instruction to a vehicle, the first instruction is used to instruct to display the projection information of a first application on the first display module of the vehicle; the acquisition module 3302 is used to obtain the driving information of the vehicle; the second sending module 3303 is used to send a second instruction to the vehicle when the driving information of the vehicle does not meet the first projection condition and the driving information of the vehicle meets the second projection condition, the second instruction is used to instruct to display the information of the first application on the second display module of the vehicle, wherein the first projection condition is a condition that needs to be met when the first display module is projected, the second projection condition is a condition that needs to be met when the second display module is projected, and the first display module and the second display module are two different display modules among the multiple display modules on the vehicle.

[0458] In the above-mentioned embodiment of the present application, after the projection information on the terminal device has been projected to the display module on the vehicle side, the terminal device can also determine whether it is necessary to switch the screen display in different driving scenes in combination with the vehicle's own driving information. In other words, the terminal device can dynamically switch between different display modules in combination with the vehicle's own driving status, so that under any driving information, the user can view the projection information in the best way, thereby improving the user experience.

[0459] In one possible design, the vehicle's driving information may include: the driving speed of the vehicle. In this case, the vehicle's driving information does not meet the first projection condition, and the vehicle's driving information meets the second projection condition, including: the first projection condition includes that the driving speed is within a first driving speed range, and the second projection condition includes that the driving speed is within a second driving speed range; the driving speed of the vehicle is not within the first driving speed range, and the driving speed of the vehicle is within the second driving speed range.

[0460] In the above-mentioned implementation mode of the present application, the screen projection information of the application running on the terminal device is projected onto different display modules based on different driving speeds, thereby improving driving safety.

[0461] In one possible design, the driving information of the vehicle may include: the type of traffic scene the vehicle is in. In this case, the driving information of the vehicle does not meet the first projection condition, and the driving information of the vehicle meets the second projection condition, which includes: the first projection condition includes that the traffic scene type belongs to the first traffic scene type, and the second projection condition includes that the traffic scene type belongs to the second traffic scene type; the traffic scene type where the vehicle is located does not belong to the first traffic scene type, and the traffic scene type where the vehicle is located belongs to the second traffic scene type.

[0462] In the above-mentioned implementation of the present application, the screen projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different traffic scene types in which the vehicle is located, thereby improving driving safety.

[0463] In a possible design, the driving information of the vehicle may include: the number of passengers in the vehicle. In this case, the driving information of the vehicle does not meet the first projection condition, and the driving information of the vehicle meets the second projection condition, which includes: the first projection condition includes that the number of passengers is within the first passenger number range, and the second projection condition includes that the number of passengers is within the second passenger number range; the number of passengers in the vehicle is not within the first passenger number range, and the number of passengers in the vehicle is within the second passenger number range.

[0464] In the above-mentioned implementation mode of the present application, based on considerations of application privacy and sharing, the number of passengers in the vehicle is different, and the screen projection information of the application running on the terminal device can be selected to be projected onto different display modules, thereby improving the user experience.

[0465] In a possible design, the vehicle's driving information may include: the fatigue state of the vehicle driver. In this case, the vehicle's driving information does not meet the first projection condition, and the vehicle's driving information meets the second projection condition, including: the first projection condition includes that the driver's fatigue state belongs to the first fatigue state, and the second projection condition includes that the driver's fatigue state belongs to the second fatigue state; the fatigue state of the vehicle driver does not belong to the first fatigue state, and the fatigue state of the vehicle driver belongs to the second fatigue state.

[0466] In the above-mentioned embodiments of the present application, the screen projection information of the application running on the terminal device is selected to be projected onto different display modules based on the different fatigue states of the driver, thereby improving driving safety.

[0467] In a possible design, the vehicle's driving information may include: the distance between the vehicle and the obstacle. In this case, the vehicle's driving information does not meet the first projection condition, and the vehicle's driving information meets the second projection condition, which includes: the first projection condition includes that the distance between the vehicle and the obstacle is within a first distance range, and the second projection condition includes that the distance between the vehicle and the obstacle is within a second distance range; the distance between the vehicle and the obstacle is not within the first distance range, and the distance between the vehicle and the obstacle is within the second distance range.

[0468] In the above-mentioned embodiment of the present application, the screen projection information of the application running on the terminal device is selected to be projected to different display modules based on the different distances between the vehicle and the obstacle, thereby reducing the probability of collision between the vehicle and the obstacle and improving driving safety.

[0469] It should be noted that Fig.33 The information interaction, execution process, etc. between the modules / units in the device 3300 provided are the same as those in the present application. Fig.30 The corresponding method embodiments are based on the same concept. For specific contents, please refer to the description in the method embodiments shown above in this application, which will not be repeated here.

[0470] It should also be noted that the above embodiments of the present application Figure 8 , Fig.30 The corresponding embodiments can be based on the above Figures 2 to 6 The corresponding terminal device executes, and the structure of the terminal device can be specifically referred to as shown in the previous part of this application. Figures 2 to 6 The description of the corresponding terminal device will not be repeated here.

[0471] The present application also provides a vehicle, see Fig.34 , Fig.34 This is a schematic diagram of the structure of a vehicle provided in an embodiment of the present application. For the sake of convenience, only the parts related to the embodiment of the present application are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present application. Fig.32 The corresponding modules in the vehicle 3200 described in the corresponding embodiment are used to implement Fig.32The functions of the vehicle in the corresponding embodiment, specifically, the vehicle 3400 is implemented by one or more servers, and the vehicle 3400 may have relatively large differences due to different configurations or performances, and may include one or more processors 3422, memories 3432, and one or more storage media 3430 (e.g., one or more mass storage devices) storing application programs 3442 or data 3444. Specifically, the processor 3422 may be a central processing unit (CPU), an embedded microcontroller, an AI processor, etc., and the type of the processor 3422 is not limited here, wherein the memory 3432 and the storage medium 3430 may be short-term storage or persistent storage. The program stored in the storage medium 3430 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations in the training device. Furthermore, the processor 3422 can be configured to communicate with the storage medium 3430 and execute a series of instruction operations in the storage medium 3430 on the vehicle 3400. For example, the processor 3422 can call a series of instruction operations in the storage medium 3430 to perform the following steps: compile the source code to obtain a control flow graph corresponding to the source code, then split the obtained control flow graph to obtain multiple sub-graphs after segmentation, and recompile the obtained multiple sub-graphs to obtain multiple linear execution sequences, and then simulate the execution of the multiple linear execution sequences in sequence, and insert at least one operator between the multiple linear execution sequences according to the semantics corresponding to the multiple linear execution sequences to connect the multiple linear execution sequences into a computational graph.

[0472] The vehicle 3400 may also include one or more power supplies 3426, one or more wired or wireless network interfaces 3450, one or more input and output interfaces 3458, and / or, one or more operating systems 3441, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0473] In the embodiment of the present application, the steps performed by the deep learning framework in the aforementioned various control flow graph processing methods can be based on the Fig.34 The structure shown in the vehicle is executed on the processor by calling the relevant code stored on the storage medium, and the details are not repeated here.

[0474] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0475] Through the description of the above implementation mode, the technicians in the relevant field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0476] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0477] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

Claims

1. A screen projection method, characterized in that: include: Obtain a first projection condition for projecting a first display module on a target vehicle, wherein the obtaining of the first projection condition for projecting a first display module on a target vehicle comprises: obtaining multiple projection conditions for projecting multiple display modules on the target vehicle, one display module corresponds to one projection condition, the first projection condition is one of the multiple projection conditions, the first projection condition is related to the driving information of the target vehicle, or the first projection condition is related to characteristic information of an application to be projected, wherein the characteristic information of the application to be projected comprises: an application type of the application to be projected, or frequency information of use of the application to be projected; the application to be projected is an application to be projected on a terminal device that establishes a communication connection with the target vehicle; When the first screen projection condition is met, the projection information of the first application to be projected on the terminal device is projected to the first display module. The first display module is one of multiple display modules on the target vehicle. Different display modules on the target vehicle have different screen projection conditions.

2. The method according to claim 1, characterized in that The driving information of the target vehicle includes: the driving speed of the target vehicle; The first screen projection condition includes that the driving speed of the target vehicle is within a first driving speed range.

3. The method according to claim 1, characterized in that The driving information of the target vehicle includes: The type of traffic scene in which the target vehicle is located; The first screen projection condition includes that the traffic scene type in which the target vehicle is located belongs to the first traffic scene type.

4. The method according to claim 1, characterized in that: The driving information of the target vehicle includes: the number of passengers in the target vehicle; The first screen projection condition includes that the number of passengers in the target vehicle is within a first passenger number range.

5. The method according to claim 1, characterized in that The driving information of the target vehicle includes: a fatigue state of the driver of the target vehicle; The first screen projection condition includes that the fatigue state of the driver of the target vehicle belongs to the first fatigue state, and the fatigue state of the driver of the target vehicle is obtained by a sensor module.

6. The method according to claim 1, characterized in that The driving information of the target vehicle includes: the distance between the target vehicle and the obstacle; The first screen projection condition includes that the distance between the target vehicle and the obstacle is within a first distance range.

7. The method according to claim 1, characterized in that The characteristic information of the application to be projected includes: The application type of the application to be projected; The first screen projection condition includes that the application type of the application to be projected is a first application type; When the first screen projection condition is met, the following steps are performed: When the application type of the first application to be projected is the first application type.

8. The method according to claim 1, characterized in that The characteristic information of the application to be projected includes: Frequency of use information of the application to be projected; The first screen projection condition includes that the usage frequency information of the application to be projected is within a first usage frequency range; When the first screen projection condition is met, the following steps are performed: When the usage frequency information of the first screen projection application on the terminal device is within the first usage frequency range.

9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: When the first screen projection condition and the second screen projection condition are met at the same time, the projection information of the first application to be projected is projected to the first display module and the second display module at the same time, the second screen projection condition is the projection condition corresponding to the second display module, and the first display module and the second display module are two different ones of the multiple display modules.

10. The method according to any one of claims 1 to 8, characterized in that The method further comprises: When the first screen projection condition and the second screen projection condition are simultaneously met, dividing the screen projection information of the first application to be projected into first screen projection sub-information and second screen projection sub-information, the second screen projection condition is a screen projection condition corresponding to a second display module, and the first display module and the second display module are two different ones of the multiple display modules; The first projection sub-information and the second projection sub-information are projected onto the first display module and the second display module respectively.

11. The method according to any one of claims 1 to 8, characterized in that The method further comprises: When the first screen projection condition and the second screen projection condition are met at the same time, the projection information of the first application to be projected is projected only to the first display module, the second screen projection condition is the projection condition corresponding to the second display module, the first display module and the second display module are two different ones of the multiple display modules, and the first display module is a display module with a higher projection priority than the second display module.

12. A device, characterized in that: include: An acquisition module, used for acquiring a first projection condition for projecting a first display module on a target vehicle, wherein the first projection condition is related to driving information of the target vehicle, or the first projection condition is related to feature information of an application to be projected; The application to be projected is an application to be projected on a terminal device that establishes a communication connection with the target vehicle; The acquisition module is specifically used to: acquire multiple screen projection conditions for multiple display modules on the target vehicle to be projected, wherein one display module corresponds to one screen projection condition, and the first screen projection condition is one of the multiple screen projection conditions; The screen projection module is used to project the screen information of the first application to be projected on the terminal device to the first display module when the first screen projection condition is met. The first display module is one of multiple display modules on the target vehicle, and different display modules on the target vehicle have different screen projection conditions.

13. The device according to claim 12, characterized in that The screen projection module is also used for: When the first screen projection condition and the second screen projection condition are met at the same time, the projection information of the first application to be projected is projected to the first display module and the second display module at the same time, the second screen projection condition is the projection condition corresponding to the second display module, and the first display module and the second display module are two different ones of the multiple display modules.

14. The device according to claim 12, characterized in that The screen projection module is also used for: When the first screen projection condition and the second screen projection condition are simultaneously met, dividing the screen projection information of the first application to be projected into first screen projection sub-information and second screen projection sub-information, the second screen projection condition is a screen projection condition corresponding to a second display module, and the first display module and the second display module are two different ones of the multiple display modules; The first projection sub-information and the second projection sub-information are projected onto the first display module and the second display module respectively.

15. The device according to claim 12, characterized in that The screen projection module is also used for: When the first screen projection condition and the second screen projection condition are met at the same time, the projection information of the first application to be projected is projected only to the first display module, the second screen projection condition is the projection condition corresponding to the second display module, the first display module and the second display module are two different ones of the multiple display modules, and the first display module is a display module with a higher projection priority than the second display module.

16. A device comprising a processor and a memory, wherein the processor is coupled to the memory, characterized in that: The memory is used to store programs; The processor is used to execute the program in the memory so that the device performs the method according to any one of claims 1 to 11.

17. A computer-readable storage medium comprising a program, characterized in that: When the method is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 11.

18. A computer program product comprising instructions, characterized in that When the method is executed on a computer, the computer is enabled to execute the method according to any one of claims 1 to 11.

Citation Information

Patent Citations

  • Information sharing method and vehicle-mounted terminal

    CN112214186A