Content display method and system, vehicle and electronic equipment

By detecting whether the driver's line of sight is blocked and controlling the second display screen to display the contents of the first display screen, the problem that the driver cannot view when the electronic rearview mirror display screen is blocked is solved, and driving safety is improved.

CN119690369APending Publication Date: 2025-03-25BEIJING BOE TECH DEV CO LTD +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202311247687.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-25
Publication Date
2025-03-25

AI Technical Summary

Technical Problem

During driving, the driver's line of sight may be blocked and the electronic rearview mirror cannot be viewed, affecting driving safety.

Method used

By detecting whether the driver's line of sight of the first display screen is blocked, the second display screen associated with the first display screen is determined, and the second display screen is controlled to display the contents of the first display screen. Optionally, the second display screen can also be adjusted angle and display parameter.

Benefits of technology

Ensure that the driver can still view the contents of the rearview mirror without barriers while the line of vision is blocked, improving driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119690369A_ABST
    Figure CN119690369A_ABST
Patent Text Reader

Abstract

The invention provides a content display method and system, a vehicle and electronic equipment, and relates to the technical field of image display. In order to prevent the sight of a driver watching an electronic rearview mirror from being interfered and improve the driving safety, the content display method comprises the steps that whether the sight of the driver watching a first display screen is blocked or not is detected, and the first display screen is located on the right side of the driver; when it is detected that the sight of a driver watching the first display screen is blocked, determining a second display screen associated with the first display screen; and controlling the second display screen to display the content of the first display screen. Through the content display method, a driver can watch the content of the first display screen through the second display screen under the condition that the sight of watching the first display screen is blocked, so that the sight of watching the content of the first display screen by the driver in the driving process is not interfered any more, the content of the first display screen can be watched without blocking, and the driving experience is improved. And the driving safety is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of image display technology, and in particular, to a content display method, system, vehicle and electronic device. Background Art

[0002] As cars continue to develop towards electronic and intelligent directions, in-vehicle displays have also undergone great changes, such as Figure 1 As shown in the figure, the development stage of smart cockpit has evolved from the initial dual-screen display and triple-screen display to the current multi-screen display. Currently, multi-screen in-vehicle displays may include instrument display, main control display, entertainment display, electronic rearview mirror display, etc. Among them, the electronic rearview mirror (Camera Monitor System, CMS) is a product that has recently appeared. Compared with traditional physical mirrors, electronic rearview mirrors have the advantages of wider field of view, reduced blind spots, automatic light compensation, less environmental impact, etc., and can effectively reduce wind resistance and wind noise, achieving energy conservation and emission reduction. At present, electronic rearview mirrors can already be "installed in the car".

[0003] The electronic rearview mirror consists of two parts: a camera and a display screen. The rearview mirror display screen is located on the left side of the driver and on the right side of the front passenger. Figure 2 As shown, the driver can see the real-time images of the left / right side of the vehicle through the left / right rearview mirror display screen (i.e., the left / right rearview screen); however, in some cases, the driver's line of sight may be blocked and the rearview mirror display screen may not be visible, thereby affecting driving safety.

[0004] Therefore, a new content display method is urgently needed to avoid interference with the driver's vision of the electronic rearview mirror and improve driving safety. Summary of the invention

[0005] The embodiments of the present application provide a content display method, system, vehicle and electronic device to at least partially solve the problems existing in the related art.

[0006] A first aspect of an embodiment of the present application provides a content display method, the method comprising:

[0007] Detecting whether a driver's line of sight of a first display screen is blocked, where the first display screen is located on the right side of the driver;

[0008] When it is detected that the driver's line of sight of the first display screen is blocked, determining a second display screen associated with the first display screen;

[0009] Control the second display screen to display the content of the first display screen.

[0010] Optionally, the method further includes:

[0011] Control the second display screen to adjust its angle.

[0012] Optionally, controlling the second display screen to adjust its angle includes at least one of the following:

[0013] Controlling the second display screen to deflect to the left at a preset angle;

[0014] The sum of the angle of the second display screen and the angle of the first display screen is controlled to be 180 degrees.

[0015] Optionally, the method further includes:

[0016] The display parameter value of the second display screen is adjusted according to the display parameter value of the first display screen.

[0017] Optionally, adjusting the display parameter value of the second display screen according to the display parameter value of the first display screen includes at least one or more of the following:

[0018] Controlling the brightness value of the second display screen according to the brightness value of the first display screen;

[0019] controlling the aspect ratio of the second display screen according to the aspect ratio of the first display screen;

[0020] The refresh rate of the second display screen is controlled according to the refresh rate of the first display screen.

[0021] Optionally, the method further includes:

[0022] In the case where it is detected that the driver's line of sight for viewing the first display screen is blocked, determining the degree of the blocked line of sight, wherein the degree of the blocked line of sight is used to characterize the situation where the visual field range of the line of sight is blocked;

[0023] When it is detected that the driver's line of sight of the first display screen is blocked, determining a second display screen associated with the first display screen comprises:

[0024] In the case where the occlusion degree exceeds a first occlusion degree threshold, determining the second display screen as: a third display screen;

[0025] When the occlusion degree exceeds a second occlusion degree threshold, the second display screen is determined to be: a fourth display screen, the second occlusion degree threshold is greater than the first occlusion degree threshold, and the fourth display screen is a display screen closer to the driver than the third display screen.

[0026] Optionally, the method further includes:

[0027] In the case where it is detected that the driver's line of sight for viewing the first display screen is blocked, determining the degree of the blocked line of sight, wherein the degree of the blocked line of sight is used to characterize the situation where the visual field range of the line of sight is blocked;

[0028] Controlling the second display screen to display the content of the first display screen includes:

[0029] When the occlusion degree exceeds a third occlusion degree threshold, controlling the first display area of ​​the second display screen to display the content of the first display screen;

[0030] When the degree of occlusion exceeds the fourth degree of occlusion threshold, the second display area of ​​the second display screen is controlled to display the content of the first display screen, the third degree of occlusion threshold is greater than the fourth degree of occlusion threshold, and the first display area is a display area closer to the driver than the second display area.

[0031] Optionally, when it is detected that the driver's line of sight of the first display screen is blocked, the method further includes:

[0032] Determine the obstruction time of the target sight line, and / or determine the number of obstruction times of the target sight line;

[0033] When the shielding time exceeds a time threshold, and / or the shielding times exceeds a times threshold, determining that the content of the first display screen needs to be displayed on the second display screen;

[0034] Determining a second display screen associated with the first display screen includes:

[0035] In case it is determined that the content of the first display screen needs to be displayed through the second display screen, the step of determining a second display screen associated with the first display screen is performed.

[0036] Optionally, detecting whether the driver's line of sight of the first display screen is blocked includes:

[0037] Acquire a first driver image captured for the driver;

[0038] detecting, according to the first driver image, whether a target part of the driver is blocked;

[0039] When the target part is blocked, it is determined that the line of sight is blocked.

[0040] Optionally, detecting whether the driver's line of sight of the first display screen is blocked includes:

[0041] Acquire a first head image of the driver, and acquire a second head image of the co-pilot;

[0042] determining an overlapping area of ​​the first head image and the second head image;

[0043] When the overlapping area is greater than an area threshold, it is determined that the line of sight is blocked.

[0044] Optionally, detecting whether the driver's line of sight of the first display screen is blocked includes:

[0045] Determine the distance between the co-pilot and the co-pilot screen;

[0046] When the distance is less than a distance threshold, it is determined that the line of sight is blocked.

[0047] Optionally, detecting whether the driver's line of sight of the first display screen is blocked includes:

[0048] Determine whether the co-pilot is operating the co-pilot screen;

[0049] When the co-pilot is operating the co-pilot screen, it is determined that the sight line is blocked.

[0050] Optionally, detecting whether the driver's line of sight of the first display screen is blocked includes:

[0051] Get the positions of the driver's seat and the co-pilot's seat respectively;

[0052] Determining the angle between the line between the driver's seat and the co-driver's seat and the horizontal direction of the vehicle body;

[0053] When the included angle is greater than an angle threshold, it is determined that the line of sight is blocked.

[0054] Optionally, the method further includes:

[0055] Detect whether the target event occurs;

[0056] When the target event is detected, the following steps are executed: detecting whether the driver's line of sight of the first display screen is blocked; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.

[0057] Optionally, the method further includes:

[0058] When a target event is detected, the second display screen is controlled to display the content of the first display screen; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.

[0059] A second aspect of an embodiment of the present application provides a content display system, the system comprising at least: a first display screen, a second display screen, a controller, and a vehicle body exterior camera;

[0060] The vehicle body exterior camera is used to capture images of the vehicle body exterior;

[0061] The controller is used to:

[0062] Detect whether the driver's line of sight to the first display screen is blocked, the first display screen is located on the right side of the driver; when it is detected that the driver's line of sight to the first display screen is blocked, determine the second display screen associated with the first display screen; control the second display screen to display the content of the first display screen; the content of the first display screen is the image content captured by the camera on the outside of the vehicle body.

[0063] Optionally, a first camera is integrated under the first display screen;

[0064] The first camera is used to capture the image of the first driver;

[0065] The controller is used to obtain the first driver image, detect whether a target part of the driver is blocked based on the first driver image, and determine that the line of sight is blocked when the target part is blocked.

[0066] Optionally, a first camera is integrated under the first display screen;

[0067] The first camera is used to capture a first head image of the driver and a second head image of the co-driver;

[0068] The controller is used to obtain the first head image and the second head image, determine an overlapping area between the first head image and the second head image, and determine that the line of sight is blocked when the overlapping area is greater than an area threshold.

[0069] Optionally, the first camera is located on the right side under the first display screen.

[0070] Optionally, a second camera is integrated under the second display screen;

[0071] The second camera is used to capture the image of the second driver;

[0072] The controller is used to detect whether the driver status meets a second preset condition based on the second driver image.

[0073] Optionally, the second display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.

[0074] Optionally, the first display screen is a rearview mirror display screen.

[0075] A third aspect of an embodiment of the present application provides a content display method, the method comprising:

[0076] Detect whether the driver's current line of sight is looking outside the vehicle;

[0077] When it is detected that the current sight line of the driver is to look outside the vehicle, determining the in-vehicle display screen;

[0078] Control the in-vehicle display screen to display information outside the vehicle.

[0079] Optionally, the method further includes:

[0080] When it is detected that the driver's current line of sight is to look outside the vehicle, determining a display mode of the display screen inside the vehicle;

[0081] Controlling the in-vehicle display screen to display information outside the vehicle, including:

[0082] Control the in-vehicle display screen to display the outside-vehicle information according to the display mode; wherein the display mode includes: a first display mode or a second display mode; the first display mode is: a display mode in which the information displayed on the in-vehicle display screen is hidden and the outside-vehicle information is displayed; the second display mode is: a display mode in which the outside-vehicle information and part of the information displayed on the in-vehicle display screen are displayed.

[0083] Optionally, the method further includes:

[0084] When it is detected that the driver's current line of sight is not the line of sight to view outside the vehicle, the in-vehicle display screen is controlled to no longer display the outside-vehicle information.

[0085] A fourth aspect of the embodiments of the present application provides a content display system, the system comprising at least: an in-vehicle display screen, a controller, and a camera outside the vehicle body;

[0086] The vehicle body exterior camera is used to capture images of the vehicle body exterior;

[0087] The controller is used to:

[0088] Detect whether the driver's current line of sight is looking outside the vehicle;

[0089] When it is detected that the driver's current line of sight is to look outside the vehicle, the in-vehicle display screen is determined; the in-vehicle display screen is controlled to display information outside the vehicle; the information outside the vehicle is image information collected by the camera outside the vehicle body.

[0090] Optionally, a third camera is integrated under the in-vehicle display screen;

[0091] The third camera is used to collect the image of the third driver;

[0092] The controller is used to obtain the third driver image and detect, based on the third driver image, whether the driver's current line of sight is a line of sight looking outside the vehicle.

[0093] Optionally, the in-vehicle display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.

[0094] A fifth aspect of an embodiment of the present application provides a vehicle, comprising a controller, wherein the controller is used to execute the steps in the content display method as described in the first aspect of the present application or to execute the steps in the content display method as described in the third aspect of the present application.

[0095] A sixth aspect of an embodiment of the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps in the content display method described in the first aspect of the present application or the steps in the content display method described in the third aspect of the present application are implemented.

[0096] In an embodiment of the present application, it is possible to detect whether the driver's line of sight to the first display screen is blocked. When it is detected that the driver's line of sight to the first display screen is blocked, a second display screen associated with the first display screen can be determined and the second display screen can be controlled to display the content of the first display screen. In this way, when the driver's line of sight to the right target screen is blocked, the driver can view the content of the right target screen through other display screens, thereby ensuring that the driver's line of sight to the target content is no longer disturbed during driving, and the driver can view the target content without obstruction, thereby improving driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0097] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0098] Figure 1 is a schematic diagram of a smart cockpit display module provided in an embodiment of the present application;

[0099] Figure 2 is a schematic diagram of a driver viewing a display screen under normal circumstances provided by an embodiment of the present application;

[0100] Figure 3 is a schematic diagram of a driver viewing a display screen when his / her vision is blocked, provided in an embodiment of the present application;

[0101] Figure 4 is another schematic diagram of a driver viewing a display screen when his / her vision is blocked, provided in an embodiment of the present application;

[0102] Figure 5 is a flow chart of a content display method according to an embodiment of the present application;

[0103] Figure 6 This is a schematic diagram of adjusting a display screen provided by an embodiment of the present application;

[0104] Figure 7 is a schematic diagram of adjusting a display screen provided by another embodiment of the present application;

[0105] Figure 8 is a schematic diagram of a target content display method provided by an embodiment of the present application;

[0106] Fig. 9 is a schematic diagram of a target content display method provided by another embodiment of the present application;

[0107] Fig.10 This is a schematic diagram of judging target sight obstruction provided by an embodiment of the present application;

[0108] Fig.11 This is a schematic diagram of judging target sight obstruction provided by an embodiment of the present application;

[0109] Fig.12 This is a schematic diagram of judging target sight obstruction provided by an embodiment of the present application;

[0110] Fig.13 It is a flow chart of a method for displaying control target content based on main driver perception according to an embodiment of the present application;

[0111] Fig.14 is a schematic diagram of a line of sight obstruction judgment in an embodiment of the present application;

[0112] Fig.15 is a schematic diagram of controlling the display of target content in an embodiment of the present application;

[0113] Fig.16 is a schematic diagram of controlling the display of target content in an embodiment of the present application;

[0114] Fig.17 It is a flowchart of a method for displaying control target content based on co-pilot perception according to an embodiment of the present application;

[0115] Fig.18It is a flowchart of a method for controlling target content display based on event sensing according to an embodiment of the present application;

[0116] Fig.19 It is a flowchart of a method for controlling target content display based on occlusion detection and judgment after event triggering according to an embodiment of the present application;

[0117] Fig. 20 It is a flowchart of a method for controlling target content to be displayed on a co-pilot screen according to an embodiment of the present application;

[0118] Fig.21 is a schematic diagram of controlling the display of target content in an embodiment of the present application;

[0119] Fig. 22 is a schematic diagram of controlling the display of target content in an embodiment of the present application;

[0120] Fig.23 A schematic diagram of a system architecture of an embodiment of the present application;

[0121] Fig.24 is a schematic diagram of a content display system provided by an embodiment of the present application;

[0122] Fig.25 is a flow chart of a content display method according to an embodiment of the present application;

[0123] Fig.26 is a schematic diagram of a content display method provided by an embodiment of the present application;

[0124] Fig. 27 is a schematic diagram of a content display method provided by an embodiment of the present application;

[0125] Fig.28 It is a schematic diagram of a content display system provided in one embodiment of the present application. DETAILED DESCRIPTION

[0126] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0127] As mentioned above, there may be many situations in which the driver's line of sight is blocked and he cannot see the rearview mirror display screen. For example, the driver's line of sight of the right rear view screen is blocked by the front passenger during driving: In one case, Figure 3 As shown in FIG. 1 , the front passenger's body leans forward, causing the driver's view of the right rear view screen to be blocked; in another case, such as Figure 4 As shown, the front passenger carries a large item, which blocks the driver's view of the right rear view screen, thus affecting driving safety.

[0128] Therefore, in order to at least partially solve the above-mentioned problems and one or more of other potential problems, an embodiment of the present application proposes a display method for detecting whether the driver's line of sight to a first display screen is blocked. When it is detected that the driver's line of sight to the first display screen (for example, the rearview screen of an electronic rearview mirror, etc.) is blocked, a second display screen corresponding to the first display screen can be determined, thereby controlling the second display screen to display the content of the first display screen. In this way, when the driver's line of sight to the first display screen is blocked, the driver can view the content of the first display screen through other display screens other than the first display screen, namely the second display screen, thereby ensuring that the driver's line of sight to the target content (for example, the content displayed on the electronic rearview mirror, etc.) during driving is no longer disturbed, and the driver can view the target content without obstruction, thereby improving driving safety.

[0129] Reference Figure 5 , shows a flow chart of a content display method according to an embodiment of the present application. The content display method provided by the embodiment of the present application can be applied to a controller, and the controller can perform relevant control on a vehicle-mounted terminal and various components in the vehicle. The content display method may include the following steps:

[0130] S101, detecting whether a driver's line of sight of a first display screen is blocked, where the first display screen is located on the right side of the driver.

[0131] During the driving of the vehicle, the driver can view the content displayed on the first display screen, wherein the first display screen is the in-vehicle display screen located on the right side of the driver and currently being viewed by the driver. The first display screen can be any display screen for the driver to view driving-related information, for example, it can be a main control screen, a central control screen, a co-pilot screen, an electronic rear-view screen, etc., and the embodiment of the present application does not limit this. In the embodiment of the present application, it is possible to perform real-time detection of whether the driver's line of sight to the first display screen is blocked.

[0132] S102: When it is detected that the driver's line of sight of the first display screen is blocked, determine a second display screen associated with the first display screen.

[0133] In the embodiment of the present application, when it is detected that the driver's line of sight to the first display screen is blocked, a second display screen associated with the first display screen can be determined. The second display screen determined in the embodiment when the line of sight is blocked can be any one or more in-vehicle display screens other than the first display screen.

[0134] S103, controlling the second display screen to display the content of the first display screen.

[0135] In the embodiment of the present application, after determining the second display screen associated with the first display screen, the second display screen can be controlled to display the content displayed on the first display screen.

[0136] Therefore, in the embodiment of the present application, when it is detected that the driver's line of sight to the first display screen is blocked, the corresponding second display screen can be determined to control the second display screen to display the content of the first display screen. In this way, when the driver's line of sight to the first display screen on the right is blocked, the driver can view the content of the first display screen through the second display screen in the car, thereby ensuring that the driver's line of sight to the target content is no longer disturbed during driving, and the driver can view the target content without obstruction, thereby improving driving safety.

[0137] In combination with the above embodiments, the present application provides a content display method, in which the method may further include the following steps:

[0138] S201, controlling the second display screen to adjust its angle.

[0139] In an embodiment of the present application, the controller can adjust the actual hardware angle of the second display screen before, after, or at the same time as controlling the second display screen to display the content of the first display screen, so that the driver can more clearly see the content of the first display screen displayed on the second display screen.

[0140] That is to say, in this embodiment, step S201 may be executed first and then step S103, or step S103 may be executed first and then step S201, or step S201 and step S103 may be executed simultaneously. This embodiment does not impose any limitation on the execution order between step S201 and step S103.

[0141] In combination with the above embodiments, the present application provides a content display method. In the method, the above S201 may include at least one of the following:

[0142] S2011: Control the second display screen to deflect to the left at a preset angle.

[0143] In this embodiment, a preset angle of the second display screen can be set in advance, so as to control the second display screen to deflect to the left according to the preset angle before, after, or simultaneously with controlling the second display screen to display the content of the first display screen. The specific value of the preset angle is not limited and can be arbitrarily specified as needed.

[0144] Accordingly, in this embodiment, step S2011 may be executed first and then step S103, or step S103 may be executed first and then step S2011, or step S2011 and step S103 may be executed simultaneously. This embodiment does not impose any limitation on the execution order between step S2011 and step S103.

[0145] For example, Figure 6 As shown, Figure 6 This is a schematic diagram of adjusting a display screen provided by an embodiment of the present application. In this embodiment, the first display screen is a right rear view screen, and the second display screen is a main control screen. Before, after, or at the same time as controlling the second display screen to display the content of the first display screen, the main control screen can be controlled to deflect to the left according to a pre-set deflection angle, so that the driver can more clearly see the content of the first display screen displayed on the second display screen.

[0146] S2012: Control the sum of the angle of the second display screen and the angle of the first display screen to be 180 degrees.

[0147] In this embodiment, before, after, or simultaneously with controlling the second display screen to display the content of the first display screen, the sum of the angles of the second display screen and the first display screen can be controlled to be 180 degrees to ensure that the first display screen and the second display screen are in a symmetrical relationship, so that the driver can more clearly view the content of the first display screen displayed on the second display screen.

[0148] Accordingly, in this embodiment, step S2012 may be executed first and then step S103, or step S103 may be executed first and then step S2012, or step S2012 and step S103 may be executed simultaneously. This embodiment does not impose any limitation on the execution order between step S2012 and step S103.

[0149] In combination with the above embodiments, the present application provides a content display method, in which the method may further include the following steps:

[0150] S301: adjusting a display parameter value of the second display screen according to a display parameter value of the first display screen.

[0151] In an embodiment of the present application, before, after, or at the same time as controlling the second display screen to display the content of the first display screen, the display parameter values ​​of the second display screen can be adjusted to a certain extent according to the display parameter values ​​of the first display screen. The display parameters include at least one or more of the following: display brightness, display contrast, aspect ratio, refresh rate. This enables the driver to more clearly view the target content displayed on the second display screen. In addition, by adjusting the display parameters of the second display screen according to the parameters of the first display screen, the driver's consistent visual perception can be maintained, thereby enhancing the driver's experience.

[0152] In this embodiment, step S301 may be executed first and then step S103, or step S103 may be executed first and then step S301, or step S301 and step S103 may be executed simultaneously. This embodiment does not impose any limitation on the execution order between step S301 and step S103.

[0153] Specifically, in one implementation, the above S301 includes at least one or more of the following:

[0154] S3011: Control the brightness value of the second display screen according to the brightness value of the first display screen.

[0155] Generally speaking, the brightness of the first display screen, such as the rearview screen, will be brighter. Therefore, this embodiment can control the brightness value of the second display screen according to the brightness value of the first display screen, such as increasing the brightness value of the second display screen, maintaining a consistent visual perception of the driver, and improving the driver's experience.

[0156] S3012: Control the aspect ratio of the second display screen according to the aspect ratio of the first display screen.

[0157] Generally speaking, the aspect ratio of the first display screen, such as the rear-view screen, is shorter horizontally than longer vertically, while the aspect ratio of the second display screen is generally longer horizontally than shorter vertically. Therefore, this embodiment can control the aspect ratio of the second display screen according to the aspect ratio of the first display screen, such as scaling the second display screen, or splitting the second display screen so that the aspect ratio of one of the split screens is consistent with the aspect ratio of the first display screen, etc., so as to maintain a consistent visual perception for the driver and enhance the driver's experience.

[0158] S3013: Control the refresh rate of the second display screen according to the refresh rate of the first display screen.

[0159] Generally speaking, the refresh rate of the first display screen, such as the rearview screen, is higher. In order to avoid delays in the second display screen displaying the content of the first display screen, the present embodiment can control the refresh rate of the second display screen according to the refresh rate of the first display screen, such as increasing the refresh rate of the second display screen, to maintain a consistent visual perception for the driver and enhance the driver's experience.

[0160] Accordingly, in this embodiment, any one or more of steps S3011-S3013 may be executed first, and then step S103; step S103 may be executed first, and then any one or more of steps S3011-S3013; step S301 and any one or more of steps S3011-S3013 may also be executed simultaneously; this embodiment does not impose any limitation on the execution order between any one or more of steps S3011-S3013, and the execution order between any one or more of steps S3011-S3013 and step S103.

[0161] For example, Figure 7 As shown, Figure 7 This is a schematic diagram of adjusting a display screen provided by another embodiment of the present application. In this embodiment, the first display screen is a right rear view screen, and the second display screen is a main control screen. After, before, or at the same time as controlling the main control screen to display the content of the right rear view screen, the display brightness and / or display contrast of the main control screen can be adjusted, for example, the display brightness and display contrast can be increased, so that the driver can more clearly see the content of the first display screen displayed on the second display screen.

[0162] In one embodiment, before, after, or at the same time as controlling the second display screen to display the content of the first display screen, both the angle of the second display screen and the display parameter value of the second display screen can be adjusted, thereby further enabling the driver to more clearly view the content of the first display screen displayed on the second display screen, maintaining a consistent visual perception for the driver and enhancing the driver's experience.

[0163] In combination with the above embodiments, the present application embodiment provides a content display method. In the method, in addition to the above steps, step S401 may be included, and the step S102 may include sub-steps S402 and S403:

[0164] S401: When it is detected that the driver's line of sight to the first display screen is blocked, determine the degree of blockage of the line of sight.

[0165] In an embodiment of the present application, when it is detected that the driver's line of sight to the first display screen is blocked, the degree of obstruction of the driver's line of sight can be determined; wherein the degree of obstruction is used to characterize the situation where the field of vision is blocked, for example, the degree of obstruction can be a blocking angle or a blocking percentage, etc., without limitation.

[0166] S402: When the shielding degree exceeds a first shielding degree threshold, determine that the second display screen is a third display screen.

[0167] In an embodiment of the present application, an occlusion degree threshold is pre-set for dividing the occlusion degree, and the occlusion degree threshold includes: a first occlusion degree and a second occlusion degree, wherein the second occlusion degree threshold is greater than the first occlusion degree threshold.

[0168] The controller can compare the determined occlusion degree with the occlusion degree threshold, and when it is determined that the occlusion degree exceeds the first occlusion degree threshold and is less than the second occlusion degree threshold, determine the second display screen as: the third display screen, thereby displaying the content of the first display screen through the third display screen.

[0169] S403: When the shielding degree exceeds a second shielding degree threshold, determine that the second display screen is: a fourth display screen.

[0170] In the embodiment of the present application, when it is determined that the degree of occlusion exceeds the second occlusion degree threshold, the second display screen can be determined to be: the fourth display screen, so that the content of the first display screen is displayed through the fourth display screen. Wherein, the second display screen of the present embodiment at least includes: the third display screen and the fourth display screen, and the fourth display screen is a display screen closer to the driver than the third display screen.

[0171] For example, Figure 8 As shown, Figure 8 Schematic diagram of a target content display method provided by an embodiment of the present application. In this embodiment, the first display screen is the right rear view screen, the first occlusion degree threshold is 20%, and when it is determined that the occlusion degree exceeds 20%, the second display screen is determined to be the third display screen, i.e., the co-pilot screen, and the content of the right rear view screen is projected to the co-pilot screen, so that the driver can view the content of the right rear view screen through the co-pilot screen.

[0172] like Fig. 9 As shown, Fig. 9 : is a schematic diagram of a target content display method provided by another embodiment of the present application. In this embodiment, the first display screen is the right rear view screen, the second occlusion degree threshold is 50%, and when it is determined that the occlusion degree exceeds 50%, the second display screen is determined to be the fourth display screen, that is, the main control screen, and the target content is projected to the main control screen, so that the driver can view the content of the right rear view screen through the main control screen, wherein the main control screen is closer to the driver than the co-pilot screen.

[0173] In this way, through the embodiment of the present application, the content of the first display screen can be projected onto different display screens based on the different degrees of occlusion. The greater the degree of occlusion, the target content will be displayed on the second display screen closer to the driver's position, thereby further improving the driver's viewing experience of the target content while ensuring that the driver can view the target content without occlusion.

[0174] In combination with the above embodiments, in another embodiment, the embodiment of the present application provides a content display method, in which, in addition to the above steps, step S501 may be included, and the step S103 may include sub-steps S502 and S503:

[0175] S501: When it is detected that the driver's line of sight to the first display screen is blocked, determine the degree of blockage of the line of sight.

[0176] In an embodiment of the present application, when it is detected that the driver's line of sight to the first display screen is blocked, the degree of obstruction of the driver's line of sight can be determined; wherein the degree of obstruction is used to characterize the situation where the field of vision is blocked, for example, the degree of obstruction can be a blocking angle or a blocking percentage, etc., and there is no limitation on this.

[0177] S502: When the occlusion degree exceeds a third occlusion degree threshold, control the first display area of ​​the second display screen to display the content of the first display screen.

[0178] In an embodiment of the present application, an occlusion degree threshold is pre-set for dividing the occlusion degree, and the occlusion degree threshold may include: a third occlusion degree and a fourth occlusion degree, wherein the third occlusion degree threshold is greater than the fourth occlusion degree threshold.

[0179] The controller may compare the determined occlusion degree with an occlusion degree threshold, and when it is determined that the occlusion degree exceeds a third occlusion degree threshold, control the first display area in the second display screen to display the content of the first display screen.

[0180] S503: When the occlusion degree exceeds a fourth occlusion degree threshold, control the second display area of ​​the second display screen to display the content of the first display screen.

[0181] In the embodiment of the present application, when it is determined that the degree of occlusion exceeds the fourth occlusion degree threshold and is less than the third occlusion degree threshold, the second display area in the second display screen can be controlled to display the content of the first display screen. The first display area in the present embodiment is a display area closer to the driver than the second display area, that is, the first display area in the second display screen is closer to the driver's position than the second display area of ​​the second display screen.

[0182] For example, in one embodiment, the first display screen is the right rear-view screen, the second display screen is the main control screen or the co-pilot screen, etc., and the content of the first display screen can be projected to different positions of the main control screen or the co-pilot screen according to different degrees of occlusion. When the degree of occlusion is greater than the fourth occlusion threshold of 20%, the content of the right rear-view mirror is projected to the second display area of ​​the main control screen or the co-pilot screen, that is, the right side of the main control screen or the co-pilot screen; when the degree of occlusion is greater than the third occlusion threshold of 50%, the content of the right rear-view mirror is projected to the first display area of ​​the main control screen or the co-pilot screen, that is, the left side of the main control screen or the co-pilot screen. Among them, the left side of the main control screen or the co-pilot screen is closer to the driver's position than the right side of the main control screen or the co-pilot screen.

[0183] In this way, through the embodiments of the present application, the content of the first display screen can be projected to different positions of the second display screen based on the different degrees of occlusion. The greater the degree of occlusion, the target content is displayed in a display area closer to the driver's position, thereby further improving the driver's viewing experience of the target content while ensuring that the driver can view the target content without occlusion.

[0184] In combination with the above embodiments, the embodiments of the present application provide a content display method. In the method, in addition to the above steps, when it is detected that the driver's line of sight of the first display screen is blocked, steps S601 and S602 may be included, and the "determining a second display screen associated with the first display screen" in step S102 may include sub-step S603:

[0185] S601, determining the blocking time of the line of sight being blocked, and / or determining the number of times the line of sight is blocked.

[0186] In the embodiment of the present application, a time threshold and a number threshold are preset, the time threshold is the longest time that the driver's line of sight to the first display screen is blocked within the permitted range, and the number threshold is the maximum number of times that the driver's line of sight to the first display screen is blocked within the permitted range. When it is detected that the driver's line of sight to the first display screen is blocked, the blocking time of the driver's line of sight to the first display screen can also be determined, and / or the number of times that the driver's line of sight to the first display screen is blocked can be determined.

[0187] S602: When the shielding time exceeds a time threshold and / or the shielding times exceeds a times threshold, determine that the content of the first display screen needs to be displayed on the second display screen.

[0188] In the embodiment of the present application, after determining the occlusion time and / or the number of occlusions, the occlusion time can be compared with a time threshold, and / or the number of occlusions can be compared with a number threshold. When it is determined that the occlusion time exceeds the time threshold, and / or the number of occlusions exceeds the number threshold, the controller determines that the content of the first display screen needs to be displayed on the second display screen.

[0189] That is to say, in this embodiment, when it is determined that the obstruction time does not exceed the time threshold, and / or the number of obstructions does not exceed the number threshold, it means that the line of sight obstruction is very short and infrequent, and the driver can continue to see the target content by watching the first display screen. At this time, the target content can continue to be displayed through the first display screen, and there is no need to display the target content through the second display screen.

[0190] S603, when it is determined that the content of the first display screen needs to be displayed through the second display screen, execute the step of: determining a second display screen associated with the first display screen.

[0191] In the embodiment of the present application, when the controller determines that the content of the first display screen needs to be displayed through the second display screen, it can determine the second display screen associated with the first display screen, that is, it can execute the step of determining the second display screen associated with the first display screen.

[0192] In this embodiment, the screen is no longer projected for display as soon as there is an occlusion. Instead, it can be further determined whether a second display screen is needed to display the target content based on the time and number of occlusions. In this way, occasional occlusions can be eliminated based on time and number of times, and the driver's driving experience can be further improved based on the actual situation of the occlusion.

[0193] In combination with the above embodiments, the present application provides a content display method. In the method, the above step S101 may include the following steps:

[0194] S701, obtaining a first driver image collected from the driver.

[0195] In the embodiment of the present application, the first display screen is a right rear view screen, and a camera is integrated in the right rear view screen. The camera can collect the driver image to obtain the first driver image, and the controller can obtain the first driver image for analysis and processing. The camera integrated in the right rear view screen can be an under-screen camera, and the position of the camera in the right rear view screen is not limited.

[0196] S702: Detect, based on the first driver image, whether a target part of the driver is blocked.

[0197] In an embodiment of the present application, a target part of the driver can be detected based on the first driver image to detect whether the target part of the driver is blocked, wherein the target part can be a characteristic part of the driver, such as the head, eyes, glasses, etc.

[0198] For example, when the target part is the driver's head, it can be determined based on the first driver image whether the complete driver's head can be detected. If the complete driver's head can be obtained, it is determined that the target part is not obscured. If the complete driver's head cannot be obtained, it is determined that the target part is obscured.

[0199] When the target part is the driver's ear, it can be determined based on the first driver image whether the driver's ear can be detected. If the driver's ear can be obtained, it is determined that the target part is not obstructed. If the driver's ear cannot be obtained, it is determined that the target part is obstructed.

[0200] S703: When the target part is blocked, determine that the target sight line is blocked.

[0201] In the embodiment of the present application, when it is determined that the target part is blocked, it can be determined that the driver's line of sight of viewing the first display screen is blocked.

[0202] In an embodiment of the present application, the driver's line of sight obstruction to the right rear screen can be detected based on the camera integrated in the first display screen, so as to accurately determine the line of sight obstruction by detecting the target part from the perspective of the first display screen.

[0203] In combination with any of the above embodiments, a content display method in an embodiment of the present application, in which step S101 may include the following steps:

[0204] S801, obtaining a first head image of the driver, and obtaining a second head image of the co-pilot.

[0205] In the embodiment of the present application, the first display screen is the right rear view screen, and the right rear view screen is integrated with a camera, which can cover the range of the main driver and the co-driver seats. The under-screen camera can collect images of the driver and the co-driver in real time to obtain a first head image of the driver and a second head image of the co-driver. The controller can obtain the first head image of the driver and the second head image of the co-driver for analysis and processing. Among them, the camera integrated with the right rear view screen can be an under-screen camera, and the position of the camera on the right rear view screen is not limited.

[0206] S802: Determine an overlapping area between the first head image and the second head image.

[0207] S803: When the overlapping area is greater than an area threshold, determine that the line of sight is blocked.

[0208] In the embodiment of the present application, after acquiring the first head image and the second head image, the overlapping area between the first head image and the second head image can be determined, and the overlapping area can be compared with a pre-set area threshold. If it is determined that the overlapping area is greater than the area threshold, it can be determined that the driver's line of sight of the first display screen is blocked. The area threshold of this embodiment is the maximum area of ​​the driver's head blocked by the co-driver's head within the allowable range of the first display screen.

[0209] In an embodiment of the present application, the driver's target line of sight obstruction detection can be performed based on the camera integrated in the first display screen, so as to accurately determine the line of sight obstruction by detecting the overlapping area between the driver and the co-driver from the perspective of the first display screen.

[0210] In combination with any of the above embodiments, a content display method in an embodiment of the present application, in which step S101 may include the following steps:

[0211] S901, determining the distance between the co-pilot and the co-pilot screen.

[0212] In an embodiment of the present application, the first display screen is the right rear view screen, and the controller can determine the distance between the co-pilot and the co-pilot screen, thereby judging whether the co-pilot blocks the driver's target line of sight of the right rear view screen based on the distance.

[0213] For example, in one embodiment, the distance between the co-pilot and the co-pilot screen can be determined by an in-vehicle sensor; or the feature information of the co-pilot can be obtained by an under-screen camera of the co-pilot screen, and then the distance between the co-pilot and the co-pilot screen can be determined by the feature information. This embodiment does not limit this.

[0214] S902: When the distance is less than a distance threshold, determine that the line of sight is blocked.

[0215] In the embodiment of the present application, a distance threshold is set in advance, and the distance threshold is the minimum distance between the co-pilot and the co-pilot screen when the co-pilot does not block the driver's line of sight. The controller can compare the acquired distance between the co-pilot and the co-pilot screen with the distance threshold, and when it is determined that the distance is less than the distance threshold, it can be determined that the driver's line of sight of the first display screen is blocked.

[0216] In one embodiment, the distance threshold can be determined based on the positional relationship between the driver and the co-pilot seats, and the distance threshold includes: a first threshold or a second threshold. When the driver's seat is behind the co-pilot seat in the horizontal direction inside the vehicle, the minimum distance between the co-pilot and the co-pilot screen when the co-pilot does not block the driver's line of sight is determined as the first threshold; when the driver's seat is in front of the co-pilot seat in the horizontal direction inside the vehicle, the minimum distance between the co-pilot and the co-pilot screen when the co-pilot does not block the driver's line of sight is determined as the second threshold, wherein the first threshold is greater than the second threshold.

[0217] So when doing distance comparison, Fig.10 As shown, Fig.10 is a schematic diagram of judging target sight obstruction provided by an embodiment of the present application. Fig.10 In the case where the driver's seat is behind the co-pilot seat in the horizontal direction inside the vehicle, the distance between the co-pilot and the co-pilot screen can be compared with a first threshold. When it is determined that the distance is less than the first threshold, it can be determined that the driver's view of the first display screen is blocked.

[0218] And, if Fig.11 As shown, Fig.11 is a schematic diagram of judging target sight obstruction provided by an embodiment of the present application. Fig.11 In the case where the driver's seat is in front of the co-pilot seat in the horizontal direction inside the vehicle, the distance between the co-pilot and the co-pilot screen can be compared with a second threshold. When it is determined that the distance is less than the second threshold, it can be determined that the driver's line of sight to the first display screen is blocked, wherein the second threshold is less than the first threshold.

[0219] In an embodiment of the present application, the driver's line of sight obstruction to the first display screen can be detected based on the distance between the co-driver and the co-driver screen, so as to accurately determine the line of sight obstruction based on the co-driver's in-car situation.

[0220] In combination with any of the above embodiments, a content display method in an embodiment of the present application, in which step S101 may include the following steps:

[0221] S1001, determining whether the co-pilot is operating the co-pilot screen.

[0222] In the embodiment of the present application, the first display screen is the right rear view screen, and the controller can determine whether the co-pilot is operating the co-pilot screen through the response information sent by the co-pilot screen. When the co-pilot is operating the co-pilot screen, the co-pilot screen can respond based on the user's operation and send the response information to the controller to notify the controller that the co-pilot is currently operating the co-pilot screen.

[0223] S1002, when the co-pilot is operating the co-pilot screen, determining that the line of sight is blocked.

[0224] In the embodiment of the present application, because the co-pilot usually needs to operate the screen at close range when the co-pilot operates the co-pilot screen, when the controller determines that the co-pilot is operating the co-pilot screen, it can be determined that the co-pilot is close to the co-pilot screen and may block the driver's view of the right rear screen. Therefore, in this case, the present embodiment can directly determine that the driver's view of the first display screen is blocked, thereby ensuring to the greatest extent that the driver's view will not be blocked.

[0225] In an embodiment of the present application, the driver's line of sight obstruction to the first display screen can be detected based on the co-driver's operation of the co-driver's screen, so as to accurately determine the line of sight obstruction based on the co-driver's in-car situation.

[0226] In combination with the above embodiments, in one implementation, the occlusion detection of the driver's line of sight to the first display screen is performed based on the co-pilot's operation of the co-pilot screen, and this can be performed in parallel with the occlusion detection of the driver's line of sight to the first display screen based on the distance between the co-pilot and the co-pilot screen.

[0227] In combination with any of the above embodiments, a content display method in an embodiment of the present application, in which step S101 may include the following steps:

[0228] S1101, respectively obtain the positions of the driver's seat and the co-pilot's seat.

[0229] S1102: Determine the angle between the line between the driver's seat and the passenger seat and the horizontal direction of the vehicle body.

[0230] In the embodiment of the present application, the positions of the driver's seat and the co-pilot's seat can be respectively obtained by the in-vehicle sensors, and then the angle between the line between the driver's seat and the co-pilot's seat and the horizontal direction of the vehicle body can be determined.

[0231] S1103: When the included angle is greater than an angle threshold, determine that the line of sight is blocked.

[0232] In an embodiment of the present application, an angle threshold is set in advance. After obtaining the angle between the line between the driver's seat and the co-pilot seat and the horizontal direction of the vehicle body, the controller can compare the angle with the angle threshold. When it is determined that the angle between the line between the driver's seat and the co-pilot seat and the horizontal direction of the vehicle body is greater than the angle threshold, it can be determined that the driver's view of the first display screen is blocked.

[0233] For example, Fig.12 As shown, Fig.12 is a schematic diagram of judging target sight obstruction provided by an embodiment of the present application. Fig.12 In the process, the controller can obtain the position of the driver's seat and the passenger seat, and determine the angle between the line connecting the two and the horizontal direction of the vehicle body (i.e. Fig.12 If the angle is greater than the angle threshold (such as 10 degrees), it is determined that the driver's line of sight of the first display screen is blocked.

[0234] In combination with any of the above embodiments, a content display method in an embodiment of the present application may further include the following steps in addition to the above steps:

[0235] S1201, detecting whether a target event occurs.

[0236] In the embodiment of the present application, the controller can also monitor the target event to detect in real time whether the target event occurs. The target event is an event that the driver needs to watch the first display screen and / or an emergency event that occurs during driving. The occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition; the occurrence of the target event indicates that the driver has the intention to watch the first display screen.

[0237] S1202, when the target event is detected, executing the step of detecting whether the driver's line of sight of the first display screen is blocked.

[0238] In the embodiment of the present application, when the occurrence of the target event is detected, that is, when it is determined that the driver has the intention to view the first display screen, the above-mentioned method will be used to start the relevant detection of whether the driver's line of sight to the first display screen is blocked, so as to more accurately judge whether the driver's line of sight is blocked. In addition, the power consumption of the device corresponding to the detection of the driver's line of sight to the first display screen can be reduced to avoid being in a working state all the time. Only when the occurrence of the target event is detected will the device be activated for occlusion judgment.

[0239] In combination with any of the above embodiments, a content display method in an embodiment of the present application may further include the following steps in addition to the above steps:

[0240] S1301: When the occurrence of a target event is detected, control the second display screen to display the content of the first display screen.

[0241] In the embodiment of the present application, not only the second display screen is controlled to display the content of the first display screen when it is detected that the driver's line of sight of the first display screen is blocked, but also the target event can be detected, and when the target event is detected, the second display screen is controlled to display the content of the first display screen. The target event is an event that the driver needs to watch the first display screen and / or an emergency event that occurs during driving. The occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition; the occurrence of the target event indicates that the driver has the intention to watch the first display screen.

[0242] In addition, in one embodiment, the target event may also include: the state of the co-pilot satisfies the third preset condition, wherein the state of the co-pilot satisfies the third preset condition at least includes: the co-pilot closes his eyes and the co-pilot sleeps. Since the display brightness of the first display screen is usually brighter, the co-pilot's eyes or sleep quality may be affected due to brightness and light problems. Therefore, in one embodiment, when the co-pilot is detected to have his eyes closed or to sleep, the second display screen is controlled to display the content of the first display screen, and the first display screen is stopped from displaying the content. In another embodiment, when the co-pilot is detected to have his eyes closed or to sleep, the second display screen is controlled to display the content of the first display screen, and the first display screen is not stopped from displaying the content, and the display brightness of the first display screen is only lowered. Thereby, while ensuring that the co-pilot is not affected by the brightness of the first display screen, it is ensured that the driver can view the content of the first display screen from the second display screen.

[0243] In combination with any of the above embodiments, in one implementation manner, the vehicle status satisfies the first preset condition and includes at least one or more of the following: the vehicle's right turn signal is turned on, and the vehicle's tires turn right more than a first angle; the vehicle's left turn signal is turned on, and the vehicle's tires turn left more than a second angle; the vehicle's emergency lights are turned on; the vehicle is in an emergency braking state.

[0244] In combination with any of the above embodiments, in one implementation, the driver state satisfies the second preset condition, including: the driver's head turns rightward by more than a third angle. The first angle, the second angle, and the third angle are all set critical values, such as the third angle can be 40 degrees, the first angle and the second angle can be 10 degrees, and so on, and no restriction is imposed on the specific values.

[0245] See also Fig.13 , shows a flow chart of a method for displaying control target content based on the main driver's perception according to an embodiment of the present application. In this method, the central control screen is the second display screen, the rearview mirror screen is the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the central control application and the rearview mirror application. The display method includes the following steps:

[0246] (1) The rearview mirror application obtains the streaming media data collected and sent by the rearview mirror;

[0247] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;

[0248] (3) The rearview mirror application sends the processed streaming media data to the rearview mirror screen for display;

[0249] (4) The rearview mirror is integrated with an under-screen camera. The rearview mirror application can detect the driver's characteristic parts, such as the head and glasses, through the under-screen camera, and then determine whether the driver's characteristic parts are blocked, such as whether the driver's head is blocked; specifically, Fig.14 As shown, Fig.14 : is a schematic diagram of a line of sight obstruction judgment of an embodiment of the present application, the rearview mirror application judges whether the line of sight is blocked by detecting the characteristic parts of the driver, and the judgment can be made by collecting images through the camera carried by the rearview mirror screen; preferably, the camera of the right rear view screen is located on the right side of the right rear view screen;

[0250] (5) If it is determined that the characteristic part of the driver has been blocked, it is optional to further determine whether the blocking time meets a certain threshold, such as 2 seconds. If the blocking time meets the certain threshold, the next step is executed; optionally, the number of times the driver is blocked is counted. If the number exceeds a certain threshold, the next step is executed;

[0251] (6) Optionally, the rearview mirror application sends a notification to the central control application;

[0252] (7) The central control application obtains streaming media data from the rearview mirror application;

[0253] (8) Optionally, the central control application may perform data processing on the streaming media data, such as scaling the streaming media data to match the size of the central control screen;

[0254] (9) The central control application sends the streaming media data to the central control screen for display;

[0255] (10) Optionally, the central control application can display the right rear view screen content in full screen on the main control screen, such as Fig.15 As shown, Fig.15 is a schematic diagram of controlling the display of target content in an embodiment of the present application; it can also be displayed on a part of the main control screen, such as Fig.16 As shown, Fig.16 is a schematic diagram of controlling the display of target content in an embodiment of the present application. Fig.16 In the embodiment, the content of the right rear screen (first display screen) is displayed on the right side of the main control screen (second display screen).

[0256] See also Fig.17, shows a flow chart of a method for displaying control target content based on co-pilot perception according to an embodiment of the present application. In this method, the central control screen is the second display screen, the rearview mirror screen is the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the central control application and the rearview mirror application. The display method includes the following steps:

[0257] (1) The rearview mirror application obtains the streaming media data sent by the rearview mirror;

[0258] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;

[0259] (3) The rearview mirror application sends the processed streaming media data to the rearview mirror screen for display;

[0260] (4) The rearview mirror application determines the positional relationship between the driver's seat and the passenger seat, and determines a first threshold or a second threshold. When the driver's seat is behind the passenger seat, the first threshold is determined; when the driver's seat is in front of the passenger seat, the second threshold is determined. The first threshold is greater than the second threshold.

[0261] (5) Detecting whether the characteristic parts of the driver are blocked can be processed by the entertainment application, such as determining the distance between the front passenger and the front passenger screen. If it is less than a certain threshold, it is determined that the driver is blocked. In addition, the characteristic information of the front passenger can be obtained through the camera on the front passenger screen, and then the distance between the front passenger and the front passenger screen is determined. If it is less than a certain threshold, it is determined that the driver is blocked.

[0262] (6) A solution parallel to (4), when the co-pilot screen detects that the passenger is operating the co-pilot screen, it is determined that the driver may be obstructed;

[0263] (7) If it is determined that the characteristic part of the driver has been blocked, optionally, further determine whether the blocking time meets a certain threshold, such as 2 seconds, and if so, proceed to the next step; optionally, count the number of times the driver is blocked, and if the number exceeds a certain threshold, proceed to the next step;

[0264] (8) Optionally, the rearview mirror application sends a notification to the central control application;

[0265] (8) The central control application obtains streaming media data from the rearview mirror application;

[0266] (9) Optionally, the central control application may perform data processing on the streaming media data, such as scaling the streaming media data to match the size of the central control screen;

[0267] (10) The central control application sends the streaming media data to the central control screen for display;

[0268] (11) The rearview mirror application continues to determine whether the distance between the co-pilot and the co-pilot screen is greater than a certain threshold. If so, the streaming media data is sent to the central control application.

[0269] See also Fig.18 , shows a flow chart of a method for displaying control target content based on event sensing according to an embodiment of the present application. In this method, the central control screen is the second display screen, the rearview mirror screen is the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the central control application and the rearview mirror application. The display method includes the following steps:

[0270] (1) The rearview mirror application obtains the streaming media data sent by the rearview mirror;

[0271] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;

[0272] (3) The rearview mirror application sends the processed streaming media data to the rearview mirror display screen for display;

[0273] (4) The central control application detects the driver's operation information and thus senses changes in vehicle status;

[0274] (5) If it is determined that the vehicle state change meets the preset conditions, the central control application obtains the streaming media data from the rearview mirror application; the preset conditions include: turning the head to the right more than a certain angle (such as 40 degrees), optionally, when the right turn signal is turned on, the tire turns right more than a certain angle (such as 10 degrees), when the left turn signal is turned on, the tire turns left more than a certain angle (such as 10 degrees), when the emergency lights are turned on, and when the emergency brake is applied;

[0275] (6) Optionally, the central control application can detect a specific state of the driver. For example, if it is detected that the driver's head is tilted to the right, the central control application obtains streaming media data from the rearview mirror application;

[0276] (7) Optionally, the central control application can process the streaming media data, such as scaling it to match the size of the central control screen;

[0277] (8) The central control application sends the streaming media data to the central control screen for display.

[0278] See also Fig.19 , shows a flow chart of a method for displaying the content of a control target based on occlusion detection and judgment after event triggering according to an embodiment of the present application. In this method, the central control screen is the second display screen, the rearview mirror screen is the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the central control application and the rearview mirror application. The display method includes the following steps:

[0279] (1) The driving assistance application identifies the driver and obtains image information of the driver looking at the left and right rearview mirrors, and inputs the image information into the neural network to identify the driver's action of looking at the left and right rearview mirrors;

[0280] (2) The rearview mirror application obtains the streaming media data sent by the rearview mirror;

[0281] (3) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;

[0282] (4) The rearview mirror application sends the processed streaming media data to the rearview mirror screen for display;

[0283] (5) The central control application detects driver status events and / or vehicle events, where the driver status event includes turning the head to the right more than a certain angle (e.g., 40 degrees), and the neural network model recognizes that the user is looking at the rearview mirror;

[0284] (6) Optionally, the vehicle events include turning on the right turn signal, the tire turning right more than a certain angle (such as 10 degrees), turning on the left turn signal, the tire turning left more than a certain angle (such as 10 degrees), turning on the emergency lights, emergency braking, etc.;

[0285] (7) If it is determined that the driver status event and / or the vehicle event meets the preset conditions, then the next step is executed;

[0286] (8) When detecting driver status events and / or vehicle events that meet preset conditions, the central control application notifies the rearview mirror application to detect whether the driver's line of sight is blocked, such as determining the distance between the front passenger and the front passenger screen. If it is less than a certain threshold, it is determined that the driver is blocked; in addition, the feature information of the front passenger can be obtained through the camera on the front passenger screen, and then the distance between the front passenger and the front passenger screen can be determined. If it is less than a certain threshold, it is determined that the driver is blocked; in addition, the right rear view screen can also be integrated with camera A, which can cover the range of the main driver and front passenger seats. Camera A implements to obtain real-time images of the main driver and front passenger seats. When camera A determines whether the complete driver's head can be obtained, it determines whether it is blocked; optionally, camera A detects the driver's ears. If the ears can be detected, it is determined that they are not blocked; if the ears cannot be detected, it is determined that they are blocked;

[0287] (9) If it is determined that the characteristic part of the driver has been blocked, optionally, further determine whether the blocking time meets a certain threshold, such as 2 seconds, and if so, proceed to the next step; optionally, count the number of times the driver is blocked, and if the number exceeds a certain threshold, proceed to the next step;

[0288] (10) Optionally, the rearview mirror application sends a notification to the central control application;

[0289] (11) The central control application obtains streaming media data from the rearview mirror application;

[0290] (12) Optionally, the central control application may perform data processing on the streaming media data, such as scaling the streaming media data to match the size of the central control screen;

[0291] (13) The central control application sends the streaming media data to the central control screen for display;

[0292] (14) Optionally, the central control application may display the content of the right rear view screen in full screen on the main control screen, or may display it on a portion of the main control screen;

[0293] (15) The rearview mirror application continues to determine whether the distance between the co-pilot and the co-pilot screen is greater than a certain threshold. If so, the streaming media data is sent to the central control application.

[0294] See also Fig. 20 , shows a flow chart of a method for controlling the display of target content on the co-pilot screen according to an embodiment of the present application. In this method, the co-pilot screen is the second display screen, the rearview mirror screen is the first display screen, the co-pilot screen corresponds to an entertainment application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the entertainment application and the rearview mirror application. The display method includes the following steps:

[0295] (1) The rearview mirror application obtains the streaming media data sent by the rearview mirror;

[0296] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;

[0297] (3) The rearview mirror application sends the processed streaming media data to the rearview mirror screen for display;

[0298] (4) The rearview mirror is used to detect the driver's characteristic parts, such as the head, glasses, etc., and then determine whether the driver's characteristic parts are blocked, such as whether the driver's head is blocked; the rearview mirror is used to detect the driver's characteristic parts, and the judgment can be made through the camera carried on the rearview mirror screen;

[0299] (5) Optionally, if it is determined that the characteristic part of the driver is blocked, if it is blocked, it is optional to further determine whether the blocking time meets a certain threshold, such as 2 seconds, and if it meets the certain threshold, execute the next step;

[0300] (6) After the rearview mirror application determines that the driver is blocked, it sends a notification to the entertainment application;

[0301] (7) The entertainment application obtains streaming data from the rearview mirror application;

[0302] (8) Optionally, the entertainment application may perform data processing on the streaming media data, such as scaling the streaming media data to match the size of the central control screen;

[0303] (9) The entertainment application sends streaming media data to the co-pilot screen for display, such as Fig.21 As shown, Fig.21 is a schematic diagram of controlling the display of target content in an embodiment of the present application. Fig.21 In the example, the content of the right rear screen (first display screen) is displayed on the co-pilot screen (second display screen);

[0304] (10) Optionally, the entertainment application may detect whether the characteristic parts of the driver are blocked, such as determining the distance between the front passenger and the front passenger screen. If the distance is less than a certain threshold, the driver is determined to be blocked. Alternatively, the front passenger's characteristic information may be obtained through the camera on the front passenger screen to determine the distance between the front passenger and the front passenger screen. If the distance is less than a certain threshold, the driver is determined to be blocked.

[0305] In another embodiment, the second display screen may also be a dashboard, such as Fig. 22 As shown, Fig. 22 is a schematic diagram of controlling the display of target content in an embodiment of the present application. Fig. 22 In the embodiment of the present invention, the content of the right rear screen (first display screen) is displayed on the instrument panel (second display screen).

[0306] In one embodiment, the overall system structure of this embodiment is as follows: Fig.23 As shown, Fig.23 The electronic rearview mirror host can use a real-time operating system on a virtual machine, and the electronic rearview mirror system can be directly mounted on a vehicle SOC or MCU without being based on a virtual machine, and the MCU and the vehicle SOC are connected.

[0307] A unified data bus is built on different virtual machine systems to provide a unified API interface for upper-level applications. Upper-level applications can obtain vehicle-perceived data through the data bus, such as data from on-board cameras, and display it on the corresponding screen.

[0308] Based on the same inventive concept, the present application embodiment provides a content display system, referring to Fig.24 , Fig.24 2404 is a schematic diagram of a content display system provided in an embodiment of the present application, wherein the content display system at least includes: a first display screen 2403, a second display screen 2401, a controller 2402 and a vehicle body exterior camera 2404.

[0309] The vehicle body exterior camera 2404 is used to capture images of the vehicle body exterior.

[0310] In the embodiment of the present application, the camera on the outside of the vehicle body corresponds to the first display screen and is used to capture images of the outside of the vehicle body.

[0311] The controller 2402 is used to:

[0312] Detect whether the driver's line of sight to the first display screen 2403 is blocked, the first display screen 2403 is located on the right side of the driver; when it is detected that the driver's line of sight to the first display screen 2403 is blocked, determine the second display screen 2401 associated with the first display screen 2403; control the second display screen 2401 to display the content of the first display screen 2403; the content of the first display screen 2403 is the image content captured by the camera 2404 on the outside of the vehicle body.

[0313] In an embodiment of the present application, the first display screen is the display screen located on the right side of the driver inside the car that the driver is currently watching. The first display screen can be any display screen that allows the driver to view driving-related information; the first display screen can display the target content captured by the camera on the outside of the car body.

[0314] When the controller detects that the driver's line of sight of the first display screen is blocked, it can determine a second display screen associated with the first display screen and control the second display screen to display the content of the first display screen. The second display screen is one or more in-vehicle display screens other than the first display screen.

[0315] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a first camera is integrated under the first display screen;

[0316] The first camera is used to capture the image of the first driver;

[0317] In the embodiment of the present application, the first display screen may be a right rear view screen, and the first camera in the right rear view screen may capture an image of the driver, thereby acquiring a first driver image.

[0318] The controller is used to obtain the first driver image, detect whether a target part of the driver is blocked based on the first driver image, and determine that the line of sight is blocked when the target part is blocked.

[0319] In an embodiment of the present application, after the first camera captures the first driver image, the controller can obtain the first driver image from the first camera, and detect whether a target part of the driver is blocked based on the first driver image. If the target part is blocked, it is determined that the driver's line of sight to the first display screen is blocked.

[0320] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a first camera is integrated under the first display screen;

[0321] The first camera is used to capture a first head image of the driver and a second head image of the co-driver;

[0322] In an embodiment of the present application, the first display screen may be a right rear view screen. The first camera in the right rear view screen may cover the range of the driver's and co-driver's seats, and may capture real-time images of the driver and co-driver, thereby obtaining a first head image of the driver and a second head image of the co-driver.

[0323] The controller is used to obtain the first head image and the second head image, determine an overlapping area between the first head image and the second head image, and determine that the line of sight is blocked when the overlapping area is greater than an area threshold.

[0324] In an embodiment of the present application, after the first camera captures the first head image and the second head image, the controller can obtain the first head image and the second head image from the first camera, and determine the overlapping area of ​​the first head image and the second head image based on the first head image and the second head image, and make a judgment based on whether the overlapping area is greater than an area threshold. When it is determined that the overlapping area is greater than the area threshold, it is determined that the driver's view of the first display screen is blocked.

[0325] In combination with the above embodiments, the embodiments of the present application provide a content display system, in which the first camera is located on the right side of the first display screen. Because when the driver is looking at the first display screen, if the line of sight is blocked, it must be blocked from the right to the left. At this time, to ensure that the driver can see the right side, the first camera is installed on the right side, and as long as the right side is blocked, it can be detected through the image collected by the first camera.

[0326] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a second camera is integrated under the second display screen;

[0327] The second camera is used to capture the image of the second driver.

[0328] In the embodiment of the present application, the second camera of the second display screen can cover the range of the main driver's seat, and can collect real-time images of the main driver, thereby obtaining a second driver image of the driver.

[0329] The controller is used to detect whether the driver status meets a second preset condition based on the second driver image.

[0330] In an embodiment of the present application, after the second camera captures the second driver image, the controller may obtain the second driver image from the second camera and detect whether the driver status satisfies a second preset condition based on the second driver image.

[0331] In one embodiment, the image information of the driver looking at the left and right rearview mirrors may be collected in advance by the second camera, and the image information may be input into the neural network to identify the action of the driver turning his head to look at the left and right rearview mirrors. Thus, the controller may obtain the second driver image from the second camera, and the second driver image may be input into the trained neural network model to identify whether the driver turns his head to look at the rearview mirror, thereby measuring whether the driver's state meets the second preset condition.

[0332] In combination with the above embodiments, in an optional implementation manner, in the content display system, the second display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.

[0333] In combination with the above embodiments, in an optional implementation manner, in the content display system, the first display screen is a rearview mirror display screen.

[0334] In one embodiment of the present application, based on the problem that the current smart cockpit multi-screen display has too many screens and high hardware costs, the present application embodiment provides a content display method, referring to Fig.25 , which shows a flow chart of a content display method in an embodiment of the present application. The content display method provided in the embodiment of the present application can be applied to a controller, which can perform relevant control on a vehicle-mounted terminal and various components in the vehicle.

[0335] Generally, the electronic rearview mirror includes a camera and a display screen. For example, the camera on the right side of the vehicle body corresponds to the right rear view screen, and the camera on the left side of the vehicle body corresponds to the left rear view screen. In the embodiment of the present application, the left and right rear view screens are removed, and the corresponding target content can still be displayed according to the driver's driving situation. The content display method may include the following steps:

[0336] S2101, detecting whether the driver's current line of sight is looking outside the vehicle.

[0337] In the embodiment of the present application, during the driving process of the vehicle, each in-vehicle display screen displays its corresponding relevant driving information. Under normal circumstances, it will not display the external information of the vehicle, that is, the image information collected by the left and right external cameras of the vehicle body. The controller can detect the current line of sight of the driver to detect whether the current line of sight is to look outside the vehicle. For example, a camera can be integrated under the screen of the in-vehicle display screen, and the camera under the screen of the in-vehicle display screen can be used to collect the driver's image in real time. The controller detects the driver's image obtained in real time through the camera under the screen of the in-vehicle display screen to determine whether the driver's current line of sight is to look outside the vehicle.

[0338] S2102: When it is detected that the driver's current line of sight is toward the outside of the vehicle, determine the in-vehicle display screen.

[0339] In an embodiment of the present application, when the controller detects that the driver's current line of sight is looking outside the vehicle, it can determine the in-vehicle display screen that needs to display outside information, wherein the determined in-vehicle display screen can be any one or more display screens in the vehicle, and this embodiment does not limit this.

[0340] S2103, controlling the in-vehicle display screen to display information outside the vehicle.

[0341] In an embodiment of the present application, after determining that an in-vehicle display screen needs to display outside-vehicle information, the in-vehicle display screen can be controlled to display the outside-vehicle information, so that when the driver's intention to look outside the vehicle is detected, the outside-vehicle information is displayed on the in-vehicle display screen.

[0342] In combination with the above embodiments, the embodiments of the present application provide a content display method. In the content display method, in addition to the above steps, step S2201 may be further included, and the above step S2103 may specifically include step S2202:

[0343] S2201: When it is detected that the driver's current line of sight is toward the outside of the vehicle, determine a display mode of the in-vehicle display screen.

[0344] In the embodiment of the present application, when the controller detects that the driver's current line of sight is to look outside the vehicle, in addition to determining the in-vehicle display screen that needs to display information outside the vehicle, it can also determine the display mode of the in-vehicle display screen. The display mode may include: a first display mode or a second display mode; the first display mode is a display mode in which the information displayed on the in-vehicle display screen is hidden and the information outside the vehicle is displayed; the second display mode is a display mode in which the information outside the vehicle and part of the information displayed on the in-vehicle display screen are displayed.

[0345] S2202: Control the in-vehicle display screen to display the external vehicle information according to the display mode.

[0346] In an embodiment of the present application, after the in-vehicle display screen and the display mode of the in-vehicle display screen are determined, the in-vehicle display screen can be controlled to display the external information according to the determined display mode.

[0347] It should be noted that, in this embodiment, step S2102 may be executed first and then step S2201, or step S2201 may be executed first and then step S2102, or step S2102 and step S2201 may be executed simultaneously. This embodiment does not impose any limitation on the execution order between step S2201 and step S2102.

[0348] For example, Fig.26 As shown, Fig.26 is a schematic diagram of a content display method provided by an embodiment of the present application, in Fig.26 In the embodiment, the in-vehicle display screen is the instrument panel. When the controller detects that the driver's current line of sight is to look outside the vehicle, the controller can control the in-vehicle display screen to display the in-vehicle information collected by the left and right rear-view cameras in the first display mode (hiding the instrument panel information and displaying the in-vehicle information collected by the left and right rear-view cameras) or the second display mode (the instrument panel information only displays the speed / main information, i.e., reducing the amount of the instrument panel information and displaying the in-vehicle information collected by the left and right rear-view cameras).

[0349] In combination with any of the above embodiments, a content display method in an embodiment of the present application may further include the following steps in addition to the above steps:

[0350] S2301, when it is detected that the driver's current line of sight is not toward the outside of the vehicle, controlling the in-vehicle display screen to no longer display the outside-vehicle information.

[0351] In the embodiment of the present application, after the controller detects that the driver's current line of sight is the line of sight for viewing outside the vehicle, the driver's current line of sight will continue to be detected in real time. If the controller detects that the driver's current line of sight is not the line of sight for viewing outside the vehicle, the in-vehicle display screen can be controlled to stop displaying the information outside the vehicle, so that the in-vehicle display screen can continue to display the content corresponding to the content displayed on the in-vehicle display screen before displaying the information outside the vehicle. For example, when the in-vehicle display screen is a dashboard, if the controller detects that the driver's current line of sight is not the line of sight for viewing outside the vehicle, the in-vehicle display screen can continue to display the dashboard information.

[0352] For example, Fig. 27 As shown, Fig. 27 is a schematic diagram of a content display method provided by an embodiment of the present application, in Fig. 27In the embodiment, the display screen in the vehicle is the instrument panel. When the controller detects that the driver's current line of sight is to view outside the vehicle, the controller can control the outside information collected by the left and right rear-view cameras to be displayed on both sides of the instrument panel in the first display mode (hiding the instrument panel information and displaying the outside information collected by the left and right rear-view cameras) or the second display mode (the instrument panel information only displays the speed / main information, that is, the instrument panel information is reduced in volume, and the outside information collected by the left and right rear-view cameras is displayed). For example, the right side of the instrument panel displays the outside information collected by the right rear-view camera, and the left side of the instrument panel displays the outside information collected by the left rear-view camera.

[0353] Based on the same inventive concept, the present application embodiment provides a content display system, referring to Fig.28 , Fig.28 2801 is a schematic diagram of a content display system provided by an embodiment of the present application, wherein the content display system at least comprises: an in-vehicle display screen 2801, a controller 2802 and a camera 2803 outside the vehicle body.

[0354] The vehicle body exterior camera 2803 is used to capture images of the vehicle body exterior;

[0355] The controller 2802 is used to:

[0356] Detect whether the driver's current line of sight is looking outside the vehicle;

[0357] When it is detected that the driver's current line of sight is to look outside the vehicle, the in-vehicle display screen 2801 is determined; the in-vehicle display screen 2801 is controlled to display information outside the vehicle; the information outside the vehicle is image information collected by the camera 2803 on the outside of the vehicle body.

[0358] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a third camera is integrated under the in-vehicle display screen.

[0359] The third camera is used to capture the image of the third driver.

[0360] In the embodiment of the present application, the third camera of the in-vehicle display screen can cover the range of the main driver's seat, and can collect real-time images of the main driver, thereby obtaining a third driver image of the driver.

[0361] The controller is used to obtain the third driver image and detect, based on the third driver image, whether the driver's current line of sight is a line of sight looking outside the vehicle.

[0362] In an embodiment of the present application, after the third camera captures the third driver image, the controller can obtain the third driver image from the third camera, and perceive the driver's head and eye adjustments based on the third driver image, and detect whether the driver's current line of sight is looking outside the vehicle.

[0363] In combination with the above embodiments, in an optional implementation manner, in the content display system, the in-vehicle display screen includes at least one of the following: a main control screen, a dashboard, and a co-pilot screen.

[0364] As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0365] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps in the content display method described in any of the above embodiments are implemented.

[0366] Based on the same inventive concept, an embodiment of the present application provides a vehicle, which includes a controller, and the controller is used to execute the steps in the content display method described in any of the above embodiments.

[0367] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0368] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0369] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable image processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable image processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0370] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable image processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0371] These computer program instructions can also be loaded onto a computer or other programmable image processing terminal device, so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, so that the instructions executed on the computer or other programmable terminal device provide for implementing the process in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0372] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0373] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0374] The above is a detailed introduction to a content display method, system, vehicle and electronic device provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A content display method, characterized in that: The method comprises: Detecting whether a driver's line of sight of a first display screen is blocked, where the first display screen is located on the right side of the driver; When it is detected that the driver's line of sight of the first display screen is blocked, determining a second display screen associated with the first display screen; Control the second display screen to display the content of the first display screen.

2. The content display method according to claim 1, characterized in that: The method further comprises: Control the second display screen to adjust its angle.

3. The content display method according to claim 2, characterized in that: Controlling the second display screen to adjust its angle includes at least one of the following: Controlling the second display screen to deflect to the left at a preset angle; The sum of the angle of the second display screen and the angle of the first display screen is controlled to be 180 degrees.

4. The content display method according to claim 1, characterized in that: The method further comprises: The display parameter value of the second display screen is adjusted according to the display parameter value of the first display screen.

5. The content display method according to claim 4, characterized in that: Adjusting the display parameter value of the second display screen according to the display parameter value of the first display screen includes at least one or more of the following: Controlling the brightness value of the second display screen according to the brightness value of the first display screen; controlling the aspect ratio of the second display screen according to the aspect ratio of the first display screen; The refresh rate of the second display screen is controlled according to the refresh rate of the first display screen.

6. The content display method according to claim 1, characterized in that: The method further comprises: In the case where it is detected that the driver's line of sight for viewing the first display screen is blocked, determining the degree of the blocked line of sight, wherein the degree of the blocked line of sight is used to characterize the situation where the visual field range of the line of sight is blocked; When it is detected that the driver's line of sight of the first display screen is blocked, determining a second display screen associated with the first display screen comprises: In the case where the occlusion degree exceeds a first occlusion degree threshold, determining the second display screen as: a third display screen; When the occlusion degree exceeds a second occlusion degree threshold, the second display screen is determined to be: a fourth display screen, the second occlusion degree threshold is greater than the first occlusion degree threshold, and the fourth display screen is a display screen closer to the driver than the third display screen.

7. The content display method according to claim 1, characterized in that: The method further comprises: In the case where it is detected that the driver's line of sight for viewing the first display screen is blocked, determining the degree of the blocked line of sight, wherein the degree of the blocked line of sight is used to characterize the situation where the visual field range of the line of sight is blocked; Controlling the second display screen to display the content of the first display screen includes: When the occlusion degree exceeds a third occlusion degree threshold, controlling the first display area of ​​the second display screen to display the content of the first display screen; When the degree of occlusion exceeds the fourth degree of occlusion threshold, the second display area of ​​the second display screen is controlled to display the content of the first display screen, the third degree of occlusion threshold is greater than the fourth degree of occlusion threshold, and the first display area is a display area closer to the driver than the second display area.

8. The content display method according to claim 1, characterized in that: In the case where it is detected that the driver's line of sight of the first display screen is blocked, the method further includes: Determine the obstruction time of the line of sight being blocked, and / or determine the number of obstruction times of the line of sight being blocked; When the shielding time exceeds a time threshold, and / or the shielding times exceeds a times threshold, determining that the content of the first display screen needs to be displayed on the second display screen; Determining a second display screen associated with the first display screen includes: In case it is determined that the content of the first display screen needs to be displayed through the second display screen, the step of determining a second display screen associated with the first display screen is performed.

9. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Acquire a first driver image captured for the driver; detecting, according to the first driver image, whether a target part of the driver is blocked; When the target part is blocked, it is determined that the line of sight is blocked.

10. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Acquire a first head image of the driver, and acquire a second head image of the co-pilot; determining an overlapping area of ​​the first head image and the second head image; When the overlapping area is greater than an area threshold, it is determined that the line of sight is blocked.

11. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Determine the distance between the co-pilot and the co-pilot screen; When the distance is less than a distance threshold, it is determined that the line of sight is blocked.

12. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Determine whether the co-pilot is operating the co-pilot screen; When the co-pilot is operating the co-pilot screen, it is determined that the sight line is blocked.

13. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Get the positions of the driver's seat and the co-pilot's seat respectively; Determining the angle between the line between the driver's seat and the co-driver's seat and the horizontal direction of the vehicle body; When the included angle is greater than an angle threshold, it is determined that the line of sight is blocked.

14. The content display method according to any one of claims 1 to 8, characterized in that: The method further comprises: Detect whether the target event occurs; When the target event is detected, the following steps are executed: detecting whether the driver's line of sight of the first display screen is blocked; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.

15. The content display method according to any one of claims 1 to 8, characterized in that: The method further comprises: When a target event is detected, the second display screen is controlled to display the content of the first display screen; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.

16. A content display system, characterized in that: The content display system at least includes: a first display screen, a second display screen, a controller and a camera outside the vehicle body; The vehicle body exterior camera is used to capture images of the vehicle body exterior; The controller is used to: detect whether the driver's line of sight to the first display screen is blocked, the first display screen is located on the right side of the driver; when it is detected that the driver's line of sight to the first display screen is blocked, determine the second display screen associated with the first display screen; control the second display screen to display the content of the first display screen; the content of the first display screen is the image content captured by the camera on the outside of the vehicle body.

17. The content display system according to claim 16, characterized in that: A first camera is integrated under the first display screen; The first camera is used to capture the image of the first driver; The controller is used to obtain the first driver image, detect whether a target part of the driver is blocked based on the first driver image, and determine that the line of sight is blocked when the target part is blocked.

18. The content display system according to claim 16, characterized in that: A first camera is integrated under the first display screen; The first camera is used to capture a first head image of the driver and a second head image of the co-driver; The controller is used to obtain the first head image and the second head image, determine an overlapping area between the first head image and the second head image, and determine that the line of sight is blocked when the overlapping area is greater than an area threshold.

19. The content display system according to claim 17, characterized in that: The first camera is located on the right side below the first display screen.

20. The content display system according to claim 16, characterized in that: A second camera is integrated under the second display screen; The second camera is used to capture the image of the second driver; The controller is used to detect whether the driver status meets a second preset condition based on the second driver image.

21. The content display system according to any one of claims 16 to 20, characterized in that: The second display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.

22. The content display system according to any one of claims 16 to 20, characterized in that: The first display screen is a rearview mirror display screen.

23. A content display method, characterized in that: The method comprises: Detect whether the driver's current line of sight is looking outside the vehicle; When it is detected that the current sight line of the driver is to look outside the vehicle, determining the in-vehicle display screen; Control the in-vehicle display screen to display information outside the vehicle.

24. The content display method according to claim 23, characterized in that: The method further comprises: When it is detected that the driver's current line of sight is to look outside the vehicle, determining a display mode of the display screen inside the vehicle; Controlling the in-vehicle display screen to display information outside the vehicle, including: Control the in-vehicle display screen to display the outside-vehicle information according to the display mode; wherein the display mode includes: a first display mode or a second display mode; the first display mode is: a display mode in which the information displayed on the in-vehicle display screen is hidden and the outside-vehicle information is displayed; the second display mode is: a display mode in which the outside-vehicle information and part of the information displayed on the in-vehicle display screen are displayed.

25. The content display method according to claim 23 or 24, characterized in that: The method further comprises: When it is detected that the driver's current line of sight is not the line of sight to view outside the vehicle, the in-vehicle display screen is controlled to no longer display the outside-vehicle information.

26. A content display system, characterized in that: The content display system at least includes: an in-vehicle display screen, a controller and a camera outside the vehicle body; The vehicle body exterior camera is used to capture images of the vehicle body exterior; The controller is used to: Detect whether the driver's current line of sight is looking outside the vehicle; When it is detected that the driver's current line of sight is to look outside the vehicle, the in-vehicle display screen is determined; the in-vehicle display screen is controlled to display information outside the vehicle; the information outside the vehicle is image information collected by the camera outside the vehicle body.

27. The content display system according to claim 26, characterized in that: A third camera is integrated under the in-vehicle display screen; The third camera is used to collect the image of the third driver; The controller is used to obtain the third driver image and detect, based on the third driver image, whether the driver's current line of sight is a line of sight looking outside the vehicle.

28. The content display system according to claim 26 or 27, characterized in that: The in-vehicle display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.

29. A vehicle, characterized in that: The vehicle includes a controller, and the controller is used to execute the steps of the content display method according to any one of claims 1 to 15 or to execute the steps of the content display method according to any one of claims 23 to 25.

30. An electronic device, characterized in that: It includes a processor and a memory, the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, it implements the steps of the content display method as described in any one of claims 1 to 15 or implements the steps of the content display method as described in any one of claims 23 to 25.

Citation Information

Cited By

  • Content display method and system, and vehicle and electronic device

    EP4769114A1