METHODS AND SYSTEMS FOR DISPLAYING CONTENT, AND ELECTRONIC DEVICES
Patent Information
- Authority / Receiving Office
- VN · VN
- Patent Type
- Applications
- Current Assignee / Owner
- BOE TECHNOLOGY GROUP CO LTD
- Filing Date
- 2024-09-18
- Publication Date
- 2026-06-15
AI Technical Summary
During driving, the driver's line of sight may be blocked and the electronic rearview mirror display cannot be viewed, affecting driving safety.
By detecting whether the driver's line of sight of the first display screen is blocked, and when necessary, control the second display screen to display the content of the first display screen, ensuring that the driver can view the target content without obstruction.
It effectively avoids the problem that the driver cannot view the electronic rearview mirror due to his visual line being blocked during driving, and improves driving safety.
Smart Images

Figure VN1202603183_0
Abstract
Description
Content display method, system, vehicle and electronic equipment
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on September 25, 2023, with application number 202311247687.4 and entitled “A content display method, system, vehicle and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The embodiments of the present application relate to the field of image display technology, and in particular to a content display method, system, vehicle, and electronic device. Background Art
[0004] As cars continue to evolve toward electronic and intelligent technology, in-vehicle displays have also undergone significant changes. As shown in Figure 1, the development of smart cockpits has evolved from dual-screen and triple-screen displays to multi-screen displays. Currently, multi-screen in-vehicle displays can include instrument displays, main control displays, entertainment displays, and electronic rearview mirror displays. Among them, electronic rearview mirrors (Camera Monitor Systems, CMS) are a recent product. Compared to traditional physical mirrors, electronic rearview mirrors offer advantages such as a wider field of view, reduced blind spots, automatic light compensation, and reduced environmental impact. They also effectively reduce wind resistance and wind noise, achieving energy conservation and emission reductions. Currently, electronic rearview mirrors are already available in vehicles.
[0005] The electronic rearview mirror consists of two parts: a camera and a display. The rearview mirror displays are located on the driver's left and the passenger's right. Under normal circumstances, as shown in Figure 2, the driver can see real-time images of the left and right sides of the vehicle through the left and right rearview mirror displays (i.e., the left and right rearview screens). However, in some situations, the driver's vision may be blocked, making it impossible to see the rearview mirror displays, thus affecting driving safety.
[0006] Therefore, there is an urgent need for a new content display method to avoid interference with the driver's vision of the electronic rearview mirror and improve driving safety.
[0007] Summary of the Invention
[0008] The embodiments of the present application provide a content display method, system, vehicle, and electronic device to at least partially solve the problems existing in the related art.
[0009] A first aspect of an embodiment of the present application provides a content display method, the method comprising:
[0010] detecting whether a driver's line of sight to a first display screen is blocked, the first display screen being located to the right of the driver;
[0011] When it is detected that the driver's line of sight of the first display screen is blocked, determining a second display screen associated with the first display screen;
[0012] Control the second display screen to display the content of the first display screen.
[0013] Optionally, the method further includes:
[0014] Control the second display screen to adjust its angle.
[0015] Optionally, controlling the second display screen to adjust its angle includes at least one of the following:
[0016] Controlling the second display screen to deflect to the left according to a preset angle;
[0017] The sum of the angle of the second display screen and the angle of the first display screen is controlled to be 180 degrees.
[0018] Optionally, the method further includes:
[0019] The display parameter value of the second display screen is adjusted according to the display parameter value of the first display screen.
[0020] Optionally, adjusting the display parameter value of the second display screen according to the display parameter value of the first display screen includes at least one or more of the following:
[0021] controlling the brightness value of the second display screen according to the brightness value of the first display screen;
[0022] controlling the aspect ratio of the second display screen according to the aspect ratio of the first display screen;
[0023] The refresh rate of the second display screen is controlled according to the refresh rate of the first display screen.
[0024] Optionally, the method further includes:
[0025] When detecting that the driver's line of sight to the first display screen is blocked, determining a degree of blocking of the line of sight, wherein the degree of blocking is used to characterize the situation in which the visual field range of the line of sight is blocked;
[0026] When it is detected that the driver's line of sight of a first display screen is blocked, determining a second display screen associated with the first display screen includes:
[0027] In a case where the occlusion degree exceeds a first occlusion degree threshold, determining that the second display screen is: a third display screen;
[0028] When the degree of occlusion exceeds a second occlusion degree threshold, the second display screen is determined to be: a fourth display screen, the second occlusion degree threshold is greater than the first occlusion degree threshold, and the fourth display screen is a display screen closer to the driver than the third display screen.
[0029] Optionally, the method further includes:
[0030] When detecting that the driver's line of sight to the first display screen is blocked, determining a degree of blocking of the line of sight, wherein the degree of blocking is used to characterize the situation in which the visual field range of the line of sight is blocked;
[0031] Controlling the second display screen to display the content of the first display screen includes:
[0032] When the occlusion degree exceeds a third occlusion degree threshold, controlling the first display area of the second display screen to display the content of the first display screen;
[0033] When the degree of occlusion exceeds the fourth degree of occlusion threshold, the second display area of the second display screen is controlled to display the content of the first display screen, the third degree of occlusion threshold is greater than the fourth degree of occlusion threshold, and the first display area is a display area closer to the driver than the second display area.
[0034] Optionally, when it is detected that the driver's line of sight to the first display screen is blocked, the method further includes:
[0035] Determining a blocking time of the target sight line being blocked, and / or determining a number of blocking times of the target sight line being blocked;
[0036] When the blocking time exceeds a time threshold and / or the number of blocking times exceeds a number threshold, determining that the content of the first display screen needs to be displayed on the second display screen;
[0037] Determining a second display screen associated with the first display screen includes:
[0038] In case it is determined that the content of the first display screen needs to be displayed via the second display screen, the step of determining a second display screen associated with the first display screen is performed.
[0039] Optionally, detecting whether the driver's line of sight to the first display screen is blocked includes:
[0040] Acquire a first driver image captured for the driver;
[0041] detecting, based on the first driver image, whether a target part of the driver is blocked;
[0042] When the target part is blocked, it is determined that the sight line is blocked.
[0043] Optionally, detecting whether the driver's line of sight to the first display screen is blocked includes:
[0044] Acquire a first head image of the driver and acquire a second head image of the co-pilot;
[0045] determining an overlapping area between the first head image and the second head image;
[0046] When the overlapping area is greater than an area threshold, it is determined that the line of sight is blocked.
[0047] Optionally, detecting whether the driver's line of sight to the first display screen is blocked includes:
[0048] Determine the distance between the co-pilot and the co-pilot screen;
[0049] When the distance is less than a distance threshold, it is determined that the line of sight is blocked.
[0050] Optionally, detecting whether the driver's line of sight to the first display screen is blocked includes:
[0051] Determine whether the co-pilot is operating the co-pilot screen;
[0052] When the co-pilot is operating the co-pilot screen, it is determined that the sight is blocked.
[0053] Optionally, detecting whether the driver's line of sight to the first display screen is blocked includes:
[0054] Get the positions of the driver's seat and the co-pilot's seat respectively;
[0055] Determining the angle between the line connecting the driver's seat and the passenger seat and the horizontal direction of the vehicle body;
[0056] When the included angle is greater than an angle threshold, it is determined that the line of sight is blocked.
[0057] Optionally, the method further includes:
[0058] Detect whether the target event occurs;
[0059] When the target event is detected, the steps are executed: detecting whether the driver's view of the first display screen is blocked; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.
[0060] Optionally, the method further includes:
[0061] When a target event is detected, the second display screen is controlled to display the content of the first display screen; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.
[0062] A second aspect of an embodiment of the present application provides a content display system, the system comprising at least: a first display screen, a second display screen, a controller, and a vehicle body exterior camera;
[0063] The vehicle body exterior camera is used to capture images of the vehicle body exterior;
[0064] The controller is used to:
[0065] Detect whether the driver's view of the first display screen is blocked, the first display screen is located on the right side of the driver; when it is detected that the driver's view of the first display screen is blocked, determine the second display screen associated with the first display screen; control the second display screen to display the content of the first display screen; the content of the first display screen is the image content captured by the camera on the outside of the vehicle body.
[0066] Optionally, a first camera is integrated under the first display screen;
[0067] The first camera is used to capture an image of the first driver;
[0068] The controller is configured to obtain the first driver image, detect whether a target part of the driver is blocked based on the first driver image, and determine that the line of sight is blocked if the target part is blocked.
[0069] Optionally, a first camera is integrated under the first display screen;
[0070] The first camera is used to capture a first head image of the driver and a second head image of the co-driver;
[0071] The controller is configured to obtain the first head image and the second head image, determine an overlapping area between the first head image and the second head image, and determine that the line of sight is blocked if the overlapping area is greater than an area threshold.
[0072] Optionally, the first camera is located on the right side below the first display screen.
[0073] Optionally, a second camera is integrated under the second display screen;
[0074] The second camera is used to capture an image of the second driver;
[0075] The controller is used to detect whether the driver status meets a second preset condition based on the second driver image.
[0076] Optionally, the second display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.
[0077] Optionally, the first display screen is a rearview mirror display screen.
[0078] A third aspect of the present application provides a content display method, the method comprising:
[0079] Detect whether the driver's current line of sight is looking outside the vehicle;
[0080] determining an in-vehicle display screen when detecting that the driver's current line of sight is looking outside the vehicle;
[0081] Control the in-vehicle display screen to display information outside the vehicle.
[0082] Optionally, the method further includes:
[0083] determining a display mode of a display screen inside the vehicle when detecting that the driver's current line of sight is looking outside the vehicle;
[0084] Controlling the in-vehicle display screen to display information outside the vehicle includes:
[0085] Control the in-vehicle display screen to display the outside-vehicle information according to the display mode; wherein, the display mode includes: a first display mode or a second display mode; the first display mode is: a display mode that hides the information displayed on the in-vehicle display screen and displays the outside-vehicle information; the second display mode is: a display mode that displays the outside-vehicle information and part of the information displayed on the in-vehicle display screen.
[0086] Optionally, the method further includes:
[0087] When it is detected that the driver's current line of sight is not directed toward the outside of the vehicle, the in-vehicle display screen is controlled to no longer display the outside-vehicle information.
[0088] A fourth aspect of the embodiments of the present application provides a content display system, the system comprising at least: an in-vehicle display screen, a controller, and a camera on the outside of the vehicle body;
[0089] The vehicle body exterior camera is used to capture images of the vehicle body exterior;
[0090] The controller is used to:
[0091] Detect whether the driver's current line of sight is looking outside the vehicle;
[0092] When it is detected that the driver's current line of sight is looking outside the vehicle, the in-vehicle display screen is determined; the in-vehicle display screen is controlled to display information outside the vehicle; the information outside the vehicle is image information collected by the camera outside the vehicle body.
[0093] Optionally, a third camera is integrated under the in-vehicle display screen;
[0094] The third camera is used to capture an image of the third driver;
[0095] The controller is used to obtain the third driver image and detect whether the driver's current line of sight is looking outside the vehicle based on the third driver image.
[0096] Optionally, the in-vehicle display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.
[0097] A fifth aspect of an embodiment of the present application provides a vehicle, comprising a controller configured to execute the steps of the content display method described in the first aspect of the present application or the steps of the content display method described in the third aspect of the present application.
[0098] In a sixth aspect of an embodiment of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps in the content display method described in the first aspect of the present application or the steps in the content display method described in the third aspect of the present application are implemented.
[0099] In an embodiment of the present application, it is possible to detect whether the driver's line of sight to the first display screen is blocked. When it is detected that the driver's line of sight to the first display screen is blocked, a second display screen associated with the first display screen can be determined and the second display screen can be controlled to display the content of the first display screen. In this way, when the driver's line of sight to the right target screen is blocked, the driver can view the content of the right target screen through other display screens, thereby ensuring that the driver's line of sight to the target content is no longer disturbed during driving, and the driver can view the target content without obstruction, thereby improving driving safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0100] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0101] FIG1 is a schematic diagram of a smart cockpit display module provided in an embodiment of the present application;
[0102] FIG2 is a schematic diagram of a driver viewing a display screen under normal circumstances, provided by an embodiment of the present application;
[0103] FIG3 is a schematic diagram of a driver viewing a display screen when his or her vision is blocked, provided by an embodiment of the present application;
[0104] FIG4 is a schematic diagram of another embodiment of the present application showing a driver viewing a display screen when his or her vision is blocked;
[0105] FIG5 is a flow chart of a content display method according to an embodiment of the present application;
[0106] FIG6 is a schematic diagram of adjusting a display screen provided by an embodiment of the present application;
[0107] FIG7 is a schematic diagram of adjusting a display screen provided by another embodiment of the present application;
[0108] FIG8 is a schematic diagram of a target content display method provided in an embodiment of the present application;
[0109] FIG9 is a schematic diagram of a target content display method provided by another embodiment of the present application;
[0110] FIG10 is a schematic diagram of determining target sight obstruction according to an embodiment of the present application;
[0111] FIG11 is a schematic diagram of determining target sight obstruction according to an embodiment of the present application;
[0112] FIG12 is a schematic diagram of determining target sight obstruction according to an embodiment of the present application;
[0113] FIG13 is a flow chart of a method for displaying control target content based on driver perception according to an embodiment of the present application;
[0114] FIG14 is a schematic diagram of a line of sight obstruction determination according to an embodiment of the present application;
[0115] FIG15 is a schematic diagram of controlling the display of target content according to an embodiment of the present application;
[0116] FIG16 is a schematic diagram of controlling the display of target content according to an embodiment of the present application;
[0117] FIG17 is a flow chart of a method for displaying control target content based on co-pilot perception according to an embodiment of the present application;
[0118] FIG18 is a flow chart of a method for controlling target content display based on event sensing according to an embodiment of the present application;
[0119] FIG19 is a flow chart of a method for controlling target content display based on occlusion detection and judgment after event triggering according to an embodiment of the present application;
[0120] FIG20 is a flow chart of a method for controlling target content to be displayed on a passenger screen according to an embodiment of the present application;
[0121] FIG21 is a schematic diagram of controlling the display of target content according to an embodiment of the present application;
[0122] FIG22 is a schematic diagram of controlling the display of target content according to an embodiment of the present application;
[0123] FIG23 is a schematic diagram of a system architecture according to an embodiment of the present application;
[0124] FIG24 is a schematic diagram of a content display system provided in an embodiment of the present application;
[0125] FIG25 is a flowchart of a content display method according to an embodiment of the present application;
[0126] FIG26 is a schematic diagram of a content display method provided in an embodiment of the present application;
[0127] FIG27 is a schematic diagram of a content display method provided in an embodiment of the present application;
[0128] FIG28 is a schematic diagram of a content display system provided in accordance with an embodiment of the present application. Specific embodiments
[0129] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below with reference to the accompanying drawings and specific implementation methods.
[0130] As mentioned above, there may be a variety of situations in which the driver's line of sight is blocked and he cannot see the rearview mirror display screen. For example, the driver's line of sight to the right rear view screen is blocked by the front passenger while driving: in one case, as shown in Figure 3, the front passenger passenger leans forward, causing the driver's line of sight to the right rear view screen to be blocked; in another case, as shown in Figure 4, the front passenger passenger carries a large object, causing the driver's line of sight to the right rear view screen to be blocked, thereby affecting driving safety.
[0131] Therefore, in order to at least partially solve one or more of the above-mentioned problems and other potential problems, an embodiment of the present application proposes a display method for detecting whether the driver's line of sight to the first display screen is blocked. When it is detected that the driver's line of sight to the first display screen (for example, the rearview screen of the electronic rearview mirror, etc.) is blocked, the second display screen corresponding to the first display screen can be determined, thereby controlling the second display screen to display the content of the first display screen. In this way, when the driver's line of sight to the first display screen is blocked, the driver can view the content of the first display screen through other display screens other than the first display screen, namely the second display screen, thereby ensuring that the driver's line of sight to the target content (for example, the content displayed on the electronic rearview mirror, etc.) is no longer disturbed during driving, and the driver can view the target content without obstruction, thereby improving driving safety.
[0132] 5 , a flow chart of a content display method according to an embodiment of the present application is shown. The content display method provided by the embodiment of the present application can be applied to a controller, which can perform relevant control on an in-vehicle terminal and various components in the vehicle. The content display method may include the following steps:
[0133] S101, detecting whether a driver's line of sight of a first display screen is blocked, where the first display screen is located on the right side of the driver.
[0134] While the vehicle is in motion, the driver can view content displayed on a first display screen, wherein the first display screen is the in-vehicle display screen located on the driver's right side and currently being viewed by the driver. The first display screen can be any display screen for the driver to view driving-related information, for example, a main control screen, a central control screen, a passenger screen, an electronic rearview screen, etc., and this embodiment of the present application is not limited thereto. In this embodiment of the present application, whether the driver's view of the first display screen is blocked can be detected in real time.
[0135] S102: When it is detected that the driver's line of sight of the first display screen is blocked, determine a second display screen associated with the first display screen.
[0136] In an embodiment of the present application, when it is detected that the driver's line of sight to a first display screen is blocked, a second display screen associated with the first display screen may be determined. The second display screen determined in this embodiment when the line of sight is blocked may be any one or more in-vehicle display screens other than the first display screen.
[0137] S103: Control the second display screen to display the content of the first display screen.
[0138] In the embodiment of the present application, after determining the second display screen associated with the first display screen, the second display screen can be controlled to display the content displayed on the first display screen.
[0139] Therefore, in the embodiment of the present application, if it is detected that the driver's view of the first display screen is blocked, the corresponding second display screen can be determined and the second display screen can be controlled to display the content of the first display screen. In this way, if the driver's view of the first display screen on the right is blocked, the content of the first display screen can be viewed through the second display screen inside the vehicle, thereby ensuring that the driver's view of the target content is not disturbed while driving, and can view the target content without obstruction, thereby improving driving safety.
[0140] In combination with the above embodiments, an embodiment of the present application provides a content display method, which may further include the following steps:
[0141] S201: Control the second display screen to adjust its angle.
[0142] In an embodiment of the present application, the controller can adjust the actual hardware angle of the second display screen before, after, or at the same time as controlling the second display screen to display the content of the first display screen, so that the driver can more clearly see the content of the first display screen displayed on the second display screen.
[0143] That is to say, this embodiment can execute step S201 first and then step S103, or execute step S103 first and then step S201, or execute step S201 and step S103 at the same time. This embodiment does not impose any limitation on the execution order between step S201 and step S103.
[0144] In combination with the above embodiments, an embodiment of the present application provides a content display method, in which the above S201 may include at least one of the following:
[0145] S2011: Control the second display screen to deflect to the left according to a preset angle.
[0146] In this embodiment, a preset angle of the second display screen can be set in advance, so as to control the second display screen to deflect to the left according to the preset angle before, after, or simultaneously with controlling the second display screen to display the content of the first display screen. The specific value of the preset angle is not limited and can be arbitrarily specified as needed.
[0147] Accordingly, this embodiment may execute step S2011 first and then step S103, or may execute step S103 first and then step S2011, or may execute step S2011 and step S103 simultaneously. This embodiment does not impose any limitation on the execution order between step S2011 and step S103.
[0148] For example, as shown in Figure 6, which is a schematic diagram of a display screen adjustment according to an embodiment of the present application, in this embodiment, the first display screen is the right rearview screen, and the second display screen is the main control screen. Before, after, or simultaneously with controlling the second display screen to display the content of the first display screen, the main control screen can be controlled to deflect to the left according to a pre-set deflection angle, allowing the driver to more clearly view the content of the first display screen displayed on the second display screen.
[0149] S2012: Control the sum of the angle of the second display screen and the angle of the first display screen to be 180 degrees.
[0150] In this embodiment, before, after, or at the same time as controlling the second display screen to display the content of the first display screen, the sum of the angles of the second display screen and the first display screen can be controlled to be 180 degrees to ensure that the first display screen and the second display screen are in a symmetrical relationship, so that the driver can more clearly view the content of the first display screen displayed on the second display screen.
[0151] Accordingly, this embodiment may execute step S2012 first and then step S103, or may execute step S103 first and then step S2012, or may execute step S2012 and step S103 simultaneously. This embodiment does not impose any limitation on the execution order between step S2012 and step S103.
[0152] In combination with the above embodiments, an embodiment of the present application provides a content display method, which may further include the following steps:
[0153] S301: adjusting the display parameter value of the second display screen according to the display parameter value of the first display screen.
[0154] In an embodiment of the present application, before, after, or at the same time as controlling the second display screen to display the content of the first display screen, the display parameter values of the second display screen can be adjusted to a certain extent according to the display parameter values of the first display screen. The display parameters include at least one or more of the following: display brightness, display contrast, aspect ratio, and refresh rate. This enables the driver to more clearly view the target content displayed on the second display screen. In addition, by adjusting the display parameters of the second display screen according to the parameters of the first display screen, the driver's consistent visual perception can be maintained, thereby improving the driver's experience.
[0155] In this embodiment, step S301 may be executed first and then step S103, or step S103 may be executed first and then step S301, or step S301 and step S103 may be executed simultaneously. This embodiment does not impose any limitation on the execution order between step S301 and step S103.
[0156] Specifically, in one embodiment, the above S301 includes at least one or more of the following:
[0157] S3011: Control the brightness value of the second display screen according to the brightness value of the first display screen.
[0158] Generally speaking, the brightness of the first display screen, such as the rearview screen, is brighter. Therefore, this embodiment can control the brightness value of the second display screen according to the brightness value of the first display screen, such as increasing the brightness value of the second display screen, maintaining a consistent visual perception for the driver, and improving the driver's experience.
[0159] S3012: Control the aspect ratio of the second display screen according to the aspect ratio of the first display screen.
[0160] Generally speaking, the aspect ratio of the first display screen, such as the rearview screen, is shorter horizontally and longer vertically, while the aspect ratio of the second display screen is generally longer horizontally and shorter vertically. Therefore, this embodiment can control the aspect ratio of the second display screen according to the aspect ratio of the first display screen, such as scaling the second display screen, or splitting the second display screen so that the aspect ratio of one of the split screens is consistent with the aspect ratio of the first display screen, etc., so as to maintain a consistent visual perception of the driver and enhance the driver's experience.
[0161] S3013: Control the refresh rate of the second display screen according to the refresh rate of the first display screen.
[0162] Generally speaking, the refresh rate of the first display screen, such as the rearview screen, is higher. In order to avoid delays in the second display screen displaying the content of the first display screen, this embodiment can control the refresh rate of the second display screen according to the refresh rate of the first display screen, such as increasing the refresh rate of the second display screen, maintaining a consistent visual perception for the driver, and improving the driver's experience.
[0163] Accordingly, in this embodiment, any one or more of steps S3011-S3013 may be executed first, and then step S103; step S103 may be executed first, and then any one or more of steps S3011-S3013; step S301 and any one or more of steps S3011-S3013 may also be executed simultaneously; this embodiment does not impose any restrictions on the execution order between any one or more of steps S3011-S3013, and the execution order between any one or more of steps S3011-S3013 and step S103.
[0164] For example, as shown in Figure 7, Figure 7 is a schematic diagram of display screen adjustment provided by another embodiment of the present application. In this embodiment, the first display screen is the right rear view screen, and the second display screen is the main control screen. After, before, or simultaneously with controlling the main control screen to display the content of the right rear view screen, the display brightness and / or display contrast of the main control screen can be adjusted, for example, by increasing the display brightness and increasing the display contrast, so that the driver can more clearly see the content of the first display screen displayed on the second display screen.
[0165] In one embodiment, before, after, or at the same time as controlling the second display screen to display the content of the first display screen, both the angle of the second display screen and the display parameter value of the second display screen can be adjusted, thereby further enabling the driver to more clearly view the content of the first display screen displayed on the second display screen, maintaining a consistent visual perception for the driver and enhancing the driver's experience.
[0166] In combination with the above embodiments, an embodiment of the present application provides a content display method. In this method, in addition to the above steps, step S401 may be included, and step S102 may include sub-steps S402 and S403:
[0167] S401: When it is detected that the driver's line of sight when viewing the first display screen is blocked, determine the degree of blocking of the line of sight.
[0168] In an embodiment of the present application, when it is detected that the driver's line of sight to the first display screen is blocked, the degree of obstruction of the driver's line of sight can be determined; wherein, the degree of obstruction is used to characterize the situation where the field of view of the driver is blocked, for example, the degree of obstruction can be a blocking angle or a blocking percentage, etc., and there is no limitation on this.
[0169] S402: When the occlusion degree exceeds a first occlusion degree threshold, determine that the second display screen is a third display screen.
[0170] In an embodiment of the present application, an occlusion degree threshold is pre-set for dividing the occlusion degree, and the occlusion degree threshold includes: a first occlusion degree and a second occlusion degree, wherein the second occlusion degree threshold is greater than the first occlusion degree threshold.
[0171] The controller can compare the determined occlusion degree with the occlusion degree threshold, and when it is determined that the occlusion degree exceeds the first occlusion degree threshold and is less than the second occlusion degree threshold, determine the second display screen as: the third display screen, thereby displaying the content of the first display screen through the third display screen.
[0172] S403: When the occlusion degree exceeds a second occlusion degree threshold, determine that the second display screen is: a fourth display screen.
[0173] In this embodiment of the present application, if the degree of obstruction is determined to exceed a second obstruction threshold, the second display screen may be determined to be a fourth display screen, thereby displaying the content of the first display screen on the fourth display screen. The second display screen in this embodiment includes at least a third display screen and a fourth display screen, with the fourth display screen being closer to the driver than the third display screen.
[0174] For example, as shown in Figure 8, which is a schematic diagram of a target content display method provided by an embodiment of the present application. In this embodiment, the first display screen is the right rear view screen, and the first occlusion threshold is 20%. If the occlusion level is determined to exceed 20%, the second display screen is determined to be the third display screen, i.e., the passenger screen, and the content of the right rear view screen is projected onto the passenger screen, allowing the driver to view the content of the right rear view screen through the passenger screen.
[0175] As shown in Figure 9, Figure 9 is a schematic diagram of a method for displaying target content according to another embodiment of the present application. In this embodiment, the first display screen is the right rearview screen, and the second occlusion threshold is 50%. If the occlusion exceeds 50%, the second display screen is determined to be the fourth display screen, i.e., the main control screen, and the target content is projected onto the main control screen, allowing the driver to view the content of the right rearview screen through the main control screen. The main control screen is closer to the driver than the passenger screen.
[0176] In this way, through the embodiment of the present application, the content of the first display screen can be projected onto different display screens based on the different degrees of occlusion. The greater the degree of occlusion, the target content will be displayed on the second display screen that is closer to the driver's position, thereby further improving the driver's viewing experience of the target content while ensuring that the driver can view the target content without occlusion.
[0177] In combination with the above embodiment, in another embodiment, the present application provides a content display method. In this method, in addition to the above steps, step S501 may be included, and the step S103 may include sub-steps S502 and S503:
[0178] S501: When it is detected that the driver's line of sight when viewing the first display screen is blocked, determine the degree of blocking of the line of sight.
[0179] In an embodiment of the present application, when it is detected that the driver's line of sight to the first display screen is blocked, the degree of obstruction of the driver's line of sight can be determined; wherein, the degree of obstruction is used to characterize the situation where the field of view of the driver is blocked, for example, the degree of obstruction can be a blocking angle or a blocking percentage, etc., and there is no limitation on this.
[0180] S502: When the occlusion degree exceeds a third occlusion degree threshold, control the first display area of the second display screen to display the content of the first display screen.
[0181] In an embodiment of the present application, an occlusion degree threshold is pre-set for dividing the occlusion degree, and the occlusion degree threshold may include: a third occlusion degree and a fourth occlusion degree, wherein the third occlusion degree threshold is greater than the fourth occlusion degree threshold.
[0182] The controller may compare the determined occlusion degree with an occlusion degree threshold, and when it is determined that the occlusion degree exceeds a third occlusion degree threshold, control the first display area in the second display screen to display the content of the first display screen.
[0183] S503: When the occlusion degree exceeds a fourth occlusion degree threshold, control the second display area of the second display screen to display the content of the first display screen.
[0184] In this embodiment of the present application, if it is determined that the degree of obstruction exceeds the fourth obstruction degree threshold and is less than the third obstruction degree threshold, the second display area of the second display screen can be controlled to display the content of the first display screen. In this embodiment, the first display area is a display area closer to the driver than the second display area. That is, the first display area of the second display screen is closer to the driver's position than the second display area of the second display screen.
[0185] For example, in one embodiment, the first display screen is the right rearview screen, and the second display screen is the main control screen or the passenger screen, etc. Depending on the degree of occlusion, the content of the first display screen can be projected to different positions of the main control screen or the passenger screen. When the degree of occlusion is greater than the fourth occlusion threshold of 20%, the content of the right rearview mirror is projected to the second display area of the main control screen or the passenger screen, that is, the right side of the main control screen or the passenger screen; when the degree of occlusion is greater than the third occlusion threshold of 50%, the content of the right rearview mirror is projected to the first display area of the main control screen or the passenger screen, that is, the left side of the main control screen or the passenger screen. The left side of the main control screen or the passenger screen is closer to the driver's position than the right side of the main screen or the passenger screen.
[0186] In this way, through the embodiment of the present application, the content of the first display screen can be projected to different positions of the second display screen based on the different degrees of occlusion. The greater the degree of occlusion, the target content is displayed in the display area closer to the driver's position, thereby further improving the driver's viewing experience of the target content while ensuring that the driver can view the target content without obstruction.
[0187] In combination with the above embodiments, an embodiment of the present application provides a content display method. In this method, in addition to the above steps, when it is detected that the driver's line of sight of the first display screen is blocked, steps S601 and S602 may be further included. Moreover, the "determining a second display screen associated with the first display screen" in step S102 may include sub-step S603:
[0188] S601: Determine the blocking time of the sight line, and / or determine the number of blocking times of the sight line.
[0189] In the embodiment of the present application, a time threshold and a number threshold are pre-set. The time threshold is the maximum duration that the driver's view of the first display screen is blocked within the permitted range, and the number threshold is the maximum number of times the driver's view of the first display screen is blocked within the permitted range. When it is detected that the driver's view of the first display screen is blocked, the blocking time and / or the number of times the driver's view of the first display screen is blocked can also be determined.
[0190] S602: When the blocking time exceeds a time threshold and / or the blocking times exceeds a times threshold, determine that the content of the first display screen needs to be displayed on the second display screen.
[0191] In the embodiment of the present application, after determining the occlusion time and / or the number of occlusions, the occlusion time can be compared with a time threshold and / or the number of occlusions can be compared with a number threshold. If it is determined that the occlusion time exceeds the time threshold and / or the number of occlusions exceeds the number threshold, the controller determines that the content of the first display screen needs to be displayed on the second display screen.
[0192] That is to say, in this embodiment, when it is determined that the obstruction time does not exceed the time threshold, and / or the number of obstructions does not exceed the number threshold, it means that the line of sight obstruction is very short and infrequent, and the driver can continue to see the target content by watching the first display screen. At this time, the target content can continue to be displayed through the first display screen, and there is no need to display the target content through the second display screen.
[0193] S603: When it is determined that the content of the first display screen needs to be displayed on the second display screen, the step of determining a second display screen associated with the first display screen is executed.
[0194] In an embodiment of the present application, when the controller determines that the content of the first display screen needs to be displayed through the second display screen, it can determine the second display screen associated with the first display screen, that is, it can execute the step of determining the second display screen associated with the first display screen.
[0195] In this embodiment, the screen is no longer projected for display as soon as there is an occlusion. Instead, it can be further determined whether a second display screen is needed to display the target content based on the time and number of occlusions. In this way, occasional occlusions can be eliminated by time and number of times, and the driver's driving experience can be further improved based on the actual situation of the occlusion.
[0196] In combination with the above embodiments, an embodiment of the present application provides a content display method. In this method, the above step S101 may include the following steps:
[0197] S701: Acquire a first driver image collected from the driver.
[0198] In the embodiment of the present application, the first display screen is the right rear view screen. The right rear view screen is integrated with a camera. The camera can capture an image of the driver to obtain a first driver image. The controller can obtain the first driver image for analysis and processing. The camera integrated into the right rear view screen can be an under-screen camera, and the camera's position within the right rear view screen is not limited.
[0199] S702: Detect, based on the first driver image, whether a target part of the driver is blocked.
[0200] In an embodiment of the present application, a target part of the driver can be detected based on the first driver image to detect whether the target part of the driver is blocked, wherein the target part can be a characteristic part of the driver, such as the head, eyes, glasses, etc.
[0201] For example, when the target part is the driver's head, it can be determined based on the first driver image whether the complete driver's head can be detected. If the complete driver's head can be obtained, it is determined that the target part is not obscured. If the complete driver's head cannot be obtained, it is determined that the target part is obscured.
[0202] When the target part is the driver's ear, it can be determined based on the first driver image whether the driver's ear can be detected. If the driver's ear can be obtained, it is determined that the target part is not blocked. If the driver's ear cannot be obtained, it is determined that the target part is blocked.
[0203] S703: When the target part is blocked, determine that the target sight is blocked.
[0204] In the embodiment of the present application, when it is determined that the target portion is blocked, it can be determined that the driver's line of sight of viewing the first display screen is blocked.
[0205] In an embodiment of the present application, the driver's line of sight obstruction to the right rear view screen can be detected based on the camera integrated in the first display screen, so as to accurately determine the line of sight obstruction by detecting the target part from the perspective of the first display screen.
[0206] In combination with any of the above embodiments, a content display method according to an embodiment of the present application, in which step S101 may include the following steps:
[0207] S801: Acquire a first head image of the driver and a second head image of the co-pilot.
[0208] In the embodiment of the present application, the first display screen is the right rear view screen. The right rear view screen is integrated with a camera that can cover the range of the driver and passenger seats. The under-screen camera can capture images of the driver and passenger seats in real time, obtaining a first head image of the driver and a second head image of the passenger. The controller can obtain the first head image of the driver and the second head image of the passenger for analysis and processing. The camera integrated into the right rear view screen can be an under-screen camera, and the location of the camera on the right rear view screen is not limited.
[0209] S802: Determine an overlapping area between the first head image and the second head image.
[0210] S803: When the overlapping area is greater than an area threshold, determine that the sight line is blocked.
[0211] In this embodiment of the present application, after acquiring the first and second head images, the overlapping area between the first and second head images can be determined and compared with a pre-set area threshold. If the overlapping area is determined to be greater than the area threshold, it can be determined that the driver's view of the first display screen is obstructed. The area threshold in this embodiment is the maximum area of the driver's head obstructed by the co-pilot's head within the permissible range of the first display screen.
[0212] In an embodiment of the present application, the driver's target line of sight obstruction detection can be performed based on the camera integrated in the first display screen, so as to accurately determine the line of sight obstruction by detecting the overlapping area between the driver and the co-driver from the perspective of the first display screen.
[0213] In combination with any of the above embodiments, a content display method according to an embodiment of the present application, in which step S101 may include the following steps:
[0214] S901: Determine the distance between the co-pilot and the co-pilot screen.
[0215] In an embodiment of the present application, the first display screen is the right rear view screen. The controller can determine the distance between the co-pilot and the co-pilot screen, and thus determine whether the co-pilot blocks the driver's target line of sight of the right rear view screen based on the distance.
[0216] For example, in one embodiment, the distance between the co-driver and the co-driver screen can be determined by an in-vehicle sensor; or the feature information of the co-driver can be obtained by an under-screen camera of the co-driver screen, and then the distance between the co-driver and the co-driver screen can be determined by the feature information. This embodiment does not impose any restrictions on this.
[0217] S902: When the distance is less than a distance threshold, determine that the line of sight is blocked.
[0218] In this embodiment of the present application, a distance threshold is pre-set. The distance threshold is the minimum distance between the co-pilot and the passenger screen when the co-pilot does not block the driver's view. The controller can compare the acquired distance between the co-pilot and the passenger screen with the distance threshold. If it is determined that the distance is less than the distance threshold, it can be determined that the driver's view of the first display screen is blocked.
[0219] In one embodiment, the distance threshold can be determined based on the positional relationship between the driver and the co-pilot seat, and the distance threshold includes: a first threshold or a second threshold. When the driver's seat is behind the co-pilot seat in the horizontal direction inside the vehicle, the minimum distance between the co-pilot and the co-pilot screen when the co-pilot does not block the driver's line of sight is determined to be the first threshold; when the driver's seat is in front of the co-pilot seat in the horizontal direction inside the vehicle, the minimum distance between the co-pilot and the co-pilot screen when the co-pilot does not block the driver's line of sight is determined to be the second threshold, wherein the first threshold is greater than the second threshold.
[0220] Therefore, when performing distance comparison, as shown in Figure 10, Figure 10 is a schematic diagram of judging target visual line of sight obstruction provided by an embodiment of the present application. In Figure 10, in the horizontal direction in the vehicle, when the driver's seat is behind the co-pilot seat, the distance between the co-pilot and the co-pilot screen can be compared with the first threshold. When it is determined that the distance is less than the first threshold, it can be determined that the driver's line of sight to the first display screen is blocked.
[0221] As shown in Figure 11, Figure 11 is a schematic diagram of judging target visual obstruction provided by an embodiment of the present application. In Figure 11, in the horizontal direction in the vehicle, when the driver's seat is in front of the co-driver's seat, the distance between the co-driver and the co-driver screen can be compared with the second threshold. When it is determined that the distance is less than the second threshold, it can be determined that the driver's visual line of sight to the first display screen is blocked, wherein the second threshold is less than the first threshold.
[0222] In an embodiment of the present application, the driver's line of sight obstruction to the first display screen can be detected based on the distance between the co-driver and the co-driver screen, so as to accurately determine the line of sight obstruction based on the co-driver's in-car situation.
[0223] In combination with any of the above embodiments, a content display method according to an embodiment of the present application, in which step S101 may include the following steps:
[0224] S1001, determining whether the co-pilot is operating the co-pilot screen.
[0225] In this embodiment of the present application, the first display screen is the right rear view screen, and the controller can determine whether the co-pilot is currently operating the co-pilot screen based on the response information sent by the co-pilot screen. When the co-pilot is currently operating the co-pilot screen, the co-pilot screen can respond based on the user's operation and send the response information to the controller to notify the controller that the co-pilot is currently operating the co-pilot screen.
[0226] S1002: When the co-pilot is operating the co-pilot screen, it is determined that the sight line is blocked.
[0227] In the embodiment of the present application, since the co-pilot operates the co-pilot screen, the co-pilot usually needs to operate the screen at close range. Therefore, when the controller determines that the co-pilot is operating the co-pilot screen, it can be determined that the co-pilot is close to the co-pilot screen and may block the driver's view of the right rear screen. Therefore, in this case, this embodiment can directly determine that the driver's view of the first display screen is blocked, thereby ensuring to the greatest extent that the driver's view will not be blocked.
[0228] In an embodiment of the present application, the driver's line of sight obstruction to the first display screen can be detected based on the co-driver's operation of the co-driver's screen, so as to accurately determine the line of sight obstruction based on the co-driver's situation inside the car.
[0229] In combination with the above embodiments, in one implementation, the detection of obstruction of the driver's view of the first display screen is performed based on the co-pilot's operation of the co-pilot screen, and the detection of obstruction of the driver's view of the first display screen is performed in parallel with the detection of obstruction of the driver's view of the first display screen based on the distance between the co-pilot and the co-pilot screen.
[0230] In combination with any of the above embodiments, a content display method according to an embodiment of the present application, in which step S101 may include the following steps:
[0231] S1101, respectively obtain the positions of the driver's seat and the passenger seat.
[0232] S1102: Determine the angle between the line connecting the driver's seat and the passenger seat and the horizontal direction of the vehicle body.
[0233] In an embodiment of the present application, the positions of the driver's seat and the co-driver's seat can be respectively obtained by in-vehicle sensors, and then the angle between the line between the driver's seat and the co-driver's seat and the horizontal direction of the vehicle body can be determined.
[0234] S1103: When the included angle is greater than an angle threshold, determine that the line of sight is blocked.
[0235] In an embodiment of the present application, an angle threshold is set in advance. After obtaining the angle between the line connecting the driver's seat and the co-pilot seat and the horizontal direction of the vehicle body, the controller can compare the angle with the angle threshold. When it is determined that the angle between the line connecting the driver's seat and the co-pilot seat and the horizontal direction of the vehicle body is greater than the angle threshold, it can be determined that the driver's view of the first display screen is blocked.
[0236] For example, as shown in Figure 12, Figure 12 is a schematic diagram of determining target visual obstruction provided in an embodiment of the present application. In Figure 12, the controller can obtain the positions of the driver's seat and the passenger seat, and determine whether the angle between the line connecting the two and the horizontal direction of the vehicle body (i.e., the obstruction angle in Figure 12) is greater than the angle threshold. If the angle is greater than the angle threshold (such as 10 degrees), it is determined that the driver's view of the first display screen is blocked.
[0237] In combination with any of the above embodiments, a content display method according to an embodiment of the present application may further include the following steps in addition to the above steps:
[0238] S1201: Detect whether a target event occurs.
[0239] In this embodiment of the present application, the controller can also monitor target events to detect in real time whether the target event has occurred. The target event is an event requiring the driver to view the first display screen and / or an emergency event occurring during driving. The occurrence of the target event includes at least one of the following: the vehicle state satisfies a first preset condition, or the driver state satisfies a second preset condition; the occurrence of the target event indicates that the driver intends to view the first display screen.
[0240] S1202, when the target event is detected, executing the step of detecting whether the driver's sight of the first display screen is blocked.
[0241] In an embodiment of the present application, when the occurrence of a target event is detected, that is, when it is determined that the driver has the intention to view the first display screen, the above method will be used to start the relevant detection of whether the driver's line of sight to the first display screen is blocked, so as to more accurately judge whether the driver's line of sight is blocked. In addition, the power consumption of the device corresponding to the detection of the driver's line of sight to the first display screen can be reduced to avoid being in a working state all the time. Only when the occurrence of the target event is detected will the device be activated for occlusion judgment.
[0242] In combination with any of the above embodiments, a content display method according to an embodiment of the present application may further include the following steps in addition to the above steps:
[0243] S1301: When a target event is detected, control the second display screen to display the content of the first display screen.
[0244] In the embodiments of the present application, not only is the second display screen controlled to display the contents of the first display screen when it is detected that the driver's view of the first display screen is blocked, but also a target event can be detected, and when the target event is detected, the second display screen can be controlled to display the contents of the first display screen. The target event is an event that requires the driver to view the first display screen and / or an emergency event that occurs during driving. The occurrence of the target event includes at least one of the following: the vehicle state meets a first preset condition, the driver state meets a second preset condition; the occurrence of the target event indicates that the driver has the intention to view the first display screen.
[0245] In addition, in one embodiment, the target event may further include: the co-pilot state meets a third preset condition, wherein the co-pilot state meeting the third preset condition at least includes: the co-pilot closing his eyes, the co-pilot sleeping. Since the display brightness of the first display screen is usually brighter, the brightness and light issues may affect the co-pilot's eyes or sleep quality. Therefore, in one embodiment, when it is detected that the co-pilot has closed his eyes or is sleeping, the second display screen is controlled to display the content of the first display screen, and the first display screen is stopped from displaying the content. In another embodiment, when it is detected that the co-pilot has closed his eyes or is sleeping, the second display screen is controlled to display the content of the first display screen, without stopping the first display screen from displaying the content, and only the display brightness of the first display screen is lowered. In this way, while ensuring that the co-pilot is not affected by the brightness of the first display screen, it is ensured that the driver can see the content of the first display screen from the second display screen.
[0246] In combination with any of the above embodiments, in one implementation manner, the vehicle status satisfies the first preset condition and includes at least one or more of the following: the vehicle's right turn signal is turned on, and the vehicle's tires turn right more than a first angle; the vehicle's left turn signal is turned on, and the vehicle's tires turn left more than a second angle; the vehicle's emergency lights are turned on; the vehicle is in an emergency braking state.
[0247] In conjunction with any of the above embodiments, in one implementation, the driver state meeting the second preset condition includes: the driver's head turning rightward by more than a third angle. The first, second, and third angles are all set thresholds. For example, the third angle may be 40 degrees, and the first and second angles may be 10 degrees, and so on. There is no limitation on the specific values.
[0248] Referring to Figure 13, a flow chart illustrating a method for displaying control target content based on driver perception according to an embodiment of the present application is shown. In this method, the central control screen serves as the second display screen, the rearview mirror screen serves as the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the central control application and the rearview mirror application. The display method includes the following steps:
[0249] (1) The rearview mirror application obtains the streaming media data collected and sent by the rearview mirror;
[0250] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;
[0251] (3) The rearview mirror application sends the processed streaming data to the rearview mirror screen for display;
[0252] (4) The rearview mirror is integrated with an under-screen camera. The rearview mirror application can detect the driver's characteristic parts, such as the head, glasses, etc., through the under-screen camera, and then determine whether the driver's characteristic parts are blocked, such as whether the driver's head is blocked. Specifically, as shown in FIG14, FIG14 is a schematic diagram of a line of sight obstruction judgment in an embodiment of the present application. The rearview mirror application judges whether the line of sight is blocked by detecting the driver's characteristic parts, and the judgment can be made by collecting images carried by the camera on the rearview mirror screen. Preferably, the camera of the right rearview screen is located on the right side of the right rearview screen;
[0253] (5) If it is determined that the driver's characteristic part is blocked, optionally, further determine whether the blocking time meets a certain threshold, such as 2 seconds. If the threshold is met, proceed to the next step; optionally, count the number of times the driver is blocked. If the number exceeds a certain threshold, proceed to the next step;
[0254] (6) Optionally, the rearview mirror application sends a notification to the central control application;
[0255] (7) The central control application obtains streaming data from the rearview mirror application;
[0256] (8) Optionally, the central control application can perform data processing on the streaming media data, such as scaling to match the size of the central control screen;
[0257] (9) The central control application sends the streaming media data to the central control screen for display;
[0258] (10) Optionally, the central control application can display the content of the right rear view screen in full screen on the main control screen, as shown in FIG15 , which is a schematic diagram of a control target content display according to an embodiment of the present application; or it can display the content of the right rear view screen in a portion of the main control screen, as shown in FIG16 , which is a schematic diagram of a control target content display according to an embodiment of the present application. In FIG16 , the content of the right rear view screen (first display screen) is displayed on a portion of the right side of the main control screen (second display screen).
[0259] Referring to Figure 17, a flow chart illustrating a method for displaying control target content based on co-pilot perception according to an embodiment of the present application is shown. In this method, the central control screen serves as the second display screen, the rearview mirror screen serves as the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the central control application and the rearview mirror application. The display method includes the following steps:
[0260] (1) The rearview mirror application obtains the streaming data sent by the rearview mirror;
[0261] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;
[0262] (3) The rearview mirror application sends the processed streaming data to the rearview mirror screen for display;
[0263] (4) The rearview mirror application determines the positional relationship between the driver's seat and the passenger seat, and determines a first threshold value or a second threshold value. When the driver's seat is behind the passenger seat, the first threshold value is determined; when the driver's seat is in front of the passenger seat, the second threshold value is determined. The first threshold value is greater than the second threshold value.
[0264] (5) Detecting whether the driver's characteristic parts are blocked can be processed by entertainment applications, such as determining the distance between the front passenger and the front passenger screen. If it is less than a certain threshold, the driver is determined to be blocked. Alternatively, the front passenger's characteristic information can be obtained through the camera on the front passenger screen, and then the distance between the front passenger and the front passenger screen can be determined. If it is less than a certain threshold, the driver is determined to be blocked.
[0265] (6) A solution parallel to (4), where when the co-pilot screen detects that the passenger is operating the co-pilot screen, it is determined that the driver may be obscured;
[0266] (7) If it is determined that the driver's characteristic part is blocked, optionally, further determine whether the blocking time meets a certain threshold, such as 2 seconds. If the threshold is met, proceed to the next step; optionally, count the number of times the driver is blocked. If the number exceeds a certain threshold, proceed to the next step;
[0267] (8) Optionally, the rearview mirror application sends a notification to the central control application;
[0268] (8) The central control application obtains streaming data from the rearview mirror application;
[0269] (9) Optionally, the central control application can perform data processing on the streaming media data, such as scaling to match the size of the central control screen;
[0270] (10) The central control application sends the streaming media data to the central control screen for display;
[0271] (11) The rearview mirror application continues to determine whether the distance between the co-pilot and the co-pilot screen is greater than a certain threshold. If so, the streaming media data is canceled from being sent to the central control application.
[0272] Referring to Figure 18, a flow chart illustrating a method for displaying control target content based on event sensing according to an embodiment of the present application is shown. In this method, the central control screen serves as the second display screen, the rearview mirror screen serves as the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes both the central control application and the rearview mirror application. The display method includes the following steps:
[0273] (1) The rearview mirror application obtains the streaming data sent by the rearview mirror;
[0274] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;
[0275] (3) The rearview mirror application sends the processed streaming data to the rearview mirror display screen for display;
[0276] (4) The central control application detects the driver's operation information and thus perceives changes in vehicle status;
[0277] (5) If the vehicle state change is determined to meet the preset conditions, the central control application obtains the streaming media data from the rearview mirror application; the preset conditions include: turning the vehicle to the right by more than a certain angle (such as 40 degrees), optionally, turning on the right turn signal, turning the tire to the right by more than a certain angle (such as 10 degrees), turning on the left turn signal, turning the tire to the left by more than a certain angle (such as 10 degrees), turning on the emergency lights, sudden braking, etc.
[0278] (6) Optionally, the central control application can detect a specific state of the driver. For example, if the driver's head is detected to be tilted to the right, the central control application obtains streaming media data from the rearview mirror application.
[0279] (7) Optionally, the central control application can process the streaming media data, such as scaling it to match the size of the central control screen;
[0280] (8) The central control application sends the streaming media data to the central control screen for display.
[0281] Referring to Figure 19, a flow chart illustrating a method for displaying control target content based on occlusion detection and judgment after event triggering according to an embodiment of the present application is shown. In this method, the central control screen serves as the second display screen, the rearview mirror screen serves as the first display screen, the central control screen corresponds to a central control application, the rearview mirror screen corresponds to a rearview mirror application, and the controller includes the central control application and the rearview mirror application. The display method includes the following steps:
[0282] (1) The driving assistance application identifies the driver and obtains image information of the driver looking at the left and right rearview mirrors, and inputs the image information into the neural network to identify the driver's action of looking at the left and right rearview mirrors;
[0283] (2) The rearview mirror application obtains the streaming data sent by the rearview mirror;
[0284] (3) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;
[0285] (4) The rearview mirror application sends the processed streaming data to the rearview mirror screen for display;
[0286] (5) The central control application detects driver status events and / or vehicle events, where the driver status event includes turning the head to the right beyond a certain angle (e.g., 40 degrees), and the neural network model recognizes that the user is looking at the rearview mirror;
[0287] (6) Optionally, vehicle events include turning on the right turn signal, turning the tire right by more than a certain angle (e.g., 10 degrees), turning on the left turn signal, turning the tire left by more than a certain angle (e.g., 10 degrees), turning on the emergency lights, and sudden braking;
[0288] (7) If the driver status event and / or vehicle event meet the preset conditions, then proceed to the next step;
[0289] (8) When detecting driver status events and / or vehicle events that meet preset conditions, the central control application notifies the rearview mirror application to detect whether the driver's line of sight is blocked, such as judging the distance between the front passenger and the front passenger screen. If it is less than a certain threshold, the driver is determined to be blocked; in addition, the feature information of the front passenger can be obtained through the camera on the front passenger screen, and then the distance between the front passenger and the front passenger screen can be judged. If it is less than a certain threshold, the driver is determined to be blocked; in addition, the right rearview screen can also be integrated with camera A, which can cover the range of the main driver and front passenger seats. Camera A implements the acquisition of real-time images of the main driver and front passenger seats. When camera A determines whether the complete driver's head can be obtained, it is determined whether it is blocked; optionally, camera A detects the driver's ears. If the ears can be detected, it is determined that they are not blocked. If the ears cannot be detected, it is determined that they are blocked;
[0290] (9) If it is determined that the driver's characteristic part is blocked, optionally, further determine whether the blocking time meets a certain threshold, such as 2 seconds. If the threshold is met, proceed to the next step. Optionally, count the number of times the driver is blocked. If the number exceeds a certain threshold, proceed to the next step.
[0291] (10) Optionally, the rearview mirror application sends a notification to the central control application;
[0292] (11) The central control application obtains streaming data from the rearview mirror application;
[0293] (12) Optionally, the central control application can perform data processing on the streaming media data, such as scaling to match the size of the central control screen;
[0294] (13) The central control application sends the streaming media data to the central control screen for display;
[0295] (14) Optionally, the central control application can display the content of the right rear view screen in full screen on the main control screen, or can display it on a portion of the main control screen;
[0296] (15) The rearview mirror application continues to determine whether the distance between the co-pilot and the co-pilot screen is greater than a certain threshold. If so, the sending of streaming media data to the central control application is canceled.
[0297] Referring to Figure 20 , a flowchart illustrating a method for controlling the display of target content on the passenger screen according to an embodiment of the present application is shown. In this method, the passenger screen serves as the second display screen, and the rearview mirror screen serves as the first display screen. The passenger screen corresponds to an entertainment application, and the rearview mirror screen corresponds to a rearview mirror application. The controller includes both the entertainment application and the rearview mirror application. The display method includes the following steps:
[0298] (1) The rearview mirror application obtains the streaming data sent by the rearview mirror;
[0299] (2) The rearview mirror application processes streaming media data, including image enhancement and distortion processing;
[0300] (3) The rearview mirror application sends the processed streaming data to the rearview mirror screen for display;
[0301] (4) The rearview mirror is used to detect the driver's characteristic parts, such as the head, glasses, etc., and then determine whether the driver's characteristic parts are blocked, such as whether the driver's head is blocked; the rearview mirror is used to detect the driver's characteristic parts, and the judgment can be made through the camera carried by the rearview mirror screen;
[0302] (5) Optionally, if it is determined that the driver's characteristic part is blocked, if it is blocked, it is optional to further determine whether the blocking time meets a certain threshold, such as 2 seconds. If the threshold is met, the next step is executed;
[0303] (6) After the rearview mirror application determines that the driver is obscured, it sends a notification to the entertainment application;
[0304] (7) The entertainment application obtains streaming data from the rearview mirror application;
[0305] (8) Optionally, the entertainment application can perform data processing on the streaming media data, such as scaling it to match the size of the central control screen;
[0306] (9) The entertainment application sends the streaming media data to the passenger screen for display, as shown in FIG21 , which is a schematic diagram of controlling the display of target content in an embodiment of the present application. In FIG21 , the content of the right rear view screen (first display screen) is displayed on the passenger screen (second display screen);
[0307] (10) Optionally, the entertainment application may detect whether the characteristic parts of the driver are blocked, such as determining the distance between the front passenger and the front passenger screen. If the distance is less than a certain threshold, the driver is determined to be blocked. Alternatively, the front passenger's characteristic information may be obtained through the camera on the front passenger screen, and then the distance between the front passenger and the front passenger screen may be determined. If the distance is less than a certain threshold, the driver is determined to be blocked.
[0308] In another embodiment, the second display screen may also be an instrument panel, as shown in FIG22 , which is a schematic diagram of controlling the display of target content according to an embodiment of the present application. In FIG22 , the content of the right rear view screen (first display screen) is displayed on the instrument panel (second display screen).
[0309] In one embodiment, the overall system structure of this embodiment is shown in FIG23 , which is a schematic diagram of a system architecture according to an embodiment of the present application. The electronic rearview mirror host can utilize a real-time operating system (RTOS) on a virtual machine. Alternatively, the electronic rearview mirror system can be directly implemented on a vehicle-mounted SOC, or on an MCU, with the MCU and the vehicle-mounted SOC connected, without relying on a virtual machine.
[0310] A unified data bus is built on different virtual machine systems to provide a unified API interface for upper-level applications. Upper-level applications can obtain vehicle perception data through the data bus, such as data from on-board cameras, and display it on the corresponding screen.
[0311] Based on the same inventive concept, an embodiment of the present application provides a content display system. Referring to FIG24 , FIG24 is a schematic diagram of a content display system provided by an embodiment of the present application. The content display system at least includes: a first display screen 2403, a second display screen 2401, a controller 2402, and a vehicle body exterior camera 2404.
[0312] The vehicle body exterior camera 2404 is used to capture images of the vehicle body exterior.
[0313] In the embodiment of the present application, the camera on the outside of the vehicle body corresponds to the first display screen and is used to capture images of the outside of the vehicle body.
[0314] The controller 2402 is configured to:
[0315] Detect whether the driver's view of the first display screen 2403 is blocked, the first display screen 2403 is located on the right side of the driver; when it is detected that the driver's view of the first display screen 2403 is blocked, determine the second display screen 2401 associated with the first display screen 2403; control the second display screen 2401 to display the content of the first display screen 2403; the content of the first display screen 2403 is the image content captured by the vehicle body outside camera 2404.
[0316] In an embodiment of the present application, the first display screen is the display screen located on the right side of the driver in the car that the driver is currently watching. The first display screen can be any display screen for the driver to view driving-related information; the first display screen can display the target content collected by the camera on the outside of the car body.
[0317] When the controller detects that the driver's view of the first display screen is blocked, it can determine a second display screen associated with the first display screen and control the second display screen to display the content of the first display screen. The second display screen is one or more in-vehicle display screens other than the first display screen.
[0318] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a first camera is integrated under the first display screen;
[0319] The first camera is used to capture an image of the first driver;
[0320] In an embodiment of the present application, the first display screen may be a right rear view screen, and the first camera in the right rear view screen may capture an image of the driver, thereby acquiring a first driver image.
[0321] The controller is configured to obtain the first driver image, detect whether a target part of the driver is blocked based on the first driver image, and determine that the line of sight is blocked if the target part is blocked.
[0322] In an embodiment of the present application, after the first camera captures the first driver image, the controller can obtain the first driver image from the first camera and detect whether the target part of the driver is blocked based on the first driver image. If the target part is blocked, it is determined that the driver's view of the first display screen is blocked.
[0323] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a first camera is integrated under the first display screen;
[0324] The first camera is used to capture a first head image of the driver and a second head image of the co-driver;
[0325] In an embodiment of the present application, the first display screen can be a right rear view screen. The first camera in the right rear view screen can cover the range of the driver and co-driver seats, and can collect real-time images of the driver and co-driver, thereby obtaining a first head image of the driver and a second head image of the co-driver.
[0326] The controller is configured to obtain the first head image and the second head image, determine an overlapping area between the first head image and the second head image, and determine that the line of sight is blocked if the overlapping area is greater than an area threshold.
[0327] In an embodiment of the present application, after the first camera captures the first head image and the second head image, the controller can obtain the first head image and the second head image from the first camera, and determine the overlapping area of the first head image and the second head image based on the first head image and the second head image, and make a judgment based on whether the overlapping area is greater than an area threshold. When it is determined that the overlapping area is greater than the area threshold, it is determined that the driver's view of the first display screen is blocked.
[0328] In conjunction with the above embodiments, embodiments of the present application provide a content display system in which the first camera is located to the right of the first display screen. Because when a driver is viewing the first display screen, any obstruction to their view will likely be from the right to the left, ensuring that the driver can see the right side, the first camera is installed on the right side. Any obstruction to the right side can be detected through the image captured by the first camera.
[0329] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a second camera is integrated under the second display screen;
[0330] The second camera is used to capture the image of the second driver.
[0331] In an embodiment of the present application, the second camera of the second display screen can cover the range of the main driver's seat, and can collect real-time images of the main driver, thereby obtaining a second driver image of the driver.
[0332] The controller is used to detect whether the driver status meets a second preset condition based on the second driver image.
[0333] In an embodiment of the present application, after the second camera captures the second driver image, the controller can obtain the second driver image from the second camera and detect whether the driver status meets the second preset condition based on the second driver image.
[0334] In one embodiment, a second camera may be used to capture image information of the driver looking at the left and right rearview mirrors. This image information is then fed into a neural network to identify the driver's turning head to look at the left and right rearview mirrors. The controller can then obtain a second image of the driver from the second camera and feed the trained neural network model to identify whether the driver is turning their head to look at the rearview mirrors, thereby determining whether the driver's state satisfies the second preset condition.
[0335] In combination with the above embodiment, in an optional implementation manner, in the content display system, the second display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.
[0336] In combination with the above embodiment, in an optional implementation manner, in the content display system, the first display screen is a rearview mirror display screen.
[0337] In one embodiment of the present application, based on the problem that the current smart cockpit multi-screen display has too many screens and high hardware costs, the embodiment of the present application provides a content display method. Referring to Figure 25, a flowchart of a content display method of the embodiment of the present application is shown. The content display method provided by the embodiment of the present application can be applied to a controller, which can perform relevant control on the vehicle-mounted terminal and various components in the vehicle.
[0338] Generally, an electronic rearview mirror includes a camera and a display screen. For example, the camera on the right side of the vehicle's exterior corresponds to the right rearview screen, and the camera on the left side of the vehicle's exterior corresponds to the left rearview screen. In the embodiment of the present application, the left and right rearview screens are removed, and the corresponding target content can still be displayed based on the driver's driving situation. The content display method may include the following steps:
[0339] S2101, detecting whether the driver's current line of sight is looking outside the vehicle.
[0340] In an embodiment of the present application, while the vehicle is in motion, each in-vehicle display screen displays its corresponding relevant driving information. Under normal circumstances, it does not display external information, i.e., image information captured by the left and right exterior cameras. The controller can detect the driver's current line of sight to determine whether the current line of sight is directed toward the outside of the vehicle. For example, a camera can be integrated under the in-vehicle display screen to capture the driver's image in real time through the camera under the in-vehicle display screen. The controller detects the driver's image captured in real time by the camera under the in-vehicle display screen to determine whether the driver's current line of sight is directed toward the outside of the vehicle.
[0341] S2102: When it is detected that the driver's current line of sight is directed toward outside the vehicle, determine the in-vehicle display screen.
[0342] In an embodiment of the present application, when the controller detects that the driver's current line of sight is looking outside the vehicle, it can determine the in-vehicle display screen that needs to display outside information, wherein the determined in-vehicle display screen can be any one or more display screens in the vehicle, and this embodiment does not limit this.
[0343] S2103, controlling the in-vehicle display screen to display information outside the vehicle.
[0344] In an embodiment of the present application, after determining that an in-vehicle display screen needs to display outside-vehicle information, the in-vehicle display screen can be controlled to display outside-vehicle information, so that when the driver's intention to look outside the vehicle is detected, the outside-vehicle information is displayed on the in-vehicle display screen.
[0345] In combination with the above embodiments, an embodiment of the present application provides a content display method. In addition to the above steps, the content display method may further include step S2201, and the above step S2103 may specifically include step S2202:
[0346] S2201: When it is detected that the driver's current line of sight is looking outside the vehicle, determine the display mode of the in-vehicle display screen.
[0347] In an embodiment of the present application, upon detecting that the driver's current line of sight is directed outside the vehicle, the controller may determine, in addition to determining the in-vehicle display screen that needs to display information outside the vehicle, the display mode of the in-vehicle display screen. The display modes may include a first display mode, wherein the first display mode hides the information displayed on the in-vehicle display screen and displays information outside the vehicle; and a second display mode, wherein the in-vehicle display screen displays information outside the vehicle and a portion of the information displayed on the in-vehicle display screen.
[0348] S2202: Control the in-vehicle display screen to display the external vehicle information according to the display mode.
[0349] In an embodiment of the present application, after the in-vehicle display screen and the display mode of the in-vehicle display screen are determined, the in-vehicle display screen can be controlled to display the external information according to the determined display mode.
[0350] It should be noted that in this embodiment, step S2102 may be executed first and then step S2201, or step S2201 may be executed first and then step S2102, or step S2102 and step S2201 may be executed at the same time. This embodiment does not impose any restrictions on the execution order between step S2201 and step S2102.
[0351] For example, as shown in FIG26 , FIG26 is a schematic diagram of a content display method provided by an embodiment of the present application. In FIG26 , the in-vehicle display screen is an instrument panel. When the controller detects that the driver's current line of sight is directed outside the vehicle, the controller can control the display of the vehicle's exterior information captured by the left and right rearview cameras on the in-vehicle display screen in a first display mode (hiding the instrument panel information and displaying the exterior information captured by the left and right rearview cameras) or a second display mode (displaying only speed / main information on the instrument panel, i.e., reducing the size of the instrument panel information and displaying the exterior information captured by the left and right rearview cameras).
[0352] In combination with any of the above embodiments, a content display method according to an embodiment of the present application may further include the following steps in addition to the above steps:
[0353] S2301, when it is detected that the driver's current line of sight is not looking outside the vehicle, controlling the in-vehicle display screen to no longer display the outside-vehicle information.
[0354] In an embodiment of the present application, after the controller detects that the driver's current line of sight is directed outside the vehicle, it continues to detect the driver's current line of sight in real time. If the controller detects that the driver's current line of sight is not directed outside the vehicle, it can control the in-vehicle display screen to stop displaying information outside the vehicle, allowing the in-vehicle display screen to continue displaying the content that was displayed on the in-vehicle display screen before the in-vehicle display screen displayed information outside the vehicle. For example, if the in-vehicle display screen is an instrument panel, if the controller detects that the driver's current line of sight is not directed outside the vehicle, the in-vehicle display screen can continue to display the instrument panel information.
[0355] For example, as shown in FIG27 , FIG27 is a schematic diagram of a content display method provided by an embodiment of the present application. In FIG27 , the in-vehicle display screen is a dashboard. When the controller detects that the driver's current line of sight is directed outside the vehicle, the controller can control the outside information captured by the left and right rearview cameras to be displayed on both sides of the dashboard in a first display mode (hiding the dashboard information and displaying the outside information captured by the left and right rearview cameras) or a second display mode (the dashboard information only displays speed / main information, i.e., the dashboard information is scaled down and the outside information captured by the left and right rearview cameras is displayed). For example, the right side of the dashboard displays the outside information captured by the right rearview camera, and the left side of the dashboard displays the outside information captured by the left rearview camera.
[0356] Based on the same inventive concept, an embodiment of the present application provides a content display system. Referring to FIG28 , FIG28 is a schematic diagram of a content display system provided by an embodiment of the present application. The content display system at least includes: an in-vehicle display screen 2801, a controller 2802, and a camera 2803 outside the vehicle body.
[0357] The vehicle body exterior camera 2803 is used to capture images of the vehicle body exterior;
[0358] The controller 2802 is configured to:
[0359] Detect whether the driver's current line of sight is looking outside the vehicle;
[0360] When it is detected that the driver's current line of sight is looking outside the vehicle, the in-vehicle display screen 2801 is determined; the in-vehicle display screen 2801 is controlled to display information outside the vehicle; the information outside the vehicle is image information collected by the camera 2803 outside the vehicle body.
[0361] In combination with the above embodiments, an embodiment of the present application provides a content display system, in which a third camera is integrated under the in-vehicle display screen.
[0362] The third camera is used to capture the image of the third driver.
[0363] In an embodiment of the present application, the third camera of the in-vehicle display screen can cover the range of the main driver's seat, and can collect real-time images of the main driver, thereby obtaining a third driver image of the driver.
[0364] The controller is used to obtain the third driver image and detect whether the driver's current line of sight is looking outside the vehicle based on the third driver image.
[0365] In an embodiment of the present application, after the third camera captures the third driver image, the controller can obtain the third driver image from the third camera, and perceive the driver's head and eye adjustments based on the third driver image, and detect whether the driver's current line of sight is looking outside the vehicle.
[0366] In combination with the above embodiments, in an optional implementation manner, in the content display system, the in-vehicle display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.
[0367] As for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0368] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and runnable on the processor. When the processor executes the computer program, the steps in the content display method described in any of the above embodiments are implemented.
[0369] Based on the same inventive concept, an embodiment of the present application provides a vehicle, which includes a controller, and the controller is used to execute the steps in the content display method described in any of the above embodiments.
[0370] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0371] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0372] The present application embodiment is described with reference to the flowchart and / or block diagram of the method, terminal device (system), and computer program product according to the embodiment of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the process and / or box in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable image processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable image processing terminal device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.
[0373] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable image processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0374] These computer program instructions can also be loaded onto a computer or other programmable image processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce computer-implemented processing, so that the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0375] Although preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they become aware of the basic inventive concepts. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0376] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or terminal device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that includes the element.
[0377] The above is a detailed introduction to a content display method, system, vehicle and electronic device provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A content display method, characterized in that: The method comprises: Detecting whether a driver's line of sight of a first display screen is blocked, where the first display screen is located on the right side of the driver; When it is detected that the driver's line of sight of the first display screen is blocked, determining a second display screen associated with the first display screen; Control the second display screen to display the content of the first display screen.
2. The content display method according to claim 1, characterized in that: The method further comprises: Control the second display screen to adjust its angle.
3. The content display method according to claim 2, characterized in that: Controlling the second display screen to adjust its angle includes at least one of the following: Controlling the second display screen to deflect to the left at a preset angle; The sum of the angle of the second display screen and the angle of the first display screen is controlled to be 180 degrees.
4. The content display method according to claim 1, characterized in that: The method further comprises: The display parameter value of the second display screen is adjusted according to the display parameter value of the first display screen.
5. The content display method according to claim 4, characterized in that: Adjusting the display parameter value of the second display screen according to the display parameter value of the first display screen includes at least one or more of the following: Controlling the brightness value of the second display screen according to the brightness value of the first display screen; controlling the aspect ratio of the second display screen according to the aspect ratio of the first display screen; The refresh rate of the second display screen is controlled according to the refresh rate of the first display screen.
6. The content display method according to claim 1, characterized in that: The method further comprises: In the case where it is detected that the driver's line of sight for viewing the first display screen is blocked, determining the degree of the blocked line of sight, wherein the degree of the blocked line of sight is used to characterize the situation where the visual field range of the line of sight is blocked; When it is detected that the driver's line of sight of the first display screen is blocked, determining a second display screen associated with the first display screen comprises: In the case where the occlusion degree exceeds a first occlusion degree threshold, determining the second display screen as: a third display screen; When the occlusion degree exceeds a second occlusion degree threshold, the second display screen is determined to be: a fourth display screen, the second occlusion degree threshold is greater than the first occlusion degree threshold, and the fourth display screen is a display screen closer to the driver than the third display screen.
7. The content display method according to claim 1, characterized in that: The method further comprises: In the case where it is detected that the driver's line of sight for viewing the first display screen is blocked, determining the degree of the blocked line of sight, wherein the degree of the blocked line of sight is used to characterize the situation where the visual field range of the line of sight is blocked; Controlling the second display screen to display the content of the first display screen includes: When the occlusion degree exceeds a third occlusion degree threshold, controlling the first display area of the second display screen to display the content of the first display screen; When the degree of occlusion exceeds the fourth degree of occlusion threshold, the second display area of the second display screen is controlled to display the content of the first display screen, the third degree of occlusion threshold is greater than the fourth degree of occlusion threshold, and the first display area is a display area closer to the driver than the second display area.
8. The content display method according to claim 1, characterized in that: In the case where it is detected that the driver's line of sight of the first display screen is blocked, the method further includes: Determine the obstruction time of the line of sight being blocked, and / or determine the number of obstruction times of the line of sight being blocked; When the shielding time exceeds a time threshold, and / or the shielding times exceeds a times threshold, determining that the content of the first display screen needs to be displayed on the second display screen; Determining a second display screen associated with the first display screen includes: In case it is determined that the content of the first display screen needs to be displayed through the second display screen, the step of determining a second display screen associated with the first display screen is performed.
9. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Acquire a first driver image captured for the driver; detecting, according to the first driver image, whether a target part of the driver is blocked; When the target part is blocked, it is determined that the line of sight is blocked.
10. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Acquire a first head image of the driver, and acquire a second head image of the co-pilot; determining an overlapping area of the first head image and the second head image; When the overlapping area is greater than an area threshold, it is determined that the line of sight is blocked.
11. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Determine the distance between the co-pilot and the co-pilot screen; When the distance is less than a distance threshold, it is determined that the line of sight is blocked.
12. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Determine whether the co-pilot is operating the co-pilot screen; When the co-pilot is operating the co-pilot screen, it is determined that the sight line is blocked.
13. The content display method according to any one of claims 1 to 8, characterized in that: Detecting whether the driver's line of sight of the first display screen is blocked includes: Get the positions of the driver's seat and the co-pilot's seat respectively; Determining the angle between the line between the driver's seat and the co-driver's seat and the horizontal direction of the vehicle body; When the included angle is greater than an angle threshold, it is determined that the line of sight is blocked.
14. The content display method according to any one of claims 1 to 8, characterized in that: The method further comprises: Detect whether the target event occurs; When the target event is detected, the following steps are executed: detecting whether the driver's line of sight of the first display screen is blocked; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.
15. The content display method according to any one of claims 1 to 8, characterized in that: The method further comprises: When a target event is detected, the second display screen is controlled to display the content of the first display screen; the occurrence of the target event includes at least one of the following: the vehicle state meets the first preset condition, and the driver state meets the second preset condition.
16. A content display system, characterized in that: The content display system at least includes: a first display screen, a second display screen, a controller and a camera outside the vehicle body; The vehicle body exterior camera is used to capture images of the vehicle body exterior; The controller is used to: detect whether the driver's view of the first display screen is blocked, the first display screen is located on the right side of the driver; when it is detected that the driver's view of the first display screen is blocked, determine the second display screen associated with the first display screen; control the second display screen to display the content of the first display screen; the content of the first display screen is the image content captured by the camera on the outside of the vehicle body.
17. The content display system according to claim 16, characterized in that: A first camera is integrated under the first display screen; The first camera is used to capture the image of the first driver; The controller is used to obtain the first driver image, detect whether a target part of the driver is blocked based on the first driver image, and determine that the line of sight is blocked when the target part is blocked.
18. The content display system according to claim 16, characterized in that: A first camera is integrated under the first display screen; The first camera is used to capture a first head image of the driver and a second head image of the co-driver; The controller is used to obtain the first head image and the second head image, determine an overlapping area between the first head image and the second head image, and determine that the line of sight is blocked when the overlapping area is greater than an area threshold.
19. The content display system according to claim 17, characterized in that: The first camera is located on the right side below the first display screen.
20. The content display system according to claim 16, characterized in that: A second camera is integrated under the second display screen; The second camera is used to capture the image of the second driver; The controller is used to detect whether the driver status meets a second preset condition based on the second driver image.
21. The content display system according to any one of claims 16 to 20, characterized in that: The second display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.
22. The content display system according to any one of claims 16 to 20, characterized in that: The first display screen is a rearview mirror display screen.
23. A content display method, characterized in that: The method comprises: Detect whether the driver's current line of sight is looking outside the vehicle; When it is detected that the current sight line of the driver is to look outside the vehicle, determining the in-vehicle display screen; Control the in-vehicle display screen to display information outside the vehicle.
24. The content display method according to claim 23, characterized in that: The method further comprises: When it is detected that the driver's current line of sight is to look outside the vehicle, determining a display mode of the display screen inside the vehicle; Controlling the in-vehicle display screen to display information outside the vehicle, including: Control the in-vehicle display screen to display the outside-vehicle information according to the display mode; wherein the display mode includes: a first display mode or a second display mode; the first display mode is: a display mode in which the information displayed on the in-vehicle display screen is hidden and the outside-vehicle information is displayed; the second display mode is: a display mode in which the outside-vehicle information and part of the information displayed on the in-vehicle display screen are displayed.
25. The content display method according to claim 23 or 24, characterized in that: The method further comprises: When it is detected that the driver's current line of sight is not the line of sight to view outside the vehicle, the in-vehicle display screen is controlled to no longer display the outside-vehicle information.
26. A content display system, characterized in that: The content display system at least includes: an in-vehicle display screen, a controller and a camera outside the vehicle body; The vehicle body exterior camera is used to capture images of the vehicle body exterior; The controller is used to: Detect whether the driver's current line of sight is looking outside the vehicle; When it is detected that the driver's current line of sight is to look outside the vehicle, the in-vehicle display screen is determined; the in-vehicle display screen is controlled to display information outside the vehicle; the information outside the vehicle is image information collected by the camera outside the vehicle body.
27. The content display system according to claim 26, characterized in that: A third camera is integrated under the in-vehicle display screen; The third camera is used to collect the image of the third driver; The controller is used to obtain the third driver image and detect, based on the third driver image, whether the driver's current line of sight is a line of sight looking outside the vehicle.
28. The content display system according to claim 26 or 27, characterized in that: The in-vehicle display screen includes at least one of the following: a main control screen, an instrument panel, and a co-pilot screen.
29. A vehicle, characterized in that: The vehicle includes a controller, and the controller is used to execute the steps of the content display method according to any one of claims 1 to 15 or to execute the steps of the content display method according to any one of claims 23 to 25.
30. An electronic device, characterized in that: It includes a processor and a memory, the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, it implements the steps of the content display method as described in any one of claims 1 to 15 or implements the steps of the content display method as described in any one of claims 23 to 25.