A screen content auxiliary display method and device, a vehicle, and a storage medium

Abstract

The embodiment of the application discloses a screen content auxiliary display method and device, a vehicle and a storage medium. The method comprises the following steps: detecting whether the content on the co-driver screen meets the preset auxiliary display condition; the auxiliary display condition comprises that the content on the co-driver screen itself needs auxiliary display, and / or the content on the co-driver screen is continuously focused by the main driver; when the content on the co-driver screen meets the auxiliary display condition, the content on the co-driver screen is displayed in an auxiliary manner; the auxiliary display manner comprises any one or more of the following: content highlighting display, content display position transfer and content reading display. Through the embodiment, the content on the co-driver screen is automatically displayed in an auxiliary manner, and the intelligence and humanization of in-vehicle control are improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to vehicle control technology, and in particular to a screen content auxiliary display method and device, a vehicle, and a storage medium. BACKGROUND

[0002] With the intelligentization of the cockpit / vehicle machine, the number / size of screens in the cockpit has been increasing, such as double-screen, triple-screen, and fish-screen. Therefore, the co-driver position usually has a single operable touch screen.

[0003] When the co-driver wants to share the information on the co-driver screen with the main driver (for example, the co-driver searches for multiple candidate restaurants in a map application on the co-driver screen and wants the main driver to confirm; or the co-driver selects a route and wants the main driver to confirm whether it is appropriate), the main driver cannot clearly see the information on the co-driver screen because the main driver is far away from the co-driver screen and the angle is relatively inclined.

[0004] The current solution is that the co-driver actively moves the window of the application (APP) to be displayed to the center screen through a specific operation (such as three-finger sliding) so that the main driver can see clearly.

[0005] In some multi-screen display application solutions, the user needs to transfer the window between multiple screens through a line-of-sight operation, for example, the main driver needs to look at the co-driver screen first and then look at the center screen to transfer the window from the co-driver screen to the center screen. SUMMARY

[0006] Embodiments of the present application provide a screen content auxiliary display method and device, a vehicle, and a storage medium, which can automatically assist in displaying the content of the co-driver screen and improve the intelligentization and humanization of in-vehicle control.

[0007] Embodiments of the present application provide a screen content auxiliary display method, which can include:

[0008] detecting whether the content on the co-driver screen meets a preset auxiliary display condition; the auxiliary display condition includes that the content of the co-driver screen itself needs auxiliary display and / or the content on the co-driver screen is continuously focused on by the main driver;

[0009] when the content on the co-driver screen meets the auxiliary display condition, assisting in displaying the content on the co-driver screen; the auxiliary display mode includes any one or more of the following: content highlighting display, content display position transfer, and content display conversion to content reading.

[0010] In exemplary embodiments of the present application, the detection of whether the content on the co-driver screen meets the auxiliary display condition can include:

[0011] The determining that the content on the co-driver screen meets the auxiliary display condition includes determining that the content on the co-driver screen itself needs auxiliary display when the content on the co-driver screen meets any one or more of the following conditions:

[0012] The type of an application APP activated on the co-driver screen belongs to a preset type that needs auxiliary display;

[0013] The font size on the co-driver screen is less than a preset threshold;

[0014] The content on the co-driver screen makes the co-driver have a sharing intention; and

[0015] The content information on the co-driver screen belongs to preset information that needs auxiliary display.

[0016] In an example embodiment of the present application, the method of detecting whether the content on the co-driver screen makes the co-driver have a sharing intention can include:

[0017] Recognizing voice content of the co-driver through a voice recognition device on the vehicle;

[0018] When the voice content includes information that the co-driver wants to share the content on the co-driver screen, it is determined that the content on the co-driver screen makes the co-driver have a sharing intention.

[0019] In an example embodiment of the present application, the method of detecting whether the content on the co-driver screen makes the co-driver have a sharing intention can include:

[0020] Obtaining picture information and / or video information of the co-driver through a preset camera in the vehicle;

[0021] Detecting whether the co-driver has an action of sharing the content on the co-driver screen according to the picture information and / or the video information;

[0022] When it is detected that the co-driver has an action of sharing the content on the co-driver screen, it is determined that the content on the co-driver screen makes the co-driver have a sharing intention.

[0023] In an example embodiment of the present application, the detecting whether the co-driver has an action of sharing the content on the co-driver screen according to the picture information and / or the video information can include:

[0024] Inputting the picture information and / or the video information into a preset action detection model;

[0025] Detecting, by the action detection model, whether the action in the picture information and / or the video information conforms to a pre-learned sharing action;

[0026] determine that the copilot has the action of sharing the content on the copilot screen when the action detection model detects that the action in the picture information and / or the video information conforms to the sharing action;

[0027] determine that the copilot does not have the action of sharing the content on the copilot screen when the action detection model detects that the action in the picture information and / or the video information does not conform to the sharing action.

[0028] In an example embodiment of the present application, the detection of whether the content on the copilot screen meets the auxiliary display condition can include:

[0029] detecting the line-of-sight direction of the main driver, and determining that the content on the copilot screen meets the auxiliary display condition that the content on the copilot screen is continuously focused on by the main driver when the line-of-sight direction of the main driver points to the copilot screen, and the duration that the line-of-sight direction of the main driver points to the copilot screen is greater than or equal to a preset duration threshold, and / or the number of times that the line-of-sight direction of the main driver points to the copilot screen within a preset duration is greater than or equal to a preset number threshold.

[0030] In an example embodiment of the present application, the detection of the line-of-sight direction of the main driver can include:

[0031] capturing images of the main driver through a preset camera in the vehicle at a preset capture period;

[0032] detecting a head image from the images of the main driver according to a preset head detection model;

[0033] detecting a rotation direction and a rotation angle of the head according to the head image;

[0034] detecting a pupil image from the head image according to a preset face key point detection model;

[0035] detecting a deflection angle of the pupil according to the pupil image;

[0036] calculating the line-of-sight direction of the main driver according to the rotation direction and the rotation angle of the head and the deflection angle of the pupil.

[0037] In an example embodiment of the present application, when the auxiliary display manner includes content highlighting, the auxiliary display of the content on the copilot screen can include:

[0038] enlarging and displaying the APP window and / or part or all of the display content in the APP window according to a preset ratio;

[0039] increasing the contrast of the display content color in the APP window;

[0040] adjust a layout of the displayed content within the APP window;

[0041] When the auxiliary display manner comprises shifting the content display position, the auxiliary display of the content on the co-driver screen comprises shifting the content on the co-driver screen to the center control screen for display.

[0042] In the exemplary embodiments of the present application, the method can further comprise: selecting a corresponding auxiliary display manner according to the APP type, the current function interface, and / or the current state of the center control screen.

[0043] The embodiments of the present application also provide a screen content auxiliary display device, which can comprise a processor and a memory, and the memory stores instructions which, when executed by the processor, implement the screen content auxiliary display method.

[0044] The embodiments of the present application also provide a vehicle, which can comprise a camera and the screen content auxiliary display device.

[0045] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the screen content auxiliary display method.

[0046] The screen content auxiliary display method of the embodiments of the present application can comprise: detecting whether the content on the co-driver screen meets a preset auxiliary display condition; the auxiliary display condition comprises that the content on the co-driver screen itself needs auxiliary display, and / or the content on the co-driver screen is continuously focused by the main driver; when the content on the co-driver screen meets the auxiliary display condition, auxiliary display the content on the co-driver screen; the auxiliary display manner comprises any one or more of the following: content highlight display, shifting the content display position, and changing the content display to content reading. Through the embodiment scheme, the co-driver screen content is automatically auxiliary displayed, and the intelligence and humanization of in-vehicle control are improved.

[0047] Other features and advantages of the present application will be described in the following description, and will become apparent from the description, or will be learned from the practice of the present application. Other advantages of the present application will be realized and attained by the schemes described in the specification and the drawings. BRIEF DESCRIPTION OF DRAWINGS

[0048] The accompanying drawings are included to provide an understanding of the present application, and constitute a part of the specification, together with the embodiments of the present application, to explain the technical solutions of the present application, and do not constitute a limitation on the technical solutions of the present application.

[0049] Figure 1 The flowchart of the screen content auxiliary display method of the embodiments of the present application;

[0050] Figure 2 A block diagram of a screen content aid display device according to an embodiment of the present application is shown.

[0051] Figure 3 A block diagram of a vehicle according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0052] The present application describes a number of embodiments, but the description is exemplary rather than limiting and it will be apparent to those of ordinary skill in the art that numerous more embodiments and implementations are possible within the scope of the embodiments described in the present application. Although a number of possible combinations of features have been set forth herein, and discussed in the specific implementation, many other combinations of the disclosed features are possible. Unless specifically intended otherwise, any feature or element of any embodiment can be used in combination with any other feature or element of any other embodiment, or in replacement of any other feature or element in any other embodiment.

[0053] The present application includes and contemplates combinations of features and elements known to those of ordinary skill in the art. The embodiments, features and elements disclosed herein can also be combined with any conventional features or elements to form a unique application that is defined by the claims. Any feature or element of any embodiment can also be combined with features or elements from other applications to form another unique application that is defined by the claims. Therefore, it should be understood that any feature shown and / or discussed in the present application can be used, alone or in any appropriate combination. Accordingly, the embodiments are not to be restricted, except as by the appended claims and their equivalents. Furthermore, various modifications and changes can be made within the scope of the appended claims.

[0054] Furthermore, in describing representative embodiments, the specification can have presented the method and / or process as a particular sequence of steps. However, to the extent that the method or process depends on more than one step, the method or process should not be limited to the particular sequence of steps described. Other sequences of steps can be possible, and are within the scope of the embodiments. Therefore, the particular order of the steps set forth in the specification is not an limitation on the claims. Further, the claims should not be limited to the steps of the method and / or process in the order written, as they can be readily changed in order to adapt them to different situations.

[0055] An embodiment of the present application provides a screen content aid display method, as shown in Figure 1 the method can include steps S101-S102:

[0056] S101, detecting whether the content on the co-driver screen meets a preset auxiliary display condition; the auxiliary display condition includes that the content on the co-driver screen itself needs auxiliary display, and / or the content on the co-driver screen is continuously focused on by the main driver;

[0057] S102, when the content on the co-driver screen meets the auxiliary display condition, auxiliary displaying the content on the co-driver screen; the auxiliary display mode includes any one or more of the following: content highlighting, shifting the content display position, and changing the content display to content reading.

[0058] In the current scheme, when the co-driver wants to share the information on the co-driver screen with the main driver, the main driver or the co-driver needs to actively operate to transfer the content on the co-driver screen to the center control screen, and the operation does not take into account the special conditions of the cabin environment (for example, three-finger sliding is not easy to operate in the case of vehicle jolt), and such content transfer that needs personnel to actually operate makes the in-vehicle control less intelligent.

[0059] In the exemplary embodiments of the present application, the content information on the co-driver screen and the intention of the main driver to view the content information are automatically detected, and based on the above results, the appropriate auxiliary display mode is automatically selected to show the main driver the information on the co-driver screen that the co-driver wants to share, without the need for the main driver or the co-driver to perform specific operations.

[0060] In the exemplary embodiments of the present application, the detection of whether the content on the co-driver screen meets the auxiliary display condition can include:

[0061] When the content on the co-driver screen meets any one or more of the following, it is determined that the content on the co-driver screen meets the auxiliary display condition that the content on the co-driver screen itself needs auxiliary display:

[0062] The type of the activated application APP on the co-driver screen belongs to a preset auxiliary display type;

[0063] The text size on the co-driver screen is less than a preset threshold;

[0064] The content on the co-driver screen makes the co-driver have a sharing intention; and,

[0065] The content information on the co-driver screen belongs to a preset auxiliary display information.

[0066] In the example embodiments of the present application, first, it can be determined whether the content on the co-driver screen meets the auxiliary display condition according to the APP type of the activated window on the current co-driver screen: before implementing the embodiments of the present application, some APPs or some functions of APPs can be pre-selected as objects that need to be auxiliary displayed, for example, navigation APPs, map APPs (which can have a navigation or destination selection function interface), or picture and / or video playing APPs and other APPs that have content sharing requirements.

[0067] In the example embodiments of the present application, it can also be determined whether the content on the co-driver screen meets the auxiliary display condition according to the text size in the activated window on the current co-driver screen: in order to facilitate sharing the content on the co-driver screen with the main driver, when the text size (the pixel area occupied by a single character) on the co-driver screen is less than a preset threshold, it is considered that the current content state is not conducive to sharing with the main driver, and therefore the content needs to be auxiliary displayed, for example, the text can be enlarged; here, the text size adjustment can be achieved by an OCR (Optical Character Recognition) method or APP output.

[0068] In the example embodiments of the present application, it can also be determined whether the content on the co-driver screen meets the auxiliary display condition by detecting whether the co-driver has an intention to share the content on the co-driver screen: for example, voice detection and action detection can be used to determine whether the co-driver has an intention to share the content on the co-driver screen.

[0069] In the example embodiments of the present application, the method of detecting whether the content on the co-driver screen makes the co-driver have an intention to share can include:

[0070] recognizing the voice content of the co-driver by a voice recognition device on the vehicle;

[0071] when the voice content contains information about wanting to share the content on the co-driver screen, determining that the content on the co-driver screen makes the co-driver have an intention to share.

[0072] In the example embodiments of the present application, the voice in the vehicle can be used to determine whether the co-driver has an intention to share, for example, if the co-driver is detected to say sentences such as “which one do you see”, “look at this”, etc., it is considered that the co-driver has an intention to share, and a deep learning natural language processing-based intention detection model can be used to detect the intention to share in the voice content of the co-driver.

[0073] In the example embodiments of the present application, the method of detecting whether the content on the co-driver screen makes the co-driver have an intention to share can also include:

[0074] obtaining picture information and / or video information of the front passenger through a preset camera in the vehicle;

[0075] detecting, according to the picture information and / or the video information, whether the front passenger has an action of sharing content on the front passenger screen;

[0076] when it is detected that the front passenger has the action of sharing the content on the front passenger screen, determining that the content on the front passenger screen makes the front passenger have a sharing intention.

[0077] In an example embodiment of the present application, whether the current action of the front passenger is to operate the front passenger screen to share the content on the front passenger screen can be determined by obtaining the image / video of the front passenger through a monitoring camera in the vehicle, and a deep learning-based action detection model can be used to achieve this.

[0078] In an example embodiment of the present application, the detection of whether the front passenger has the action of sharing the content on the front passenger screen according to the picture information and / or the video information can include:

[0079] inputting the picture information and / or the video information into a preset action detection model;

[0080] detecting, by the action detection model, whether the action in the picture information and / or the video information conforms to a pre-learned sharing action;

[0081] when the action detection model detects that the action in the picture information and / or the video information conforms to the sharing action, determining that the front passenger has the action of sharing the content on the front passenger screen;

[0082] when the action detection model detects that the action in the picture information and / or the video information does not conform to the sharing action, determining that the front passenger does not have the action of sharing the content on the front passenger screen.

[0083] In an example embodiment of the present application, the sharing action refers to an action of sharing the content on the front passenger screen, for example, an action of enlarging the display content on the screen, an action of searching how to share the content on the screen, a specified action indicating that the front passenger wants to share the content on the screen, etc.

[0084] In an example embodiment of the present application, whether the content on the front passenger screen meets the auxiliary display condition can also be determined by confirming whether the information reflected by the content on the front passenger screen is predetermined information that needs to be displayed to the driver, for example, some pop-up messages (such as road condition emergency broadcast, important notifications, etc.) and other information that needs to be displayed to the driver.

[0085] In the example embodiments of the present application, the content on the co-driver screen can be considered to need auxiliary display to the main driver when the content on the co-driver screen meets any one or more of the above conditions.

[0086] In the example embodiments of the present application, whether the content on the co-driver screen needs auxiliary display to the main driver can also be considered from another angle (the angle of the main driver), for example, if the main driver is very interested in the content on the co-driver screen and pays continuous attention to it, it can also be considered that the content on the co-driver screen needs auxiliary display to the main driver.

[0087] In the example embodiments of the present application, the detection of whether the content on the co-driver screen meets the auxiliary display condition can also include:

[0088] detecting the line-of-sight direction of the main driver, and when the line-of-sight direction of the main driver points to the co-driver screen, and the time length during which the line-of-sight direction of the main driver points to the co-driver screen is greater than or equal to a preset time length threshold, and / or, the number of times during which the line-of-sight direction of the main driver points to the co-driver screen within a preset time length is greater than or equal to a preset number of times threshold, it is determined that the content on the co-driver screen meets the condition of the main driver paying continuous attention to the content on the co-driver screen included in the auxiliary display condition.

[0089] In the example embodiments of the present application, the line-of-sight direction of the main driver can be detected to determine what the main driver is paying attention to, so as to determine whether the main driver is interested in the content on the co-driver screen.

[0090] In the example embodiments of the present application, the detection of the line-of-sight direction of the main driver can include:

[0091] capturing images of the main driver through a preset camera in the vehicle at a preset capture period;

[0092] detecting a head image from the images of the main driver according to a preset head detection model;

[0093] detecting the rotation direction and rotation angle of the head according to the head image;

[0094] detecting a pupil image from the head image according to a preset face key point detection model;

[0095] detecting the offset angle of the pupil according to the pupil image;

[0096] calculating the line-of-sight direction of the main driver according to the rotation direction and rotation angle of the head and the offset angle of the pupil.

[0097] In the exemplary embodiments of the present application, the voice of the main driver can also be detected and recognized by a preset voice detection module. The voice content of the main driver is detected to determine whether the main driver pays more attention to the content of the co-driver screen. For example, if the voice content of the main driver includes "let me take a look", "what is displayed on your side", etc., it can be determined that the main driver pays more attention to the content of the co-driver screen, and the content of the co-driver screen can be displayed.

[0098] In the exemplary embodiments of the present application, the auxiliary display mode can include, but is not limited to, any one or more of the following: content highlighting, shifting the content display position, and changing the content display to content reading.

[0099] In the exemplary embodiments of the present application, when the auxiliary display mode includes content highlighting, the auxiliary display of the content on the co-driver screen can include:

[0100] According to a preset ratio, the APP window and / or part or all of the display content in the APP window are enlarged;

[0101] The contrast of the display content color in the APP window is increased;

[0102] The layout of the display content in the APP window is adjusted.

[0103] In the exemplary embodiments of the present application, by enlarging the APP window or the content, the corresponding text or picture can be enlarged, and the visibility and recognition rate can be increased.

[0104] In the exemplary embodiments of the present application, increasing the contrast of the color can change the text background, change the text color, or combine both, so that the screen display content is more eye-catching and easy to identify by improving the contrast between the background color and the text color. For example, the red text or yellow text on the white background can be modified to black text to improve the contrast through black and white contrast.

[0105] In the exemplary embodiments of the present application, adjusting the layout of the display content in the APP window can include, but is not limited to, displaying the text content or picture that needs to be focused on (for example, the destination, the accident site, the landmark building, etc.) to the central area of the screen, or to the area biased towards the main driver, so that the main driver can conveniently and clearly see the relevant content.

[0106] In the exemplary embodiments of the present application, when the auxiliary display mode includes shifting the content display position, the auxiliary display of the content on the co-driver screen includes shifting the content on the co-driver screen to the center control screen for display.

[0107] In the exemplary embodiments of the present application, the content is transferred to the center screen, so that the main driver and the co-driver can both conveniently view the content on the screen, which is more humanized.

[0108] In the exemplary embodiments of the present application, in order to further facilitate the main driver to understand the screen content, the APP window content can also be read aloud: for example, the text content or picture description displayed in the current APP window of the co-driver screen can be read aloud according to a preset order.

[0109] In the exemplary embodiments of the present application, the pictures contained in the current APP window can be pictures for text display, or can be pause pictures of the current video playing. The descriptions of these pictures can be obtained through a picture description model based on deep learning, and the picture text description can be read aloud.

[0110] In the exemplary embodiments of the present application, the method can further include: selecting a corresponding auxiliary display mode according to the APP type, the current function interface and / or the state of the center screen.

[0111] In the exemplary embodiments of the present application, for example, if the APP is a map navigation type APP, and the current state is a navigation destination search result display interface, the APP window can be transferred to the center screen, and the display font of the search result can be enlarged.

[0112] In the exemplary embodiments of the present application, for example, if the APP is a gallery type APP, and the picture is displayed, the content description of the picture can be read aloud first when the center screen is idle. When the center screen is occupied and cannot display other content (such as continuous navigation), the content description of the picture can be read aloud. When the center screen is not occupied and can display other content, the APP window can be moved to the center screen for display.

[0113] In the exemplary embodiments of the present application, for example, if the APP window is a pop-up message, the screen display part of the pop-up message can be enlarged, the text and background can be changed to high-contrast colors, and the message content can be read aloud.

[0114] In the exemplary embodiments of the present application, at least the following advantages are included:

[0115] 1. No user operation is required, and the content of the co-driver screen is actively displayed for auxiliary display through automatic detection of specific scenes, so that the cabin is more intelligent and humanized.

[0116] 2. The detection accuracy requirement is low (relative to line-of-sight tracking), and it is easier to realize landing at a low cost.

[0117] The present application also provides a screen content auxiliary display device 1, as shown inFigure 2 As shown, the screen content auxiliary display device can include a processor 11 and a memory 12 having instructions stored therein which, when executed by the processor 11, implement the screen content auxiliary display method.

[0118] In exemplary embodiments of the present application, the aforementioned screen content auxiliary display method embodiments are applicable to the device embodiments, and thus will not be repeated here.

[0119] The present application also provides a vehicle 2, as shown in the accompanying drawings. Figure 3 As shown, the screen content auxiliary display device can include a camera 3 and the aforementioned screen content auxiliary display device 1.

[0120] In exemplary embodiments of the present application, the aforementioned screen content auxiliary display method embodiments are applicable to the vehicle embodiments, and thus will not be repeated here.

[0121] The present application also provides a computer readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the screen content auxiliary display method.

[0122] Those of ordinary skill in the art will realize and understand that all or some of the steps in the methods disclosed above and the functional modules / units in the systems and devices can be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementation, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be performed by several physical components in cooperation. Some or all of the components can be implemented as software executed by a processor, such as a digital signal processor or a microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on computer-readable media, which can include computer storage media (or non-transitory media) and communication media (or transitory media). As is well known to those of ordinary skill in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, it is common and well understood by those of ordinary skill in the art that communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and can include any information delivery media.

Claims

1. A method for assisting in the display of screen content, characterized in that, The method includes: The system detects whether the content on the passenger-side screen meets preset auxiliary display conditions. The auxiliary display conditions include: the content on the passenger-side screen itself requires auxiliary display. Specifically, when the content information on the passenger-side screen belongs to preset auxiliary display information, it meets the condition that the content on the passenger-side screen itself requires auxiliary display. The preset auxiliary display information includes pop-up messages. When the content on the passenger-side screen meets the auxiliary display conditions, the content on the passenger-side screen is displayed as an auxiliary display; the auxiliary display methods include: highlighting the content, moving the content display position, and converting the content display into content reading aloud; The method of highlighting content to assist in displaying the content on the passenger-side screen includes: enlarging the display of the APP window and / or part or all of the content displayed within the APP window according to a preset ratio; increasing the color contrast of the content displayed within the APP window; and adjusting the layout of the content displayed within the APP window, including: displaying text or images that require special attention in the central area of ​​the screen, or in an area closer to the driver; the text or images that require special attention include the destination, accident location, and landmarks.

2. The screen content auxiliary display method according to claim 1, characterized in that, The method of detecting whether the content on the passenger-side screen meets the auxiliary display conditions also includes: The content on the passenger-side screen is determined to meet the auxiliary display conditions if it satisfies any one or more of the following: The type of application app activated on the passenger side screen belongs to the preset type that requires auxiliary display; The text size on the passenger-side screen is smaller than a preset threshold. The content on the passenger's screen suggests that the passenger intends to share it.

3. The screen content auxiliary display method according to claim 2, characterized in that, A method for detecting whether the content on the passenger's screen induces the passenger to intend to share it includes: The voice recognition device in the vehicle identifies the voice content of the passenger. When the voice content contains information about wanting to share content on the passenger's screen, it is determined that the content on the passenger's screen makes the passenger intend to share.

4. The screen content auxiliary display method according to claim 2, characterized in that, A method for detecting whether the content on the passenger's screen induces the passenger to intend to share it includes: The system uses a pre-installed camera inside the vehicle to capture images and / or videos of the passenger. Based on the image information and / or the video information, detect whether the passenger has an action of sharing content on the passenger's screen; When it is detected that the passenger is sharing content on the passenger's screen, it is determined that the content on the passenger's screen indicates that the passenger intends to share.

5. The screen content auxiliary display method according to claim 4, characterized in that, The step of detecting whether the passenger has the action of sharing content on the passenger's screen based on the image information and / or the video information includes: Input the image information and / or the video information into a preset motion detection model; The motion detection model detects whether the actions in the image information and / or the video information match the pre-learned sharing actions. When the action detection model detects that the action in the image information and / or the video information matches the sharing action, it is determined that the passenger has the action of sharing the content on the passenger's screen. When the action detection model detects that the action in the image information and / or the video information does not conform to the sharing action, it is determined that the passenger does not have the action of sharing the content on the passenger's screen.

6. The screen content auxiliary display method according to claim 1, characterized in that, The detection of whether the content on the passenger-side screen meets the auxiliary display conditions includes: The driver's gaze direction is detected. When the driver's gaze direction is pointing towards the passenger screen, and the duration of the driver's gaze direction pointing towards the passenger screen is greater than or equal to a preset duration threshold, and / or the number of times the driver's gaze direction points towards the passenger screen within a preset duration is greater than or equal to a preset number of times threshold, it is determined that the content on the passenger screen meets the auxiliary display conditions, namely, that the content on the passenger screen is continuously being watched by the driver.

7. The screen content auxiliary display method according to claim 6, characterized in that, The detection of the driver's line of sight includes: Images of the driver's seat are captured by a camera pre-installed inside the vehicle at a preset acquisition period. The head image is detected from the image of the driver's vehicle based on a preset head detection model; The rotation direction and rotation angle of the head are detected based on the head image; The pupil image is detected from the head image based on a preset facial key point detection model; The pupil offset angle is detected based on the pupil image; The driver's line of sight is calculated based on the direction and angle of head rotation and the offset angle of the pupil.

8. The screen content auxiliary display method according to claim 6, characterized in that, When the auxiliary display method includes shifting the content display position, the auxiliary display of the content on the passenger screen includes: shifting the content on the passenger screen to the central control screen for display.

9. The screen content auxiliary display method according to claim 8, characterized in that, The method further includes: selecting the appropriate auxiliary display method based on the APP type, the current functional interface, and / or the current state of the central control screen.

10. A screen content auxiliary display device, comprising a processor and a memory, wherein the memory stores instructions, characterized in that, When the instruction is executed by the processor, the screen content auxiliary display method as described in any one of claims 1-9 is implemented.

11. A vehicle, characterized in that, Includes a camera and a screen content auxiliary display device as described in claim 10.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the screen content auxiliary display method as described in any one of claims 1-9.

Images