Vehicle image display method and device, vehicle, and storage medium
By setting up a horizontally arranged display area in front of the vehicle's cockpit, displaying a steering image according to the steering direction, and adjusting the display attributes and viewing angle in conjunction with user operation, the problem of steering images distracting the driver's attention is solved, improving driving safety and convenience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- XIAOMI EV TECH CO LTD
- Filing Date
- 2025-04-07
- Publication Date
- 2026-08-04
AI Technical Summary
In existing technologies, the position of the turn signal image on the vehicle's central control display screen is fixed, which requires the driver to distract their eyes when observing the vehicle's condition and viewing the image, affecting driving safety and convenience.
At least two horizontally arranged display areas are set in front of the vehicle's cockpit. The steering image is displayed on the first display area according to the vehicle's steering direction. The display attributes and viewing angle of the image are adjusted in combination with user operation, including display position, size, and viewing angle. The image display effect is improved by floating display and background layer processing.
It achieves the goal of aligning the display position of the steering image with the driver's field of vision when the vehicle is turning, reducing eye movement and improving driving safety and convenience. Furthermore, it enhances driving safety through intelligent analysis and prompts.
Smart Images

Figure CN120573044B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of smart cockpit technology, and in particular to a vehicle image display method, device, vehicle, and storage medium. Background Technology
[0002] With the development of vehicle intelligence, in order to better assist users in driving, vehicles can automatically switch or display turning images captured by specific cameras when the user turns on the turn signal, so as to help the driver better understand the situation around the vehicle and thus improve driving safety.
[0003] In related technologies, the steering image is sent to the vehicle's central control display screen for display, and the display position is fixed. Users need to observe the steering status of the vehicle while viewing the steering image displayed on the central control display screen.
[0004] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention
[0005] To overcome the problems existing in the related technologies, this disclosure provides a vehicle image display method, device, vehicle, and storage medium.
[0006] According to a first aspect of the present disclosure, a vehicle image display method is provided, wherein the display device of the vehicle includes at least two display areas, and the at least two display areas are arranged laterally in front of the driver's cabin of the vehicle;
[0007] The vehicle image display method includes:
[0008] In response to the vehicle being in a steering state, a steering image corresponding to the target turning direction is acquired;
[0009] The turning image is displayed on a first display area of the display device;
[0010] Wherein, the first display area is a display area that is wholly or partially located on one side of the target rotation direction;
[0011] Alternatively, the first display area is the display area directly in front of the driver's seat.
[0012] In some exemplary embodiments of this disclosure, the display position of the turning image is located on one side of the target rotation direction in the first display area.
[0013] In some exemplary embodiments of this disclosure, the display device includes three display areas;
[0014] The first display area is the display area arranged horizontally in the middle of the three display areas;
[0015] In response to the target rotating in the right direction, the display position of the turning image is located on the left side of the first display area.
[0016] Some exemplary embodiments of this disclosure also include:
[0017] In response to the vehicle's steering signal, determine that the vehicle is in a steering state and the target rotation direction.
[0018] Some exemplary embodiments of this disclosure also include:
[0019] Obtain the vehicle's driving information and navigation information;
[0020] Based on the driving information and the navigation information, determine whether the vehicle is in a turning state and the target turning direction.
[0021] Some exemplary embodiments of this disclosure also include:
[0022] In response to the user's first display control operation, the display attributes of the steering image are adjusted;
[0023] The display attributes include: display position and / or display size.
[0024] In some exemplary embodiments of this disclosure, the display size characterizes the screen size of the turning image;
[0025] The display size is smaller than a preset size threshold.
[0026] Some exemplary embodiments of this disclosure also include:
[0027] In response to a second display control operation by the user, the display viewing angle of the steering image is adjusted.
[0028] In some exemplary embodiments of this disclosure, the display viewing angle is the field of view of the directional image.
[0029] In some exemplary embodiments of this disclosure, adjusting the display viewing angle of the turning image in response to a user's second display control operation includes:
[0030] In response to the user's viewpoint switching operation, the display viewpoint of the turning image is adjusted to switch from the first display viewpoint to the second display viewpoint;
[0031] The first display view and the second display view correspond to different image shooting angles.
[0032] In some exemplary embodiments of this disclosure, the method further includes: adjusting the display perspective of the steering image based on the vehicle's condition monitoring information.
[0033] In some exemplary embodiments of this disclosure, the method further includes: displaying the inherent display information in a floating manner in response to the presence of inherent display information in the coverage area of the turning image on the first display area.
[0034] In some exemplary embodiments of this disclosure, the method further includes: configuring a display background layer such that the turning image covers the display background layer;
[0035] The edges of the background layer are partially gradient-processed.
[0036] In some exemplary embodiments of this disclosure, the turning image is displayed as a display card; the color of the display card is a first color;
[0037] The color of the background layer is the second color;
[0038] The vehicle image display method further includes: determining the second color based on the first color;
[0039] And / or, adjust the transparency of the display background layer based on the first color.
[0040] In some exemplary embodiments of this disclosure, the turning image is displayed as a display card; the color of the display card is a first color;
[0041] The color of the background layer is the second color;
[0042] The display background layer includes at least a transition area;
[0043] The color of the transition region is the third color;
[0044] The third color is determined based on the first color and the second color.
[0045] Some exemplary embodiments of this disclosure also include:
[0046] The steering images are analyzed and identified to determine whether any hazardous factors exist;
[0047] In response to the presence of the aforementioned hazard, a preset effect is displayed on the steering image.
[0048] Some exemplary embodiments of this disclosure also include:
[0049] In response to the detection of a collision risk with the vehicle, a risk warning message is generated.
[0050] The risk warning information is displayed floating on the turn signal image.
[0051] Some exemplary embodiments of this disclosure also include:
[0052] The steering image is analyzed, and behavior prediction is performed based on the analysis results to obtain prediction results and corresponding driving suggestions;
[0053] Based on the prediction results and corresponding driving suggestions, the voice broadcast content is obtained;
[0054] The voice broadcast content will be broadcast inside the vehicle's cabin.
[0055] In some exemplary embodiments of this disclosure, the display device is used to project onto the windshield of the vehicle to form a display area extending from one side of the windshield to the other.
[0056] In some exemplary embodiments of this disclosure, the horizontal width of the two display areas is fixed.
[0057] According to a second aspect of the present disclosure, a vehicle image display device is provided, wherein the display device of the vehicle includes at least two display areas, the at least two display areas being arranged laterally in front of the driver's cabin of the vehicle;
[0058] The vehicle image display device includes:
[0059] The image acquisition unit is used to acquire a steering image corresponding to the target rotation direction in response to the vehicle being in a steering state;
[0060] An image display unit is configured to display the turning image on a first display area of the display device;
[0061] Wherein, the first display area is a display area that is wholly or partially located on one side of the target rotation direction;
[0062] Alternatively, the first display area is the display area directly in front of the driver's seat.
[0063] According to a third aspect of the present disclosure, a vehicle is provided, comprising:
[0064] The display device includes at least two display areas arranged laterally in front of the driver's cabin of the vehicle;
[0065] processor;
[0066] Memory used to store processor-executable instructions;
[0067] The processor is configured to implement the steps of any of the vehicle image display methods described in the first aspect above.
[0068] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, which, when the instructions in the storage medium are executed by a processor of a terminal, enables the terminal to perform any of the vehicle image display methods described in the first aspect.
[0069] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements any of the vehicle image display methods described in the first aspect above.
[0070] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:
[0071] This disclosure involves installing a display device comprising at least two display areas in a vehicle, with the at least two display areas arranged laterally in front of the vehicle's driver's cabin. When the vehicle is turning, a turning image corresponding to the target turning direction is acquired; the turning image is then displayed on a first display area of the display device. The first display area may be entirely or partially located on one side of the target turning direction; or, the first display area may be the display area directly in front of the driver's seat, ensuring that the display position of the turning image is consistent with the vehicle's turning direction or with the driver's field of vision. This guarantees that when the user is turning, the operational field of vision is consistent with the position of the turning image, resulting in a better user experience and further enhancing driving safety and convenience.
[0072] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0073] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0074] Figure 1 This is a flowchart illustrating a vehicle image display method according to an exemplary embodiment of the present disclosure.
[0075] Figure 2 This is a schematic diagram illustrating the display position of a directional image in a multi-display area according to an exemplary embodiment of the present disclosure. Figure 1 .
[0076] Figure 3 This is a schematic diagram illustrating the display position of a directional image in a multi-display area according to an exemplary embodiment of the present disclosure. Figure 2 .
[0077] Figure 4 This is a schematic diagram illustrating the display position of a directional image in a multi-display area according to an exemplary embodiment of the present disclosure. Figure 3 .
[0078] Figure 5 This is a schematic diagram illustrating the display position of a directional image in a multi-display area according to an exemplary embodiment of the present disclosure. Figure 4 .
[0079] Figure 6 This is a block diagram illustrating a vehicle image display device according to an exemplary embodiment of the present disclosure.
[0080] Figure 7 This is a block diagram illustrating a vehicle according to an exemplary embodiment of the present disclosure. Detailed Implementation
[0081] Exemplary embodiments of this disclosure will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings denote the same or similar elements unless otherwise indicated. Various changes, modifications, and equivalents of the methods, apparatus, and / or systems described herein will become apparent upon understanding this disclosure. For example, the order of operations described herein is merely illustrative and is not limited to those orders set forth herein, but can be changed as will become apparent upon understanding this disclosure, except for operations that must be performed in a particular order. Furthermore, for clarity and brevity, descriptions of features known in the art may be omitted.
[0082] The embodiments described below, which are examples of some of the embodiments of this disclosure, do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0083] The specific implementation methods of the embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.
[0084] Figure 1 This is a flowchart illustrating a vehicle image display method according to an exemplary embodiment of the present disclosure. The vehicle image display method can be used in electronic devices, including vehicles, which may be new energy vehicles. The display device of the vehicle includes at least two display areas, which are arranged laterally in front of the vehicle's cockpit.
[0085] In specific embodiments of this disclosure, the display device can be a head-up display (HUD), or a strip-shaped or full-screen display formed by embedding one or more layers of transparent display material inside the windshield. By using techniques that project information onto the driver's field of vision, or by displaying the information directly in the driver's field of vision, the driver can obtain information without looking down or shifting their gaze.
[0086] It should be noted that the display device is used to project onto the windshield of the vehicle to form a display area extending from one side of the windshield to the other. Specifically, the horizontal width of the two display areas is fixed.
[0087] For example, the display device may have two display areas, three display areas, or four display areas, with each display area having a fixed horizontal width and each display area being evenly distributed across the area from one side of the windshield to the other, in order to provide users with an aesthetically pleasing display interface.
[0088] like Figure 1 As shown, the method includes the following steps.
[0089] In step S110, in response to the vehicle being in a steering state, a steering image corresponding to the target rotation direction is acquired.
[0090] In an exemplary embodiment of this disclosure, the target rotation direction represents the direction in which the vehicle is about to turn, which can be either left or right. Based on the target rotation direction, a corresponding turning image can be acquired from at least one camera mounted on the side of the vehicle, and the turning image displays environmental information on the side of the target rotation direction.
[0091] In practical implementation, for example, in low-speed turning scenarios, when a vehicle is turning slowly in a narrow street, it can automatically acquire a side view image of the target turning direction to help the driver judge and avoid scraping roadside obstacles. In high-speed lane-changing scenarios, when a vehicle is traveling on a highway and the driver activates the turn signal to prepare to change lanes, it can immediately acquire a blind spot image of the target side to remind the driver to pay attention to vehicles approaching from behind. In parking assistance scenarios, when the vehicle is reversing into a parking space or parallel parking, it displays corresponding side and rear view images based on the target turning direction to assist the driver in completing precise operations.
[0092] It should be noted that the vehicle's steering status can be detected in various ways, such as by the steering wheel angle sensor, the status of the turn signal lights, and vehicle dynamic data, such as yaw rate.
[0093] In some exemplary embodiments of this disclosure, it can be determined whether the vehicle is in a turning state and the target turning direction by monitoring the vehicle's steering signal. Accordingly, the provided vehicle image display method may further include: determining that the vehicle is in a turning state and the target turning direction in response to the vehicle's steering signal.
[0094] It should be noted that the vehicle's turn signal can be either a turn signal stalk activation signal, meaning the user activates the turn signal by moving the stalk, thus confirming that the vehicle is turning and allowing the target turning direction to be determined based on the stalk's position. Alternatively, the vehicle's turn signal can be a steering wheel rotation signal, triggered when the steering wheel is turned to one side by an angle exceeding a preset threshold. In other words, when the user turns the steering wheel left or right by an angle exceeding the preset threshold, the vehicle is confirmed to be turning, and the target turning direction can be determined based on the steering wheel's rotation direction.
[0095] In some exemplary embodiments of this disclosure, it can be determined whether the vehicle is in a turning state and the target turning direction can be determined based on the vehicle's current driving status and the user's desired navigation. Accordingly, the provided vehicle image display method may further include: acquiring vehicle driving information and navigation information; and determining whether the vehicle is in a turning state and the target turning direction based on the driving information and navigation information.
[0096] In practice, driving information includes at least one or more of the following: steering wheel rotation angle, wheel speed, and acceleration sensor data. Navigation information may include real-time route guidance from the navigation system, including but not limited to the current road name, suggested driving direction, and the location of the upcoming turn. The system can determine whether the vehicle is preparing to turn based on the driving information; and by combining this with the route guidance information from the navigation system, the target turning direction can be determined. For example, when the steering wheel rotation angle exceeds a certain angle, or when acceleration sensor data indicates that the vehicle has begun to move laterally, it is determined that the vehicle has entered a turning state; using the suggested driving direction and the location of the upcoming turn in the navigation information, the system can accurately predict and confirm whether the target turning direction is a left or right turn.
[0097] In step S120, a turn signal image is displayed on a first display area of the display device. The first display area is a display area that is wholly or partially located on one side of the target turning direction; or, the first display area is the display area directly in front of the driver's seat.
[0098] It should be noted that the display device needs to display various multimedia information from the vehicle, and there is a need to display multiple different types of services (such as navigation, music, instrument panel, dynamic prompts, etc.). The display device includes multiple display areas. While displaying the turn signal image on the first display area, the other display areas, as well as other parts of the first display area, can also display display cards corresponding to other services, thereby achieving zoned display and providing drivers with a safer, more convenient, and smarter driving experience.
[0099] For example, a zoned display can provide navigation and steering assistance in complex road conditions: the first display area shows the steering image to help the driver observe blind spots; the second display area displays navigation information, providing real-time route guidance; the third display area displays vehicle status (such as fuel level and tire pressure) to ensure the driver has full control over the vehicle's status. It can also provide panoramic imaging and entertainment functions in parking scenarios: the first display area displays a panoramic image including the steering image to assist the driver in precise parking, and other parts of the first display area display instrument panel information such as vehicle speed and engine speed; the second display area displays reversing trajectory guidelines; and the third display area plays music or videos to reduce user waiting time.
[0100] It should be noted that the vehicle can be symmetrically divided into left and right halves using the vehicle's centerline. The vehicle centerline refers to an imaginary straight line drawn along the longitudinal center of the vehicle, extending from the front to the rear. The first display screen is entirely or partially located on the side of the target rotation direction of the vehicle's centerline, displaying the turn signal image at the corresponding position on that side. The display area directly in front of the driver's seat refers to the main display screen area located above the vehicle's instrument panel or center console, within the driver's direct line of sight. This area is designed to allow the driver to quickly obtain important driving information and operational feedback without significantly shifting their gaze. By displaying the turn signal image in the area directly in front of the driver's seat, it minimizes eye movement, maximizes information transmission efficiency, and ensures driving safety and convenience.
[0101] In some specific embodiments of this disclosure, the display position of the turn signal image is located in the first display area on the side closer to the target turning direction, so as to ensure that the driver's line of sight is highly consistent with the presentation position of the turn signal image, thereby further improving the user experience.
[0102] As can be seen from the above steps, the vehicle image display method provided in the embodiments of this disclosure, by setting a display device including at least two display areas on the vehicle, with the at least two display areas arranged horizontally in front of the vehicle's cockpit, acquires a steering image corresponding to the target turning direction when the vehicle is turning; and displays the steering image on the first display area of the display device. The first display area is a display area that is wholly or partially located on one side of the target turning direction; or, the first display area is a display area directly in front of the driver's seat, so that the display position of the steering image is consistent with the vehicle's turning direction or with the field of vision in front of the driver's seat, thereby ensuring that the user's field of vision is consistent with the position of the steering image when the vehicle is turning, resulting in a better user experience and further improving driving safety and convenience.
[0103] In some exemplary embodiments of this disclosure, such as Figures 2 to 5 As shown, the display device includes three display areas, namely display area A, display area B, and display area C from the left to the right of the windshield. The display area directly in front of the driver's seat can be the left part of display area A and display area B.
[0104] like Figure 2 As shown, for a left turn scenario, the first display area can be display area A, and the left turn image can be displayed on the left side of display area A; for a right turn scenario, the right turn image can be displayed on the right side of display area A.
[0105] like Figure 3 As shown, for a left turn scenario, the first display area can be display area B, and the left turn image can be displayed on the left side of display area B; for a right turn scenario, the right turn image can be displayed on the right side of display area B.
[0106] like Figure 4 As shown, for a left turn scenario, the first display area can be display area A, and the left turn image can be displayed to the left of display area A; for a right turn scenario, the first display area can be display area C, and the right turn image can be displayed to the right of display area C.
[0107] In specific implementation, the display device includes three display areas; the first display area is the display area arranged horizontally in the middle of the three display areas; in response to the target turning direction being to the right, the display position of the turn image is located on the left side of the first display area, so that the driver can see the turn image when he looks up.
[0108] In other words, corresponding to the specific examples above, such as Figure 5As shown, for a right turn scenario, the first display area is display area B, and the right turn image can also be displayed to the left of display area B. To distinguish between left and right turn images, in a specific embodiment, for a left turn scenario, the first display area can be display area A, and the left turn image can be displayed to the left of display area A.
[0109] It is understood that the first display area and display position provided in the above embodiments are merely examples and are not intended to limit the scope of protection of this disclosure. In specific implementations, users can set the first display area and the display position of the turning image on the first display area according to their own needs.
[0110] In an exemplary embodiment of this disclosure, the provided vehicle image display method may further include: adjusting the display attributes of the turn signal image in response to a user's first display control operation. It should be noted that the display attributes include: display position and / or display size. The display size characterizes the screen size of the turn signal image, and the display size is smaller than a preset size threshold.
[0111] For example, users can adjust the display position of the turn-around image by dragging it, such as from display area A to display area B, or from the left side to the right side of display area A. The turn-around image is displayed as a window in the first display area. Users can zoom in using gestures such as pinching or spreading two fingers to enlarge the display window and adjust the display size of the turn-around image. It should be noted that, to prevent users from accidentally enlarging the turn-around image display window too much and obscuring other display cards in other areas of the display area, the display size can be set to be smaller than a preset size threshold.
[0112] In an exemplary embodiment of this disclosure, the provided vehicle image display method may further include: adjusting the display viewing angle of the turn signal image in response to a second display control operation by a user. It should be noted that the display viewing angle can be the field of view (FOV) of the turn signal image, or it can be the shooting angle of the turn signal image.
[0113] In an exemplary embodiment of this disclosure, the user controls the operation by clicking a button, dragging gestures, or using voice commands to adjust the display angle of the displayed turning image, thereby changing the field of view, or the field of view (FOV) or observation angle.
[0114] In an exemplary embodiment of this disclosure, multiple cameras can be installed on the vehicle side to capture turning images, thereby capturing images from different positions of the vehicle. For example, a right front wheel view camera captures images from the right front side, a right side vehicle body view camera captures images from the right side, and a right rear wheel view camera captures images from the right rear side. Multiple display views can be provided on the display interface of the turning image for the user to select or switch. Accordingly, in response to the user's second display control operation, adjusting the display view of the turning image may include: in response to the user's view switching operation, adjusting the display view of the turning image from a first display view to a second display view; wherein the first display view and the second display view correspond to different image capturing angles. Specifically, the user switches the display view of the turning image from the first display view to the second display view by sliding a switching gesture or selecting the desired option in the view options, thereby obtaining images from different positions captured by different cameras, thereby accurately assisting driving.
[0115] In an exemplary embodiment of this disclosure, the provided vehicle image display method may further include: adjusting the display angle of the steering image based on vehicle status monitoring information. It should be noted that the display angle can be the field of view (FOV) of the steering image, or it can be the shooting angle of the steering image.
[0116] It should be noted that vehicle status monitoring information may include: steering angle: the rotation angle of the steering wheel or the actual steering angle of the wheels; vehicle speed; acceleration: lateral and longitudinal acceleration; environmental information: such as weather conditions (rainy days, foggy days), road type (urban roads, highways), etc.; vehicle position and attitude: the vehicle's position, tilt angle, etc. are obtained through positioning systems such as GPS or inertial navigation systems.
[0117] Specifically, the vehicle's steering status can be determined based on vehicle status monitoring information, that is, the specific stage in the vehicle's steering process, and the display view can be switched to the display view corresponding to the current stage, which is also the shooting view. For example, if it is determined that the front wheels of the vehicle have completed the steering process to avoid an obstacle, the display view can be automatically switched to the right side of the vehicle body, and the steering image captured by the right side of the vehicle body camera can be displayed on the display interface to help the user to better complete the steering driving.
[0118] In practice, the field of view of the steering image can be adjusted or the optimal field of view of the steering image can be intelligently recommended to the user based on the vehicle's current driving status (such as vehicle speed and steering angle) and the user's historical operating habits. For example, when turning at low speed, a wider field of view can be automatically selected; while when driving at high speed, images at a greater distance may be prioritized.
[0119] For example, in low-speed turning scenarios, such as parking, U-turns, or narrow roads, drivers need a clearer close-up view. The display perspective can be switched to a wider-angle mode to cover a larger near-field area, showing obstacles around the vehicle, such as pedestrians, curbs, and reference lines, such as steering trajectory prediction lines. If the vehicle has a 360° surround view system, it can be automatically activated and a bird's-eye view can be displayed.
[0120] In high-speed lane-changing scenarios, such as lane changes and overtaking on highways, drivers need to pay attention to road conditions in the distance. Adjusting the display view to long-range mode highlights lane lines, other vehicles, and road signs in the distance. It can also be combined with a blind spot monitoring system to display images of the sides and rear, alerting the driver to vehicles in the blind spot.
[0121] In scenarios involving sharp turns or inclines, the vehicle's posture changes, such as tilting or pitching. The camera angle can be adjusted according to the vehicle's posture to maintain a horizontal and stable image, ensuring a smooth display view. For downhill curves, a view closer to the ground can be displayed to help the driver assess road conditions. In nighttime or inclement weather conditions, where light is insufficient or visibility is low, night vision or an infrared camera can be activated to enhance image brightness and contrast. The display view will also automatically switch to wide-angle mode to expand the field of view.
[0122] In some exemplary embodiments of this disclosure, other display cards, such as instrument information display cards, are originally displayed on the first display area. The information displayed is information that the driver needs to pay close attention to frequently during driving. When the turn signal image is displayed in this position, it will cover the original inherent display information. Therefore, the covered inherent information can be displayed in a floating manner to avoid obscuring important information and affecting the driver's driving, thereby improving driving safety. Accordingly, the provided vehicle image display method further includes: responding to the existence of inherent display information in the coverage area of the turn signal image on the first display area, displaying the inherent display information in a floating manner. Inherent display information such as vehicle speed, navigation prompts, and warning information is superimposed on the turn signal image in a semi-transparent or independent window form.
[0123] Furthermore, the priority of the floating information can be dynamically adjusted according to the driving scenario. For example, during normal driving, only the vehicle speed and navigation prompts are displayed. In emergency situations, such as collision warnings, the warning information is highlighted.
[0124] In some exemplary embodiments of this disclosure, to improve the presentation of the turn signal image, the provided vehicle image display method further includes: configuring a display background layer so that the turn signal image covers the display background layer. It should be noted that some edges of the display background layer are gradient-processed. By setting an appropriate color or pattern for the display background layer, the content of the turn signal image is highlighted. This avoids the turn signal image being directly superimposed on complex underlying content, such as other display interfaces, reducing visual interference. The shape of the display background layer is typically rectangular or rounded rectangle, but it can also be designed into other shapes, such as circles or ellipses, according to actual needs.
[0125] In practice, gradient processing enhances the visual hierarchy of the interface while preventing abrupt boundaries between the image and background, allowing the background layer to transition naturally with its surroundings and avoiding harsh edges. The direction and extent of the gradient can be adjusted according to actual needs, for example, gradually fading from the center to the edge.
[0126] In some embodiments of this disclosure, the color of the background layer should contrast with the directional image to ensure that the image content is clearly visible. Common choices include dark backgrounds, such as black or dark gray, or semi-transparent backgrounds, such as dark blue or dark green.
[0127] In some exemplary embodiments of this disclosure, the turn signal image is displayed as a display card, and the color of the display card is a first color. The color of the display background layer is a second color. Accordingly, the vehicle image display method further includes: determining the second color based on the first color; and / or adjusting the transparency of the display background layer based on the first color. Thus, based on the first color of the display card, the color and / or transparency of the display background layer are adaptively set, providing the user with a more aesthetically pleasing and visually superior display effect.
[0128] In some exemplary embodiments of this disclosure, the turning image is displayed as a display card, and the color of the display card is a first color. The color of the display background layer is a second color, such as black. Further, the display background layer includes at least a transition area, and the color of the transition area is a third color; the third color is determined based on the first and second colors. In specific implementations, the third color can be generated by sampling the first and second colors and using them as the basis for the transition color. The position and size of the transition area can be adjusted to achieve the best display effect.
[0129] In practice, linear gradients, radial gradients, and other methods can be used to gradually transition the background layer from the second color in the center to the first color, so that the turning image can be better integrated into the first display area, avoiding harsh boundaries and improving the aesthetics of the display interface and user experience.
[0130] In some exemplary embodiments of this disclosure, the presence of hazardous factors threatening driving safety can be determined by analyzing and identifying the turn signal image, and a warning label can be overlaid on the turn signal image for display, such as a red warning halo to alert the user. Accordingly, the provided vehicle image display method further includes: analyzing and identifying the turn signal image to determine the presence of hazardous factors; and displaying a preset effect on the turn signal image in response to the presence of hazardous factors. For example, this could be displaying a warning label overlaid on the turn signal image.
[0131] It should be noted that computer vision and machine learning algorithms can be used to analyze turning images and identify potential hazards. Possible implementation methods include: Feature extraction: Extracting key features from the turning image, such as object shape, size, and color. Classification / detection model application: Utilizing trained deep learning models, such as convolutional neural networks (CNNs), to identify specific types of objects or situations, such as pedestrians, other vehicles, and road obstacles. Based on information from the current video frame and its historical frames, behavior prediction can be performed to predict potential future situations and determine whether they pose a threat. Assessing whether the identified objects pose a threat to driving safety can be determined using AI algorithms, considering factors such as the object's distance, speed, direction, and the vehicle's own driving status.
[0132] If a hazard is detected, a warning sign will be overlaid on the corresponding turn signal image. The warning sign can be a graphic symbol, such as a triangle warning sign or an exclamation mark warning sign; a text prompt, such as "Pedestrian Ahead"; a dynamic prompt, such as a continuous red halo; or other forms of visual alerts, such as animation effects, designed to quickly attract the driver's attention and prompt appropriate action. It should be noted that a continuous flashing red halo can be displayed at the edge of the turn signal image display, or at the edge of the hazard, to alert the user.
[0133] In practice, the generated warning icons, text messages, or dynamic prompts can be merged with the original images to form a new output screen for display. In some advanced driver assistance systems (ADAS), augmented reality technology can also be used to directly overlay virtual information onto the actual scene in the driver's field of vision.
[0134] In some exemplary embodiments of this disclosure, the provided vehicle image display method further includes: in response to detecting a collision risk to the vehicle, determining risk warning information; and displaying the risk warning information on a floating screen over a turn signal image.
[0135] Collision risk detection, using technologies such as AI algorithms, dynamic path planning, or large AI models, determines whether a vehicle poses a collision risk. If a collision risk is identified, a risk warning message is provided to the user. These warning messages can be categorized as follows: Forward collision risk: e.g., "Vehicle ahead is too close." Side collision risk: e.g., "Vehicle approaching in the right blind spot." Rear collision risk: e.g., "Vehicle rapidly approaching from behind." Pedestrian or obstacle risk: e.g., "Caution: Pedestrian on the left."
[0136] By overlaying floating risk warning information onto the turn signal image, drivers can more intuitively understand the source of danger and how to respond. The risk warning information can also be placed near key areas of the turn signal image. For example, if the risk comes from the left, the warning information can be displayed on the left edge of the image. The warning information can also use a semi-transparent background to ensure that it does not affect the clarity of the turn signal image. The size, color, and transparency of the warning information can also be adjusted according to the risk level. For example, high-risk information uses a prominent red font, while low-risk information uses a more subtle yellow font.
[0137] In some exemplary embodiments of this disclosure, the provided vehicle image display method further includes: performing image analysis on the steering image and performing behavior prediction based on the analysis result to obtain the prediction result and corresponding driving suggestions; obtaining voice broadcast content based on the prediction result and corresponding driving suggestions; and broadcasting the voice broadcast content in the vehicle's cabin.
[0138] In practice, prediction results and driving suggestions for users can be generated through methods such as image-to-text conversion, feature extraction combined with dynamic path planning. For example, if an obstacle is predicted ahead, it is suggested to "slow down and prepare to stop"; if a vehicle is predicted to be rapidly approaching in the right blind spot, it is suggested to "pay attention to the right blind spot and change lanes cautiously".
[0139] The predicted results and driving suggestions can be converted into easily understandable text descriptions using NLP (Natural Language Processing) technology. For example, "An obstacle has been detected 50 meters ahead, please slow down." TTS (Text-to-Speech) technology can then be used to convert the converted text into speech information, which is then played through the vehicle's built-in speaker system. The sound must be clear and audible without being overly harsh or interfering with the normal driving experience. Furthermore, if multiple warnings or prompts exist simultaneously, a reasonable prioritization mechanism must be set up to ensure that the most important information is delivered to the driver first.
[0140] This specific embodiment can not only intelligently analyze the steering image, but also provide driving suggestions based on these analyses and inform the driver via voice, thereby improving driving safety.
[0141] Those skilled in the art will understand that the various display implementation processes provided in the above exemplary embodiments can be implemented individually or in combination to provide users with a variety of display services. For example, when a potential forward collision is detected, "Forward Collision Risk: Please Slow Down" is displayed in the center or front area of the turn signal image. The vehicle in front is surrounded by a red warning box, and a voice reminder "Please be aware of the vehicle in front, please slow down" is played.
[0142] For example, if a hazard is detected in the blind spot, a message will be displayed on the side of the turn signal camera indicating "Vehicle approaching in the right blind spot." A dynamic arrow or a flashing red marker will also be displayed near the vehicle in the blind spot.
[0143] For example, if a pedestrian is detected around the vehicle, the system displays "Caution: Pedestrian on the left" in the lower left corner of the turn signal image. A prominent red box is overlaid on the pedestrian image, and a voice prompt, "Caution: Pedestrian, please brake," is played.
[0144] It is understood that in a reversing scenario, when a user is reversing the vehicle, the reversing image can be displayed on the display device. Simultaneously, the steering image display method provided in the above embodiments can be applied to display the steering image during the reversing process in the first display area. This display can be combined with the direction of steering wheel rotation; for example, when reversing to the left, a left-turning image can be displayed. Steering images from both the left and right sides can also be displayed simultaneously to provide more comprehensive image support for safe driving. Further details regarding the embodiments disclosed herein will not be elaborated upon here.
[0145] It should be noted that the acquisition, storage, use, and processing of information or data in this disclosed technical solution comply with the relevant provisions of national laws and regulations.
[0146] Figure 6 This is a block diagram illustrating a vehicle image display device according to some exemplary embodiments of the present disclosure. The vehicle display device includes at least two display areas, which are arranged laterally in front of the vehicle's driver's cabin.
[0147] It should be noted that the display device is used to project onto the windshield of the vehicle to form a display area extending from one side of the windshield to the other. The horizontal width of the two display areas is fixed.
[0148] Reference Figure 6 The device 600 includes an image acquisition unit 601 and an image display unit 602.
[0149] The image acquisition unit 601 is used to acquire a steering image corresponding to the target rotation direction in response to the vehicle being in a steering state.
[0150] The image display unit 602 is used to display a turning image on a first display area of the display device.
[0151] The first display area is a display area that is entirely or partially located on one side of the target rotation direction; or, the first display area is the display area directly in front of the driver's seat.
[0152] In some exemplary embodiments of this disclosure, the display position of the turning image is located on one side of the target rotation direction in the first display area.
[0153] In some exemplary embodiments of this disclosure, the display device includes three display areas; the first display area is the display area arranged horizontally in the middle of the three display areas; in response to the target rotation direction being to the right, the display position of the turning image is located on the left side of the first display area.
[0154] In some exemplary embodiments of this disclosure, a first steering state monitoring unit is further included, configured to determine, in response to a steering signal of the vehicle, that the vehicle is in a steering state and a target turning direction.
[0155] In some exemplary embodiments of this disclosure, a second steering state monitoring unit is further included, configured to: acquire vehicle driving information and navigation information; and determine whether the vehicle is in a steering state and the target steering direction based on the driving information and navigation information.
[0156] In some exemplary embodiments of this disclosure, the system further includes: a first display adjustment unit configured to: adjust the display attributes of the turn signal image in response to a first display control operation by a user; wherein the display attributes include: display position and / or display size. It should be noted that the display size represents the screen size of the turn signal image; the display size is smaller than a preset size threshold.
[0157] In some exemplary embodiments of this disclosure, a second display adjustment unit is further included, configured to adjust the display viewing angle of the turning image in response to a second display control operation by a user. It should be noted that the display viewing angle is the field of view angle of the turning image.
[0158] In some exemplary embodiments of this disclosure, the second display adjustment unit is specifically configured as follows:
[0159] In response to the user's perspective switching operation, the display perspective of the turning image is adjusted to switch from the first display perspective to the second display perspective;
[0160] The first display view and the second display view correspond to different image shooting angles.
[0161] In some exemplary embodiments of this disclosure, a third display adjustment unit is also included, configured to adjust the display angle of the steering image based on vehicle status monitoring information.
[0162] In some exemplary embodiments of this disclosure, a first display unit is further included, configured to display the inherent display information in a floating manner in response to the presence of inherent display information in the coverage area of the turning image on the first display area.
[0163] In some exemplary embodiments of this disclosure, a second display unit is further included, configured to: configure a display background layer such that the turning image covers the display background layer; wherein a portion of the edges of the display background layer is gradient-processed.
[0164] In some exemplary embodiments of this disclosure, the turning image is displayed as a display card; the color of the display card is a first color, and the color of the display background layer is a second color. It also includes a third display unit configured to: determine the second color based on the first color; and / or, adjust the transparency of the display background layer based on the first color.
[0165] It should be noted that the turning image is displayed in a card display manner; the color of the display card is the first color, and the color of the background layer is the second color. The background layer includes at least a transition area; the color of the transition area is the third color; the third color is determined based on the first and second colors.
[0166] In some exemplary embodiments of this disclosure, a fourth display unit is also included, configured to:
[0167] Analyze and identify steering images to determine if any hazardous factors exist;
[0168] In response to the presence of hazardous factors, a preset effect is displayed on the turn signal image.
[0169] In some exemplary embodiments of this disclosure, a fifth display unit is also included, configured to:
[0170] In response to the detection of a potential collision risk, a risk warning message is generated.
[0171] The risk warning information is displayed floating above the turn signal image.
[0172] In some exemplary embodiments of this disclosure, a sixth display unit is also included, configured to:
[0173] The system analyzes the steering image and predicts behavior based on the analysis results, thus obtaining the prediction results and corresponding driving suggestions.
[0174] Based on the prediction results and corresponding driving suggestions, the voice broadcast content is obtained;
[0175] The voice prompts will be played in the vehicle's cabin.
[0176] Regarding the apparatus in the above embodiments, the specific manner in which each unit performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0177] This disclosure provides a vehicle including a display device and a processor as described above. The display device includes at least two display areas arranged laterally in front of the vehicle's driver's cabin.
[0178] Figure 7 This is a block diagram illustrating a vehicle 700 according to an exemplary embodiment. For example, vehicle 700 can be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicle. Vehicle 700 can be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.
[0179] Reference Figure 7 The vehicle 700 may include various subsystems, such as an infotainment system 710, a perception system 720, a decision control system 730, a drive system 740, and a computing platform 750. The vehicle 700 may also include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and each component of the vehicle 700 can be interconnected via wired or wireless means.
[0180] In some embodiments, the infotainment system 710 may include a communication system, an entertainment system, and a navigation system, etc.
[0181] The perception system 720 may include several sensors for sensing information about the environment surrounding the vehicle 700. For example, the perception system 720 may include a global positioning system (which may be GPS, BeiDou, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.
[0182] The decision control system 730 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.
[0183] The drive system 740 may include components that provide powered motion to the vehicle 700. In one embodiment, the drive system 740 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of internal combustion engines, electric motors, and compressed air engines. The engine is capable of converting energy provided by the energy source into mechanical energy.
[0184] Some or all of the functions of vehicle 700 are controlled by computing platform 750. Computing platform 750 may include at least one processor 751 and memory 752, and processor 751 may execute instructions 753 stored in memory 752.
[0185] Processor 751 can be any conventional processor, such as a commercially available CPU. Processors may also include graphics processing units (GPUs), field-programmable gate arrays (FPGAs), systems-on-chips (SoCs), application-specific integrated circuits (ASICs), or combinations thereof.
[0186] The memory 752 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.
[0187] In addition to instruction 753, memory 752 can also store data, such as road maps, route information, vehicle position, direction, speed, and other data. The data stored in memory 752 can be used by computing platform 750.
[0188] In this embodiment of the disclosure, the processor 751 may execute instructions 753 to complete all or part of the steps of the vehicle image display method described above.
[0189] In some embodiments of this disclosure, a non-transitory computer-readable storage medium is provided, which, when the instructions in the storage medium are executed by a vehicle's processor, enables the vehicle to perform the vehicle image display method described above.
[0190] In some embodiments of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the vehicle image display method described above.
[0191] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.
[0192] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A vehicle image display method characterized by comprising: The vehicle's display device includes at least two display areas arranged laterally in front of the vehicle's cockpit; the display device is used to project onto the vehicle's windshield to form a display area extending from one side of the windshield to the other. The vehicle image display method includes: In response to the vehicle being in a steering state, a steering image corresponding to the target turning direction is acquired; The turning image is displayed on a first display area of the display device, and the display position of the turning image is located on one side of the target rotation direction in the first display area; The first display area is the display area directly in front of the driver's seat, which refers to the main display screen area located above the vehicle's dashboard or center console within the driver's direct line of sight.
2. The vehicle image display method according to claim 1, characterized by The display device includes three display areas, namely display area A, display area B and display area C from left to right of the windshield; When the first display area is display area A, in response to the target rotating in the left direction, the display position of the turning image is located on the left side of the display area A, and in response to the target rotating in the right direction, the display position of the turning image is located on the right side of the display area A. Alternatively, when the first display area is display area B, in response to the target rotating in the left direction, the display position of the turning image is located on the left side of the display area B, and in response to the target rotating in the right direction, the display position of the turning image is located on the right side of the display area B. Alternatively, when the first display area is the left-hand portion of display area A and display area B, in response to the target rotating to the left, the display position of the turning image is located to the left of display area A, and in response to the target rotating to the right, the display position of the turning image is located to the left of display area B.
3. The vehicle image display method according to claim 1, characterized by Also includes: In response to the vehicle's steering signal, determine that the vehicle is in a steering state and the target rotation direction.
4. The vehicle image display method according to claim 1, characterized by Also includes: Obtain the vehicle's driving information and navigation information; Based on the driving information and the navigation information, determine whether the vehicle is in a turning state and the target turning direction.
5. The vehicle image display method according to claim 1, characterized by Also includes: In response to the user's first display control operation, the display attributes of the steering image are adjusted; The display attributes include: display position and / or display size.
6. The vehicle image display method according to claim 5, characterized by The display size represents the screen size of the turning image; The display size is smaller than a preset size threshold.
7. The vehicle image display method according to claim 1, characterized by Also includes: In response to a second display control operation by the user, the display viewing angle of the steering image is adjusted.
8. The vehicle image display method according to claim 7, characterized by The display viewing angle is the field of view of the directional image.
9. The vehicle image display method according to claim 7, characterized by In response to a second display control operation by the user, adjusting the display viewing angle of the steering image includes: In response to the user's viewpoint switching operation, the display viewpoint of the turning image is adjusted to switch from the first display viewpoint to the second display viewpoint; The first display view and the second display view correspond to different image shooting angles.
10. The vehicle image display method according to claim 1, characterized by Also includes: Based on the vehicle's status monitoring information, the display angle of the steering image is adjusted.
11. The vehicle image display method according to claim 1, characterized by Also includes: In response to the presence of inherent display information in the coverage area of the turning image on the first display area, the inherent display information is displayed in a floating manner.
12. The vehicle image display method according to claim 1, characterized by Also includes: Configure a display background layer so that the turning image covers the display background layer; The edges of the background layer are partially gradient-processed.
13. The vehicle image display method according to claim 12, characterized by The turn signal is displayed in the form of a display card; the color of the display card is a first color. The color of the background layer is the second color; The vehicle image display method further includes: determining the second color based on the first color; And / or, adjust the transparency of the display background layer based on the first color.
14. The vehicle image display method according to claim 12, characterized by The turn signal is displayed in the form of a display card; the color of the display card is a first color. The color of the background layer is the second color; The display background layer includes at least a transition area; The color of the transition region is the third color; The third color is determined based on the first color and the second color.
15. The vehicle image display method according to claim 1, characterized by Also includes: The steering images are analyzed and identified to determine whether any hazardous factors exist; In response to the presence of the aforementioned hazard, a preset effect is displayed on the steering image.
16. The vehicle image display method according to claim 1, characterized by Also includes: In response to the detection of a collision risk with the vehicle, a risk warning message is generated. The risk warning information is displayed floating on the turn signal image.
17. The vehicle image display method according to claim 1, characterized by Also includes: The steering image is analyzed, and behavior prediction is performed based on the analysis results to obtain prediction results and corresponding driving suggestions; Based on the prediction results and corresponding driving suggestions, the voice broadcast content is obtained; The voice broadcast content will be broadcast inside the vehicle's cabin.
18. The vehicle image display method according to any one of claims 1 to 16, characterized by The horizontal width of the two display areas is fixed.
19. A vehicle image display device, comprising: The vehicle's display device includes at least two display areas arranged laterally in front of the vehicle's cockpit; the display device is used to project onto the vehicle's windshield to form a display area extending from one side of the windshield to the other. The vehicle image display device includes: The image acquisition unit is used to acquire a steering image corresponding to the target rotation direction in response to the vehicle being in a steering state; An image display unit is used to display the turning image on a first display area of the display device, wherein the display position of the turning image is located on one side of the target rotation direction in the first display area; The first display area is the display area directly in front of the driver's seat, which refers to the main display screen area located above the vehicle's dashboard or center console within the driver's direct line of sight.
20. A vehicle characterized by comprising: include: The display device includes at least two display areas arranged laterally in front of the driver's cabin of the vehicle; processor; Memory used to store processor-executable instructions; The processor is configured to implement the vehicle image display method according to any one of claims 1 to 18.
21. A non-transitory computer readable storage medium having stored thereon instructions that, when executed by a processor of a terminal, enable the terminal to perform the steps of the vehicle image display method of any one of claims 1 to 18.
22. A computer program product, characterised in that, including a computer program that, when executed by a processor, carries out the vehicle image display method of any one of claims 1 to 18.