Display control method and device, vehicle, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a display control method and device, a vehicle, electronic equipment and a storage medium, and the display control method is applied to a first vehicle and comprises the steps that the driving state of the first vehicle is determined; switching a rendering angle of a virtual image display arranged in the first vehicle according to the driving state of the first vehicle; and determining a display picture displayed on the virtual image display according to the current rendering angle.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle technology, and in particular to a display control method, device, vehicle, electronic device, and storage medium. Background Art

[0002] With the development of on-board visual systems and high-precision maps, intelligent driving display functions (abbreviated as "intelligent driving"), which detect the surrounding environment of the vehicle and perform 3D real-time rendering, are becoming increasingly common. However, in existing technologies, the implementation of intelligent driving functions mainly focuses on rendering and displaying a single perspective and a single amount of information. Although some technical solutions can provide manual control to view display images from different perspectives or manually adjust the density and granularity of the surrounding environment display, these require manual adjustment by the user, and adjustments are made on the rendered image, which may not be able to adjust the display image to the user's desired perspective. In other words, existing intelligent driving information cannot automatically switch the rendering perspective for rendering and display according to the needs of different driving scenarios. Drivers have different requirements and content for intelligent driving modules in different scenarios. Existing technologies cannot take into account the needs of all scenarios. For example, the fixed display range does not increase driving safety in some scenarios. For example, when turning, the driver is more focused on the surrounding road conditions, but existing technologies cannot adapt to this display requirement and cannot effectively improve driving safety. Summary of the Invention

[0003] The purpose of the embodiments of the present disclosure is to provide a display control method, device, vehicle, electronic device and storage medium, which can automatically switch the rendering angle of the display screen according to the driving status of the vehicle, so that the display displayed in the display screen is more consistent with the current driving scene and improve the driver's driving safety.

[0004] In order to solve the above technical problems, the embodiments of the present disclosure adopt the following technical solutions:

[0005] A display control method, applied to a first vehicle, comprising:

[0006] determining a driving state of the first vehicle;

[0007] switching a rendering angle of a virtual image display provided in the first vehicle according to a driving state of the first vehicle;

[0008] A display image displayed on the virtual image display is determined according to the current rendering angle.

[0009] In some embodiments, determining a display image displayed on the virtual image display according to the current rendering angle includes:

[0010] determining a display object to be displayed in the display screen according to the current rendering angle;

[0011] Based on the current rendering angle, the display object, and the state parameters corresponding to the display object, generating an image at the current rendering angle;

[0012] The image frame is magnified and imaged by the virtual image display to present the display frame.

[0013] In some embodiments, determining the display object to be displayed in the display screen according to the current rendering angle includes:

[0014] Identifying environmental objects in a driving environment of the first vehicle, the environmental objects comprising at least one of static objects, dynamic objects, and lane lines;

[0015] According to the current rendering angle, a display object in the display picture is determined from the identified environmental objects.

[0016] In some embodiments, determining the display object in the display screen from the identified environmental objects according to the current rendering angle includes:

[0017] If the current rendering angle is a top-down perspective, determining the first vehicle as the display object, and determining static objects and / or dynamic objects within a first preset range around the first vehicle in the environmental objects as the display objects;

[0018] If the current rendering angle is a rearview perspective, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a second preset range behind the first vehicle in the environmental objects as the display objects;

[0019] If the current rendering angle is a first forward-viewing angle, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a third preset range in front of the first vehicle in the environmental objects as the display objects;

[0020] If the current rendering angle is the second forward viewing angle, the first vehicle and static objects within a fourth preset range around the first vehicle in the environmental objects are determined as the display objects.

[0021] In some embodiments, switching the rendering angle of the virtual image display provided in the first vehicle according to the driving state of the first vehicle includes:

[0022] determining a driving behavior of the first vehicle and a vehicle state of the first vehicle;

[0023] The rendering angle to which the virtual image display needs to be switched is determined according to the driving behavior of the first vehicle or the vehicle state of the first vehicle.

[0024] In some embodiments, the vehicle state of the first vehicle includes a current gear, wherein determining the driving behavior of the first vehicle includes:

[0025] determining an expected driving behavior and / or a current driving behavior of the first vehicle based on at least one of positioning information of the first vehicle, lighting information of the first vehicle, navigation data corresponding to the first vehicle, and information about a current driving environment of the first vehicle, where the driving behavior of the first vehicle includes the expected driving behavior or the current driving behavior;

[0026] The determining, based on the driving behavior of the first vehicle or the vehicle state of the first vehicle, a rendering angle to which the virtual image display needs to be switched includes:

[0027] If the expected driving behavior is turning, or the current driving behavior is turning, determining that the rendering angle to which the virtual image display needs to be switched is a top-down perspective;

[0028] If the expected driving behavior is merging lanes, or the current driving behavior is merging lanes, determining that the rendering angle to which the virtual image display needs to be switched is a rearview perspective;

[0029] If the current gear is a forward gear or a reverse gear, determining that the rendering angle to which the virtual image display needs to be switched is a first forward viewing angle;

[0030] If the current gear is the parking gear, it is determined that the rendering angle to which the virtual image display needs to be switched is the second forward viewing angle.

[0031] In some embodiments, determining the display object in the display screen from the identified environmental objects according to the current rendering angle includes:

[0032] determining an object type of the identified environmental object and a distance between the environmental object and the first vehicle;

[0033] Filtering the identified environmental objects according to display configuration information and a current rendering angle corresponding to the virtual image display, and determining environmental objects that meet the display configuration information and the current rendering angle as display objects in the display picture, wherein the display configuration information includes an information display type and / or an information display range;

[0034] In the display image, the display object is represented by a 3D rendering model corresponding to the display object.

[0035] In some embodiments, the method further comprises:

[0036] If the distance between the identified environmental object and the first vehicle meets a preset distance condition, corresponding prompt information is displayed on the virtual image display.

[0037] In some embodiments, the method further comprises:

[0038] Obtaining identity information of the driver of the first vehicle;

[0039] Determining, based on the driver's identity information, a display screen presentation mode that matches the driver's identity information from preset display screen presentation modes;

[0040] The virtual image display is controlled to display the display image at the rendering angle corresponding to the presentation mode.

[0041] The present disclosure also provides a display control device, including:

[0042] a first determining module configured to determine a driving state of a first vehicle;

[0043] a switching module configured to switch a rendering angle of a virtual image display provided in the first vehicle according to a driving state of the first vehicle;

[0044] The third determining module is configured to determine a display image displayed on the virtual image display according to a current rendering angle.

[0045] An embodiment of the present disclosure also provides a vehicle, comprising the above-mentioned display control device.

[0046] An embodiment of the present disclosure further provides an electronic device, comprising at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program on the memory.

[0047] An embodiment of the present disclosure further provides a computer-readable storage medium, wherein the computer-readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0048] The display control method, device, vehicle, electronic device and storage medium provided by the embodiments of the present disclosure determine the driving status of a first vehicle; then, according to the driving status of the first vehicle, switch the rendering angle of a virtual image display provided in the first vehicle; thereafter, determine the display screen displayed on the virtual image display according to the current rendering angle, and can render and display relevant environmental information in the driving environment of the first vehicle at a suitable rendering angle according to the different driving statuses of the first vehicle, so that the display of information in the display screen is more consistent with the current driving scene, thereby meeting the effective display of information in different driving statuses and meeting the viewing needs of users, while improving the driver's driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0050] Figure 1 is a flow chart of a display control method according to an embodiment of the present disclosure;

[0051] Figure 2 A rendering schematic diagram of the first rendering angle and a rendered display screen after the virtual image display switches to the first rendering angle in the display control method of an embodiment of the present disclosure;

[0052] Figure 3 A rendering schematic diagram of the second rendering angle and a rendered display screen after the virtual image display switches to the second rendering angle in the display control method of an embodiment of the present disclosure;

[0053] Figure 4 A rendering schematic diagram of a third rendering angle and a rendered display screen after the virtual image display switches to the third rendering angle in the display control method of an embodiment of the present disclosure;

[0054] Figure 5 Schematic diagram of the structure of the display control device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0055] Various aspects and features of the present disclosure are described herein with reference to the accompanying drawings.

[0056] It should be understood that various modifications may be made to the embodiments disclosed herein. Therefore, the above description should not be considered as limiting, but merely as an example of an embodiment. Other modifications within the scope and spirit of the present disclosure will occur to those skilled in the art.

[0057] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the general description of the present disclosure given above and the detailed description of the embodiments given below, serve to explain the principles of the present disclosure.

[0058] These and other characteristics of the present disclosure will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.

[0059] It should also be understood that although the present disclosure has been described with reference to certain specific examples, those skilled in the art will be able to realize many other equivalent forms of the present disclosure that have the characteristics recited in the claims and are therefore within the scope of protection defined thereby.

[0060] The above and other aspects, features and advantages of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0061] Specific embodiments of the present disclosure will be described hereinafter with reference to the accompanying drawings; however, it should be understood that the claimed embodiments are merely examples of the present disclosure, which may be implemented in a variety of ways. Well-known and / or repetitive functions and structures are not described in detail to avoid obscuring the present disclosure with unnecessary or redundant detail. Therefore, the specific structural and functional details claimed herein are not intended to be limiting, but rather serve merely as a basis and representative basis for teaching those skilled in the art to variously employ the present disclosure with substantially any suitable detailed structure.

[0062] This description may use the phrases "in one embodiment," "in another embodiment," "in a further embodiment," or "in other embodiments," each of which may refer to one or more of the same or different embodiments according to the present disclosure.

[0063] Figure 1 A flow chart of a display control method according to an embodiment of the present disclosure is shown. Figure 1 As shown, an embodiment of the present disclosure provides a display control method, applied to a first vehicle, comprising:

[0064] S101: Determine the driving state of the first vehicle.

[0065] The display control method is specifically applied to a first vehicle equipped with a virtual image display. As a type of vehicle-mounted intelligent driving module, the virtual image display can render and display vehicle condition and navigation information, vehicle ecological service information (such as dining and shopping navigation information), warning information (such as obstacle warning), and other information.

[0066] The virtual image display is mainly composed of components such as PGU (Picture Generation Unit), amplifying optical path (including reflection and / or transmission optical path). The working principle of the virtual image display is that the image generation unit integrates information such as navigation, ADAS driving assistance system, vehicle signals, etc. to perform virtual and real overlap and image rendering to form a 2D or 3D image screen, and then amplifies the image screen through the amplifying optical path. The image light used to form the image screen is finally reflected through the windshield to the human eye, so that the user can see the virtual image formed in front of the windshield (that is, the display screen of the virtual image display). The virtual image display may include a renderer, and the renderer includes an acquisition device such as a camera to collect driving environment information around the first vehicle to perform image rendering to generate an image screen. The image screen is provided to the PGU for display, and the PGU emits image light and is incident on the amplifying optical path.

[0067] The first vehicle is provided with a controller that is in communication with the virtual image display to implement the above-mentioned display control method. The controller may be an independent controller or a vehicle controller unit (VCU).

[0068] The driving state of the first vehicle may include being in motion or parked, and may also include specific driving behaviors during driving, such as driving straight, turning, merging, cornering, and reversing. The driving state of the first vehicle may also include vehicle status used to determine whether the vehicle is in motion or parked, and / or used to determine driving behaviors. The vehicle state may include the vehicle's current gear position, which includes B, D, L, N, P, R, and S, representing brake, forward, low, neutral, park (park), reverse, and sport mode, respectively, to determine the vehicle's specific driving state. For example, when parking, the first vehicle must be in P, which stops braking and prevents rolling. When the first vehicle is temporarily parked, such as while waiting at a traffic light, it may be in N. The vehicle state may also include vehicle speed, fuel consumption / battery charge, and range.

[0069] The driving state of the first vehicle can be determined based on a control signal from a vehicle controller, a vehicle-mounted system signal (e.g., a high-precision map connected to the first vehicle), or driving signals detected by sensors installed on the first vehicle. For example, after the first vehicle turns on navigation, the position and lane of the first vehicle can be located in real time using a high-precision map to determine whether the first vehicle is about to turn.

[0070] S102: Switching a rendering angle of a virtual image display provided in the first vehicle according to the driving state of the first vehicle.

[0071] After determining the driving status of the first vehicle, the controller of the first vehicle switches the rendering angle of the virtual image display (specifically, the renderer) according to the driving status. A 3D scene is generated based on the first vehicle and the environmental objects in the driving environment in which the first vehicle is located (including lane lines, dynamic objects such as vehicles, pedestrians, and non-motor vehicles in the lane, and static objects such as traffic lights and traffic signs). The first vehicle and environmental objects in the 3D scene are all 3D models, that is, the first vehicle and the surrounding environmental objects are represented by 3D models. It can be understood that the rendering angle of the virtual image display refers to the rendering perspective of the renderer, that is, the perspective of the virtual camera in the renderer to frame the 3D scene, and the renderer renders the framing of the virtual camera to generate an image screen.

[0072] For example, Figure 2 As shown in (a), the rendering angle may be a forward-looking angle to render the first vehicle 10 and the driving environment (including the lane and other vehicles in the lane, etc.) in front of the first vehicle 10 (including the front and side front); Figure 3 As shown in (c), the rendering angle may be a top-down perspective, so as to render the first vehicle 10 and the surrounding driving environment from the top of the first vehicle 10 .

[0073] like Figure 2 As shown in (a), when the first vehicle is in a normal driving state, for example, driving straight along a lane at a certain speed, the renderer of the virtual image display can collect information of the driving environment in front of the first vehicle 10 from a forward perspective on the left side of the first vehicle and render according to the collected information.

[0074] The rendering perspective is the perspective of the virtual camera 20 framing the 3D scene, for example, Figure 2 The virtual camera 20 shown in (a) is located above and behind the first vehicle 10 .

[0075] S103: Determine a display image to be displayed on the virtual image display according to the current rendering angle.

[0076] According to the driving state of the first vehicle, after the rendering angle of the virtual image display is switched, the controller of the first vehicle can control the renderer of the virtual image display to render the first vehicle and its surrounding environment according to the current rendering angle to obtain a rendered image. The virtual image formed by the image light after the image is magnified by the magnifying optical path in front of the windshield is the display image presented by the virtual image display. Figure 2 After rendering the front view shown in (a), the virtual image display can show Figure 2 The display screen shown in (b) is displayed in a semi-top-down perspective format and covers at least three lanes and objects around the lanes, allowing the user to easily see other vehicles, lane lines, etc. around the first vehicle.

[0077] The display control method provided by the embodiment of the present disclosure determines the driving status of a first vehicle; then, according to the driving status of the first vehicle, switches the rendering angle of a virtual image display provided in the first vehicle; thereafter, determines the display screen displayed on the virtual image display according to the current rendering angle. According to the different driving statuses of the first vehicle, the relevant environmental information in the driving environment of the first vehicle can be rendered and displayed at a suitable rendering angle, so that the display of information in the display screen is more consistent with the current driving scene, thereby meeting the effective display of intelligent driving information in different driving scenes and meeting the viewing needs of users, while improving the driver's driving safety.

[0078] In some embodiments, in step S103, determining a display image displayed on the virtual image display according to the current rendering angle includes:

[0079] S1031: Determine a display object to be displayed in the display screen according to the current rendering angle;

[0080] S1032: Generate an image at the current rendering angle based on the current rendering angle, the display object, and a state parameter corresponding to the display object;

[0081] S1033: Enlarging the image frame through the virtual image display to present the display frame.

[0082] Specifically, since the rendering angle is the viewing angle of the virtual camera in the renderer to view the 3D scene, once the rendering angle is determined, the display objects that can be displayed in the display screen are also determined. The display screen content is different under different rendering angles.

[0083] After switching the rendering angle of the virtual image display in the first vehicle, the controller controls the position of virtual camera 20 to adjust to the position in the 3D scene corresponding to the rendering angle. After adjusting the position of virtual camera 20, the controller controls the renderer to identify objects within the viewing range of virtual camera 20 as display objects. Based on the specific name or type of the display object and the corresponding state parameters of the display object, the 3D scene is rendered in 3D, generating an image at the current rendering angle. The image includes 3D rendered models of the vehicle (the first vehicle), lane markings, and surrounding objects such as the preceding vehicle.

[0084] The state parameter corresponding to the display object includes at least one of the relative position between the display object and the first vehicle, the distance between the display object and the first vehicle, the size of the display object, and the moving speed of the display object.

[0085] In this embodiment, after determining each display object, rendering is performed according to the state parameters corresponding to the display object, which can highly integrate the real driving environment to obtain a more accurate and reasonable 3D rendering model, thereby improving the rendering effect.

[0086] After the image is rendered by the renderer, the virtual image display can magnify the image through a magnifying light path formed by a plane mirror and / or a curved mirror, and finally present the display image in front of the windshield.

[0087] In some embodiments, in step S1031, determining a display object to be displayed in the display screen according to the current rendering angle includes:

[0088] S201: Identifying environmental objects in the driving environment of the first vehicle;

[0089] S202: Determine, according to the current rendering angle, a display object in the display screen from the identified environmental objects.

[0090] The environmental objects include at least one of static objects, dynamic objects, and lane lines. Static objects include traffic signs (such as speed limit signs and straight ahead signs), traffic lights, and buildings. Dynamic objects include other vehicles other than the first vehicle, pedestrians, and non-motorized vehicles.

[0091] In this embodiment, when determining the display object, the environmental objects in the driving environment of the first vehicle 10 can be identified and a 3D scene can be established. Then, according to the current rendering angle, the display object in the display screen can be determined from the identified environmental objects.

[0092] In other embodiments, the acquisition position of the virtual camera 20 may be adjusted according to the current rendering angle after switching, the rendering acquisition range of the virtual camera 20 may be determined, and objects within the rendering acquisition range may be determined as display objects.

[0093] In some embodiments, as Figures 2 to 4 As shown, in step S202, determining the display object in the display screen from the identified environmental objects according to the current rendering angle includes:

[0094] If the current rendering angle is a top-down perspective, determining the first vehicle as the display object, and determining static objects and / or dynamic objects within a first preset range around the first vehicle in the environmental objects as the display objects;

[0095] If the current rendering angle is a rearview perspective, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a second preset range behind the first vehicle in the environmental objects as the display objects;

[0096] If the current rendering angle is a first forward-viewing angle, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a third preset range in front of the first vehicle in the environmental objects as the display objects;

[0097] If the current rendering angle is the second forward viewing angle, the first vehicle and static objects within a fourth preset range around the first vehicle in the environmental objects are determined as the display objects.

[0098] like Figure 3 As shown in (c), when the current rendering angle is determined to be a bird's-eye view, the first vehicle 10 and the static objects and / or dynamic objects (such as other vehicles 40) within a first preset range around it (such as 5 meters around the first vehicle) are determined to be display objects, and the lane line 30 is a non-display object. Subsequently, only the static objects and / or dynamic objects within the first preset range around the first vehicle 10 need to be 3D rendered, and other environmental objects such as lane lines do not need to be rendered. Figure 3 As shown in (d), the display image rendered from a bird's-eye view is a bird's-eye view image including the above-mentioned display object.

[0099] like Figure 4 As shown in (e), when the current rendering angle is determined to be a rear-view angle, the first vehicle 10 and lane line 30 are determined as display objects, and the static objects and / or dynamic objects (such as other vehicles 40) within the second preset range behind the first vehicle 10 in the environmental objects are determined to be the display objects, and the display objects are subsequently rendered so that the user can observe the first vehicle moving forward along the lane, for example, whether it crosses the line, whether it needs to change lanes, etc.; at the same time, it is convenient for the user to observe the driving conditions of other vehicles behind the first vehicle, etc., to avoid scratches or collisions between the rear vehicles and the first vehicle when changing lanes or overtaking. Figure 4 As shown in (f), the display image rendered from the rear-view perspective is a semi-top-down tilted image containing the display object. A tilted image refers to an image in which the display object is tilted at a certain angle.

[0100] like Figure 2As shown in (a), when the current rendering angle is determined to be the first forward-looking angle, it is determined that the first vehicle 10 is in a moving state (moving forward normally). To facilitate the user to observe the driving condition of the first vehicle 10, the first vehicle 10 and the lane line 30 can be determined as the display objects, and the static objects and / or dynamic objects (other vehicles 40) within the third preset range in front of the first vehicle in the environmental objects can be determined as the display objects. Figure 2 As shown in (b), the display image rendered under the first forward viewing angle is a semi-top-down forward perspective image containing the display object. With the first vehicle 10 as the center, the lane lines 30 and other vehicles 40 in front of and to the sides of the first vehicle 10 can be clearly seen.

[0101] When the current rendering angle is determined to be the second forward-looking perspective, it is determined that the first vehicle is in a parking state (the current gear position may be P gear). At this time, the first vehicle and static objects such as obstacles within a fourth preset range around the first vehicle in the environmental objects can be determined as display objects, while dynamic objects such as other vehicles around the first vehicle and lane lines can be determined as non-display objects.

[0102] When the gear of the first vehicle is switched from P gear to D gear (forward gear), the current rendering angle is determined to be the first forward viewing angle, the first vehicle and the lane line are determined as the display objects as described above, and the static objects and / or dynamic objects within the third preset range in front of the first vehicle in the environmental objects are determined as the display objects.

[0103] In particular, when the gear of the first vehicle is switched to R gear (reverse gear), the current rendering angle is determined to be the first forward viewing angle, and the display image rendered under the first forward viewing angle is still a semi-top-down forward perspective image. However, the display objects in the display image are the first vehicle and the lane line, as well as the static objects and / or dynamic objects within the fifth preset range behind the first vehicle in the environmental objects, so as to facilitate the observation of static objects and / or dynamic objects directly behind and to the side of the first vehicle when reversing.

[0104] Optionally, in step S102, switching the rendering angle of the virtual image display provided in the first vehicle according to the driving state of the first vehicle includes:

[0105] S1021: Determine the driving behavior of the first vehicle and the vehicle state of the first vehicle;

[0106] S1022: Determine a rendering angle to which the virtual image display needs to be switched according to the driving behavior of the first vehicle or the vehicle state of the first vehicle.

[0107] The first vehicle's driving behavior includes the aforementioned straight driving, turning, and merging, and the first vehicle's vehicle state includes the current gear position and current speed. The controller determines the first vehicle's driving behavior and vehicle state, and then, based on the first vehicle's driving behavior or vehicle state, determines the rendering angle to which the virtual image display should switch. This allows the virtual image display to effectively render display objects based on the first vehicle's driving behavior or vehicle state, making the content displayed on the display more consistent with the current driving scene. For example, when the first vehicle's driving behavior is turning, the top-view image can clearly display the first vehicle's turning direction, the turning intersection, and dynamic objects such as pedestrians near the intersection, effectively preventing the first vehicle from colliding with pedestrians during the turn. For another example, when the first vehicle's driving behavior is merging, because other vehicles behind the target lane may affect the first vehicle's ability to merge, the rearview image can clearly display other vehicles to the side and rear of the first vehicle for the user to observe, allowing the user to choose an appropriate time to merge based on the distance between the first vehicle and the following vehicle.

[0108] Furthermore, in step S1021, determining the driving behavior of the first vehicle includes:

[0109] Based on at least one of the positioning information of the first vehicle, the lighting information of the first vehicle, the navigation data corresponding to the first vehicle, and the current driving environment information of the first vehicle, the expected driving behavior and / or the current driving behavior of the first vehicle is determined, and the driving behavior of the first vehicle includes the expected driving behavior or the current driving behavior.

[0110] The positioning information of the first vehicle can be located in real time through a high-precision map after the first vehicle turns on navigation; the lighting information of the first vehicle includes information such as the turn signal, brake light (brake light), hazard lights, low beam, and high beam of the first vehicle; the navigation data corresponding to the first vehicle may include information such as the navigation route of the first vehicle and the distance between the first vehicle and the intersection ahead; the current driving environment information of the first vehicle includes information such as the road where the first vehicle is located (urban road or highway, etc.) and the complexity of the road conditions.

[0111] In one specific embodiment, when a first vehicle's turn signal is on, possible intended driving behaviors of the first vehicle are determined to include turning, changing lanes, and pulling over. In this case, the first vehicle's location information can be determined by real-time positioning of the vehicle's position using a high-precision map. Based on this location information, it can be determined whether there is an accessible lane in the direction of the turn signal. If so, the first vehicle's intended driving behavior is determined to be a lane change. Furthermore, based on the first vehicle's location information, it can be determined whether there is an intersection within a preset range in front of the first vehicle. If so, the first vehicle's intended driving behavior is determined to be turning. After the turn signal is on, it can also be determined whether the first vehicle's lane is a lane at the edge of the road, combined with the first vehicle's speed, whether the first vehicle's current driving behavior is pulling over. If the first vehicle's lane is a lane at the edge of the road and the first vehicle is in P gear, the first vehicle is determined to be pulling over. In another specific embodiment, the first vehicle's current driving behavior can be directly decoupled from braking based on the activation of the brake lights.

[0112] Furthermore, in step S1022, determining the rendering angle to which the virtual image display needs to be switched according to the driving behavior of the first vehicle or the vehicle state of the first vehicle includes:

[0113] If the expected driving behavior is turning, or the current driving behavior is turning, determining that the rendering angle to which the virtual image display needs to be switched is a top-down perspective;

[0114] If the expected driving behavior is merging lanes, or the current driving behavior is merging lanes, determining that the rendering angle to which the virtual image display needs to be switched is a rearview perspective;

[0115] If the current gear is a forward gear or a reverse gear, determining that the rendering angle to which the virtual image display needs to be switched is a first forward viewing angle;

[0116] If the current gear is the parking gear, it is determined that the rendering angle to which the virtual image display needs to be switched is the second forward viewing angle.

[0117] If the expected or current driving behavior of the first vehicle is turning, in order to ensure that the displayed image is a bird's-eye view that can help the user view the displayed objects around the turning intersection, it is determined that the rendering angle to which the virtual image display needs to be switched is a bird's-eye view; if the expected or current driving behavior of the first vehicle is changing lanes, in order to ensure that the displayed image is a rear-view view that can help the user view the target lane behind the first vehicle changing lanes, it is determined that the rendering angle to which the virtual image display needs to be switched is a rear-view view.

[0118] If the current gear of the first vehicle is the forward gear or the reverse gear, it is determined that the rendering angle to which the virtual image display needs to be switched is the first forward viewing angle, so that other vehicles within a certain range in front of or behind the first vehicle can be viewed with the first vehicle as the center.

[0119] In some embodiments, in step S202, determining the display object in the display screen from the identified environmental objects according to the current rendering angle includes:

[0120] S301: Determine the object type of the identified environmental object and the distance between the environmental object and the first vehicle;

[0121] S302: Filtering the identified environmental objects according to display configuration information and a current rendering angle corresponding to the virtual image display, and determining environmental objects that meet the display configuration information and the current rendering angle as display objects in the display screen, wherein the display configuration information includes an information display type and / or an information display range;

[0122] S303: In the display image, the display object is represented by a 3D rendering model corresponding to the display object.

[0123] In the above embodiment, according to the current rendering angle, the environmental objects within the current rendering angle range are used as display objects.

[0124] In steps S301 and S302, when determining the display objects to be displayed on the display screen, the object type of the identified environmental object and relevant parameters of the environmental object, such as the distance between the environmental object and the first vehicle, can be determined in step S301. Then, the identified environmental objects can be filtered based on the current rendering angle and pre-set display configuration information to determine the final display objects. For example, it can be predetermined that only pedestrians are displayed on the display screen, and that the distance threshold between the displayed pedestrians and the first vehicle does not exceed 1 meter. Environmental objects that match the rendering angle automatically filtered based on the current rendering angle are pedestrians and vehicles within 5 meters of the first vehicle. Then, based on the pre-configured display configuration information, the vehicle can be removed. Simultaneously, based on the distance threshold between the pedestrians and the first vehicle in the display configuration information, pedestrians within 5 meters of the first vehicle filtered based on the current rendering angle are filtered to those within 1 meter of the first vehicle. These pedestrians are the display objects presented in the final display screen. Then, in step S303, the rendered 3D model of the pedestrian is displayed on the display screen.

[0125] Optionally, the virtual image display can be configured with a touch screen operation interface to facilitate the user to manually set the display configuration information. The touch screen operation interface can be the operation interface of the vehicle system that is communicated with the virtual image display (such as the display interface of the vehicle multimedia device).

[0126] The touch screen operation interface can pre-configure an information display type selection button so that the user can pre-set the information display type; the touch screen operation interface can also pre-configure an information display range slider, a display range gear adjustment button or a distance threshold input box so that the user can pre-set the information display range.

[0127] From the above, it can be seen that in this embodiment, not only can the automatic determination of the display objects be realized, but the required display objects can also be manually determined according to user needs (for example, whether it is necessary to display all the automatically determined display objects in order to display detailed display objects), thereby meeting the different observation needs of different users, reducing the visual interference caused by too many display objects, making it easier for users to concentrate on observing the display objects at a certain position, improving the user experience of the virtual image display, and improving driving safety.

[0128] In some embodiments, the method further comprises:

[0129] S304: If the distance between the identified environmental object and the first vehicle meets a preset distance condition, corresponding prompt information is displayed on the virtual image display.

[0130] In this step, after identifying the environmental objects in the driving environment where the first vehicle is located, it is possible to determine whether the distance between the first vehicle and the environmental objects is a safe distance based on the distance between the first vehicle and the environmental objects. When the distance is too close and less than the safe distance, even if the environmental object is not a display object, a corresponding prompt message is displayed on the virtual image display to promptly alert the user. For example, when other vehicles within the second preset range on the left side behind the first vehicle can be rendered and displayed in the rearview perspective, when other vehicles on the left side behind the first vehicle that exceed the second preset range approach the first vehicle at high speed or other vehicles in the blind spot on the right side behind the first vehicle approach the first vehicle, and the distance between them and the first vehicle meets the preset distance condition, a corresponding warning prompt message is generated and displayed on the display screen to promptly alert the user, further improving driving safety, and the display of the virtual image display is more intelligent.

[0131] It is understandable that if Figure 4 As shown, when the distance between other vehicles around the first vehicle and the first vehicle is too close and less than the safe distance, they can be determined as display objects and rendered together with other display objects in the rearview perspective so that users can observe the driving conditions of other vehicles close to the first vehicle and avoid safety accidents.

[0132] In some embodiments, the method further comprises:

[0133] S401: Acquire the driver's identity information;

[0134] S402: Determining, based on the driver's identity information, a display screen presentation mode that matches the driver's identity information from preset display screen presentation modes;

[0135] S403: Control the virtual image display to display the display image at the rendering angle corresponding to the presentation mode.

[0136] In this embodiment, a display presentation method with optimal display quality can be configured for the driver based on information such as the driver's height and the eye box size of the virtual image display. This presentation method may include the display format of the display object, for example, whether the display object is presented as a 2D or 3D rendered model, and the display angle of the 3D rendered model. The driver's identity information can be pre-recorded and stored in the vehicle-mounted system. After a camera or other acquisition device in the vehicle recognizes the driver, it transmits the driver's facial image to the controller. The controller retrieves the driver's identity information from the vehicle-mounted system based on the received facial image, determines the display presentation method based on the driver's identity information, controls the virtual image display to switch to the corresponding rendering angle, and renders the corresponding display object and surrounding environment based on the current rendering angle in step S103, resulting in a rendered display image containing the display object. This ensures that the display image matches the driver's identity, further improving the user experience of the virtual image display.

[0137] It can be understood that the virtual image display can always render the display screen at a certain rendering angle according to the user's selection, or it can automatically switch the rendering angle of the virtual image display set in the first vehicle according to the driving status of the first vehicle as mentioned above, and obtain the corresponding display screen through different rendering angles.

[0138] Figure 5 FIG. 1 shows a schematic diagram of the structure of the display control device according to an embodiment of the present disclosure. Figure 5 As shown, based on the above display control method, the embodiment of the present disclosure further provides a display control device, including:

[0139] A first determining module 100 is configured to determine a driving state of a first vehicle;

[0140] a switching module 200 configured to switch a rendering angle of a virtual image display provided in the first vehicle according to a driving state of the first vehicle;

[0141] The second determining module 300 is configured to determine a display image displayed on the virtual image display according to a current rendering angle.

[0142] In some embodiments, the second determining module 300 is further configured to:

[0143] determining a display object to be displayed in the display screen according to the current rendering angle;

[0144] Based on the current rendering angle, the display object, and the state parameters corresponding to the display object, generating an image at the current rendering angle;

[0145] The image frame is magnified and imaged by the virtual image display to present the display frame.

[0146] In some embodiments, the second determining module 300 is further configured to:

[0147] Identifying environmental objects in a driving environment of the first vehicle, the environmental objects comprising at least one of static objects, dynamic objects, and lane lines;

[0148] According to the current rendering angle, a display object in the display picture is determined from the identified environmental objects.

[0149] In some embodiments, the second determining module 300 is further configured to:

[0150] If the current rendering angle is a top-down perspective, determining the first vehicle as the display object, and determining static objects and / or dynamic objects within a first preset range around the first vehicle in the environmental objects as the display objects;

[0151] If the current rendering angle is a rearview perspective, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a second preset range behind the first vehicle in the environmental objects as the display objects;

[0152] If the current rendering angle is a first forward-viewing angle, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a third preset range in front of the first vehicle in the environmental objects as the display objects;

[0153] If the current rendering angle is the second forward viewing angle, the first vehicle and static objects within a fourth preset range around the first vehicle in the environmental objects are determined as the display objects.

[0154] In some embodiments, the switching module 200 is further configured to:

[0155] determining a driving behavior of the first vehicle and a vehicle state of the first vehicle;

[0156] The rendering angle to which the virtual image display needs to be switched is determined according to the driving behavior of the first vehicle or the vehicle state of the first vehicle.

[0157] In some embodiments, the vehicle state of the first vehicle includes a current gear, and the first determining module 100 is further configured to:

[0158] determining an expected driving behavior and / or a current driving behavior of the first vehicle based on at least one of positioning information of the first vehicle, lighting information of the first vehicle, navigation data corresponding to the first vehicle, and information about a current driving environment of the first vehicle, where the driving behavior of the first vehicle includes the expected driving behavior or the current driving behavior;

[0159] The switching module 200 is further configured to:

[0160] If the expected driving behavior is turning, or the current driving behavior is turning, determining that the rendering angle to which the virtual image display needs to be switched is a top-down perspective;

[0161] If the expected driving behavior is merging lanes, or the current driving behavior is merging lanes, determining that the rendering angle to which the virtual image display needs to be switched is a rearview perspective;

[0162] If the current gear is a forward gear or a reverse gear, determining that the rendering angle to which the virtual image display needs to be switched is a first forward viewing angle;

[0163] If the current gear is the parking gear, it is determined that the rendering angle to which the virtual image display needs to be switched is the second forward viewing angle.

[0164] In some embodiments, the second determining module 300 is further configured to:

[0165] determining an object type of the identified environmental object and a distance between the environmental object and the first vehicle;

[0166] Filtering the identified environmental objects according to display configuration information and a current rendering angle corresponding to the virtual image display, and determining environmental objects that meet the display configuration information and the current rendering angle as display objects in the display picture, wherein the display configuration information includes an information display type and / or an information display range;

[0167] In the display image, the display object is represented by a 3D rendering model corresponding to the display object.

[0168] In some embodiments, the second determining module 300 is further configured to:

[0169] If the distance between the identified environmental object and the first vehicle meets a preset distance condition, corresponding prompt information is displayed on the virtual image display.

[0170] In some embodiments, the display control device further includes:

[0171] an acquisition module configured to acquire identity information of the driver of the first vehicle;

[0172] The second determining module 300 is further configured to:

[0173] Determining, based on the driver's identity information, a display screen presentation mode that matches the driver's identity information from preset display screen presentation modes;

[0174] The virtual image display is controlled to display the display image at the rendering angle corresponding to the presentation mode.

[0175] It should be noted that the display control device provided in the embodiment of the present disclosure corresponds to the display control method in the above-mentioned embodiment. Based on the above-mentioned display control method, technicians in this field can understand the specific implementation methods of the display control device in the embodiment of the present disclosure and its various variations. Any optional items in the display control method embodiment are also applicable to the display control device and will not be repeated here.

[0176] An embodiment of the present disclosure also provides a vehicle, comprising the above-mentioned display control device.

[0177] An embodiment of the present disclosure further provides an electronic device, comprising at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program on the memory.

[0178] In some embodiments, the processor that executes the computer program may be a processing device including one or more general-purpose processing devices, such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), etc. More specifically, the processor may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor that runs other instruction sets, or a processor that runs a combination of instruction sets. The processor may also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), etc.

[0179] The memory may be read-only memory (ROM), random access memory (RAM), phase-change random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), electrically erasable programmable read-only memory (EEPROM), other types of random access memory (RAM), flash disks or other forms of flash memory, cache, registers, static memory, compact disk read-only memory (CD-ROM), digital versatile disks (DVD) or other optical storage, magnetic tape cassettes or other magnetic storage devices, or any other possible non-transitory medium used to store information or instructions that can be accessed by a computer device.

[0180] The electronic devices of the embodiments of the present disclosure may include but are not limited to fixed terminal devices such as servers, desktop computers, digital TVs, etc., and mobile terminal devices such as vehicle-mounted devices (such as head-up display devices HUD), handheld devices (such as mobile phones, tablets, etc.), and wearable devices (such as smart watches, smart bracelets, etc.).

[0181] Optionally, the electronic device is a virtual image display of the first vehicle, and the controller of the virtual image display can determine the driving status of the first vehicle; switch the rendering angle of the virtual image display set in the first vehicle according to the driving status of the first vehicle; and determine the display screen displayed on the virtual image display according to the rendering angle.

[0182] An embodiment of the present disclosure further provides a computer-readable storage medium, wherein the computer-readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0183] The computer-readable storage medium of the embodiments of the present disclosure may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, apparatus or device, for example, the memory described above.

[0184] The computer programs of the embodiments of the present disclosure may be organized into one or more computer-executable components or modules. Any number and combination of such components or modules may be used to implement various aspects of the present disclosure. For example, various aspects of the present disclosure are not limited to the specific computer-executable instructions or specific components or modules shown in the accompanying drawings and described herein. Other embodiments may include different computer-executable instructions or components with more or less functionality than shown and described herein.

[0185] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

Claims

1. A display control method, applied to a first vehicle, characterized in that: include: determining a driving state of the first vehicle; Switching a rendering angle of a virtual image display disposed in the first vehicle according to a driving state of the first vehicle; A display picture displayed on the virtual image display is determined according to the current rendering angle.

2. The method according to claim 1, characterized in that The step of determining a display picture displayed on the virtual image display according to the current rendering angle includes: Determine a display object to be displayed in the display picture according to the current rendering angle; Based on the current rendering angle and the display object, and the state parameters corresponding to the display object, generate an image screen at the current rendering angle; The image picture is magnified and imaged by the virtual image display to present the display picture.

3. The method according to claim 2, characterized in that The determining, according to the current rendering angle, a display object to be displayed in the display picture includes: Identify environmental objects in the driving environment of the first vehicle, wherein the environmental objects include at least one of static objects, dynamic objects, and lane lines; According to the current rendering angle, a display object in the display picture is determined from the identified environmental objects.

4. The method according to claim 3, characterized in that The step of determining the display object in the display picture from the identified environmental objects according to the current rendering angle includes: If the current rendering angle is a top-down perspective, determining the first vehicle as the display object, and determining static objects and / or dynamic objects within a first preset range around the first vehicle in the environmental object as the display object; If the current rendering angle is a rear-view angle, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a second preset range behind the first vehicle in the environmental objects as the display objects; If the current rendering angle is a first forward-viewing angle, determining the first vehicle and the lane line as the display objects, and determining static objects and / or dynamic objects within a third preset range in front of the first vehicle in the environmental objects as the display objects; If the current rendering angle is the second forward viewing angle, the first vehicle and static objects within a fourth preset range around the first vehicle in the environmental objects are determined as the display objects.

5. The method according to claim 1, characterized in that: The step of switching a rendering angle of a virtual image display disposed in the first vehicle according to the driving state of the first vehicle includes: determining a driving behavior of the first vehicle and a vehicle state of the first vehicle; The rendering angle to which the virtual image display needs to be switched is determined according to the driving behavior of the first vehicle or the vehicle state of the first vehicle.

6. The method according to claim 5, characterized in that The vehicle state of the first vehicle includes a current gear position, wherein determining the driving behavior of the first vehicle includes: determining an expected driving behavior and / or a current driving behavior of the first vehicle according to at least one of the positioning information of the first vehicle, the lighting information of the first vehicle, the navigation data corresponding to the first vehicle, and the driving environment information currently located by the first vehicle, wherein the driving behavior of the first vehicle includes the expected driving behavior or the current driving behavior; The determining, according to the driving behavior of the first vehicle or the vehicle state of the first vehicle, a rendering angle to which the virtual image display needs to be switched includes: If the expected driving behavior is turning, or the current driving behavior is turning, determining that the rendering angle to which the virtual image display needs to be switched is a top-down perspective; If the expected driving behavior is merging lanes, or the current driving behavior is merging lanes, determining that the rendering angle to which the virtual image display needs to be switched is a rear-view perspective; If the current gear is a forward gear or a reverse gear, determining that the rendering angle to which the virtual image display needs to be switched is a first forward viewing angle; If the current gear position is the parking gear position, it is determined that the rendering angle to which the virtual image display needs to be switched is the second forward viewing angle.

7. The method according to claim 3, characterized in that The step of determining the display object in the display picture from the identified environmental objects according to the current rendering angle includes: determining an object type of the identified environmental object and a distance between the environmental object and the first vehicle; According to the display configuration information and the current rendering angle corresponding to the virtual image display, the identified environmental objects are screened, and the environmental objects that meet the display configuration information and the current rendering angle are determined as display objects in the display picture, wherein the display configuration information includes an information display type and / or an information display range; In the display picture, the display object is represented by a 3D rendering model corresponding to the display object.

8. The method according to claim 7, characterized in that The method further comprises: If the distance between the identified environmental object and the first vehicle meets a preset distance condition, corresponding prompt information is displayed on the virtual image display.

9. The method according to claim 2, characterized in that: The method further comprises: Obtaining identity information of the driver of the first vehicle; According to the identity information of the driver, determining a presentation mode of the display screen that matches the identity information of the driver from preset display screen presentation modes; The virtual image display is controlled to display the display picture at the rendering angle corresponding to the presentation mode.

10. A display control device, characterized in that: include: A first determination module is configured to determine a driving state of a first vehicle; a switching module configured to switch a rendering angle of a virtual image display disposed in the first vehicle according to a driving state of the first vehicle; The third determination module is configured to determine a display picture displayed on the virtual image display according to a current rendering angle.

11. A vehicle, characterized in that: Includes the display control device according to claim 10.

12. An electronic device, characterized in that: The method comprises at least a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method according to any one of claims 1 to 9 when executing the computer program on the memory.

13. A computer-readable storage medium, characterized in that: The computer readable medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Images