AR content adjustment method, head-up display device and vehicle

Abstract

The invention discloses an AR content adjustment method, a head-up display device and a vehicle, the method can be applied to the head-up display device, and the method comprises the steps that the vehicle speed and driving information of a first vehicle are acquired, and the driving information comprises one or more of the driving direction, the driving state, the attention information of a driver and the congestion condition; and based on the vehicle speed and the driving information, the rendered AR content is adaptively adjusted, so that the AR content better conforming to the actual driving scene can be provided, and the driving safety can be improved.

Description

Technical Field

[0001] This application relates to the technical field of head-up display, and in particular, to an AR content adjustment method, a head-up display device, and a vehicle. Background Art

[0002] The main function of a Head-Up Display (HUD) system is to project key driving information such as vehicle speed and navigation onto the windshield in front of the driver. In this way, the driver can see this important information without having to lower their head or turn their head during driving, thus greatly improving driving safety and convenience.

[0003] In recent years, the rapid development of Augmented Reality (AR) technology has provided a new opportunity for the upgrade of HUD systems, resulting in an augmented reality head-up display system that combines AR technology (i.e., an AR HUD system). The AR HUD system provides richer and more intuitive driving assistance information for the driver by integrating virtual information with the real driving environment. How to further optimize the AR HUD system to improve driving safety has become an important research topic. Summary of the Invention

[0004] This application discloses an AR content adjustment method, a head-up display device, and a vehicle, which can adaptively adjust the rendered AR content based on the vehicle speed and driving information, which is beneficial to providing AR content that more conforms to the actual driving scenario, thereby facilitating the improvement of driving safety.

[0005] In a first aspect, an embodiment of this application provides an AR content adjustment method, which is applied to a head-up display device. The method includes: obtaining the vehicle speed and driving information of a first vehicle, where the driving information includes one or more of a driving direction, a driving state, the driver's attention information, and a traffic congestion situation; and adjusting the rendered AR content based on the vehicle speed and the driving information.

[0006] In this technical solution, the rendered AR content can be adaptively adjusted based on the actual driving scenario, so that AR content that more conforms to the actual driving scenario can be provided, which helps to maintain the driver's attention and reduce the risk of blind driving, thereby facilitating the improvement of driving safety and convenience.

[0007] In one implementation, the driving information includes a driving direction; the specific implementation of adjusting the rendered AR content based on the vehicle speed and the driving information may be: when the vehicle speed is greater than a first speed and the driving direction is straight, adjusting the rendered AR content; wherein, the adjusted rendered AR content corresponds to an object within a first distance range in front of the first vehicle, and the pre-adjustment rendered AR content corresponds to an object within a second distance range in front of the first vehicle, and the first distance is greater than the second distance.

[0008] In this technical solution, the head-up display device can render the AR content corresponding to the objects within a farther distance range in front of the first vehicle, so as to provide AR content that better conforms to the actual driving scenario, which is convenient for the driver to make better driving decisions, thereby facilitating the improvement of driving safety.

[0009] In one implementation, the driving information includes the driving state; based on the vehicle speed and the driving information, the specific implementation of adjusting the rendered AR content can be: when the vehicle speed is less than the second speed and the driving state is a high-dynamic driving state, adjust the rendered AR content; wherein, the adjusted rendered AR content corresponds to the objects within the third distance range around the first vehicle, and the pre-adjustment rendered AR content corresponds to the objects within the fourth distance range around the first vehicle, and the third distance is less than or equal to the fourth distance; the number of the adjusted rendered AR content is greater than the number of the pre-adjustment rendered AR content, and / or, the type number of the adjusted rendered AR content is greater than the type number of the pre-adjustment rendered AR content.

[0010] In this technical solution, after adjustment, the head-up display device can render a greater number and / or a greater variety of AR content, so that the head-up display device can render the AR content corresponding to the objects within a closer distance range around the first vehicle in a more detailed manner, that is, render the situation around the first vehicle in a more detailed manner, which is convenient for the driver to make better driving decisions and is conducive to improving driving safety.

[0011] In one implementation, when the first vehicle meets the first condition, the driving state of the first vehicle is a high-dynamic driving state; wherein, the first vehicle meeting the first condition includes one or more of the following: the first vehicle performs an emergency brake; the first vehicle makes a sharp turn; the body of the first vehicle vibrates.

[0012] In one implementation, the driving information includes the driver's attention information and the traffic congestion situation, wherein the driver's attention information is used to indicate whether the driver's attention is focused on driving, and the traffic congestion situation is used to indicate whether the section where the first vehicle is located is congested; based on the vehicle speed and the driving information, the specific implementation of adjusting the rendered AR content can be: when the first vehicle meets the second condition, adjust the rendered AR content; wherein, the first vehicle meeting the second condition includes: the vehicle speed is within the speed range, the section where the first vehicle is located is not congested, and the driver's attention is not focused on driving; the adjusted rendered AR content includes the AR content associated with driving and the AR content associated with leisure and entertainment services; the pre-adjustment rendered AR content is associated with driving.

[0013] In this technical solution, after adjustment, in addition to rendering AR content related to driving, the head-up display device can also additionally render AR content related to recreational services. In this way, richer AR content can be provided, and AR content that better conforms to the actual driving scenario can be provided, which is convenient for the driver to make better driving decisions, thereby contributing to improving driving safety and convenience.

[0014] In one implementation, after adjustment, the quantity of AR content related to driving rendered is less than the quantity of AR content related to driving rendered before adjustment, and / or the variety of AR content related to driving rendered after adjustment is less than the variety of AR content related to driving rendered before adjustment; and / or, the quantity of AR content related to recreational services rendered after adjustment is greater than the quantity of AR content related to recreational services rendered before adjustment, and / or the variety of AR content related to recreational services rendered after adjustment is greater than the variety of AR content related to recreational services rendered before adjustment.

[0015] In this technical solution, on the one hand, after adjustment, the head-up display device can reduce the quantity and / or variety of AR content related to driving rendered. That is to say, the head-up display device can only render the necessary AR content related to driving and reduce the rendering of unnecessary AR content related to driving. On the other hand, after adjustment, the head-up display device can increase the quantity and / or variety of AR content related to recreational services rendered, and adaptively adjust the rendering focus based on the actual driving scenario, which is conducive to improving driving safety and convenience.

[0016] In one implementation, the driving information further includes the position of the first vehicle; the first vehicle meeting the second condition further includes: the position of the first vehicle being within the area related to the recreational service.

[0017] In this technical solution, it is possible to more accurately determine that the user hopes to see AR content related to recreational services, which is conducive to providing AR content that better conforms to the actual driving scenario, thereby contributing to improving driving convenience.

[0018] In one implementation, the driving information includes the traffic congestion situation, and the traffic congestion situation is used to indicate whether the section where the first vehicle is located is congested; based on the vehicle speed and the driving information, the specific implementation manner of adjusting the rendered AR content can be: when the section where the first vehicle is located is congested, adjusting the rendered AR content; wherein, the adjusted rendered AR content includes AR content corresponding to a second vehicle, and the distance between the second vehicle and the first vehicle is less than a fifth distance.

[0019] In this technical solution, the head-up display device can render the AR content corresponding to the second vehicle around the first vehicle, so as to provide AR content that is more in line with the actual driving scenario, which is beneficial to avoiding collisions between the first vehicle and the second vehicle, and thus beneficial to improving driving safety.

[0020] In a second aspect, an embodiment of the present application provides an AR content adjustment device, and the device includes units for implementing the method described in the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a head-up display device, including a processor; the processor is configured to execute the method described in the first aspect.

[0022] In an optional implementation manner, the head-up display device may further include a memory; the memory is used to store computer programs or instructions; the processor is specifically configured to call the computer programs or instructions from the memory and execute the method described in the first aspect.

[0023] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, and the computer-readable storage medium stores computer programs or computer instructions, and when the computer programs or computer instructions are executed, the head-up display device is caused to execute the method described in the first aspect.

[0024] In a fifth aspect, an embodiment of the present application provides a computer program product including computer programs or instructions, and when the computer programs or instructions run on a head-up display device, the head-up display device is caused to execute the method described in the first aspect.

[0025] In a sixth aspect, an embodiment of the present application provides a vehicle, including: a vehicle body and a head-up display device disposed in the vehicle body, and the head-up display device is used to implement the method described in the first aspect. Description of the Drawings

[0026] Figure 1 is a schematic structural diagram of a vehicle to which an embodiment of the present application is applicable;

[0027] Figure 2 is a schematic flowchart of an AR content adjustment method provided by an embodiment of the present application;

[0028] Figure 3 is a schematic structural diagram of an AR content adjustment device provided by an embodiment of the present application;

[0029] Figure 4 is a schematic structural diagram of a head-up display device provided by an embodiment of the present application. Detailed Embodiments

[0030] It should be understood that the terms "first", "second", etc. involved in the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order. The "at least one" in the embodiments of the present application refers to one or more, and multiple refers to two or more. The "and / or" in the embodiments of the present application describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent the following three situations: A exists alone, A and B exist simultaneously, and B exists alone. Among them, A and B can be singular or plural. The character " / " can represent an "or" relationship between the front and back associated objects. In addition, the symbol " / " can also represent a division sign, that is, perform a division operation.

[0031] The "at least one (item)" or its similar expression in the embodiments of the present application refers to any combination of these items, including any combination of single item (item) or plural items (items). For example, at least one (item) of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Among them, each of a, b, and c can be an element or a set containing one or more elements.

[0032] In the embodiments of the present application, the terms "corresponding", "associated", and "corresponding" sometimes can be used interchangeably. It should be noted that when the difference is not emphasized, the concepts or meanings to be expressed are the same.

[0033] The AR content adjustment method proposed in the embodiments of the present application can be executed by a head-up display device, or by a device (such as a chip or a processor, etc., which are devices placed inside the head-up display device) that matches the head-up display device. The embodiments of the present application take the AR content adjustment method being executed by the head-up display device as an example for description. The head-up display device can also be referred to as an augmented reality head-up display device, AR HUD.

[0034] In the embodiments of the present application, the head-up display device can be installed on a vehicle, and the vehicle can include but are not limited to: vehicles, ships, airplanes, etc.

[0035] The schematic structural diagram of the vehicle can be as Figure 1 shown. As Figure 1 shown, the vehicle 10 can include but are not limited to components such as a head-up display device 101, at least one sensor 102, and an electronic management system 103. The head-up display device 101 can be connected to at least one sensor 102 and the electronic management system 103. Figure 1 The number and form of the components included in the vehicle 10 shown are for illustration and do not constitute a limitation on the embodiments of the present application.

[0036] Among them, the at least one sensor 102 can be used to obtain the distance between an object ( Figure 1 not shown) and the vehicle 10 and an image of the object. The object can be a movable object or an immovable object in the real environment. For example, the object can include but is not limited to: animals, plants, roads, vehicles, buildings, street lamps, road signs, guardrails, trash cans, bridges, mountains. Among them, the image of the object obtained by the at least one sensor 102 can be a two-dimensional image or a three-dimensional image.

[0037] The type of the at least one sensor 102 can include but is not limited to: cameras, radars, lidars, ultrasonic radars, millimeter wave radars, or other sensors that can sense objects around the vehicle 10. When the vehicle 10 includes multiple sensors, the types of the multiple sensors can be the same or different, and the embodiments of the present application do not make any limitations in this regard.

[0038] The at least one sensor 102 can send the collected information to the head-up display device 101 and / or the electronic management system 103.

[0039] The head-up display device 101 can be used to generate a virtual image and project the virtual image into the driver's field of view through an optical system. The virtual image is superimposed on the actual road conditions seen by the driver to form an augmented reality effect. Without leaving the driving field of view, the driver can see this superimposed image information. In this way, the driver can see these important information without lowering the head or turning the head during driving, which can reduce the risk of blind driving and is beneficial to improving driving safety and convenience.

[0040] The electronic management system 103 can be used to manage one or more of the following information: the status information of the vehicle, driving operation information, navigation and route information, safety system data, environmental monitoring data, passenger comfort settings, energy consumption data, fault diagnosis and maintenance reminders, communication-related information. By adopting the electronic management system 103, the vehicle 10 can be made more intelligent, efficient and safe. Exemplarily, taking the vehicle 10 as an example, the electronic management system 103 can include an in-vehicle system and / or a navigation system.

[0041] Next, taking the vehicle as an example, the AR content adjustment method proposed in the embodiments of the present application will be described.

[0042] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of an AR content adjustment method provided by the embodiments of the present application. The AR content adjustment method can be applied to Figure 1 the head-up display device 101 in Figure 2 As shown, the AR content adjustment method can include but is not limited to the following steps.

[0043] S201: Obtain the vehicle speed and driving information of the first vehicle, where the driving information includes one or more of the driving direction, driving state, driver's attention information, and traffic congestion situation.

[0044] Herein, the first vehicle is any vehicle equipped with a head-up display device.

[0045] The vehicle speed and driving information of the first vehicle can be provided by the sensors and / or the electronic management system of the first vehicle. Alternatively, the head-up display device can determine the vehicle speed and driving information of the first vehicle based on the information provided by the sensors and / or the electronic management system of the first vehicle. For the content regarding the sensors and the electronic management system, reference can be made to the specific descriptions of at least one sensor 102 and the electronic management system 103 in the foregoing, which will not be elaborated herein.

[0046] The vehicle speed of the first vehicle can include, but is not limited to, the instantaneous vehicle speed of the first vehicle at the first moment and the average vehicle speed of the first vehicle within the first time period. Herein, the first moment can include the current moment and / or at least one historical moment. The first time period can include a time period containing the current moment and / or a historical time period without the current moment.

[0047] The driving direction of the first vehicle can include, but is not limited to, going straight, turning left, turning right, diagonal, and reversing. Herein, going straight means that the vehicle maintains the current driving direction unchanged during driving, continues to move forward along the current lane, and does not turn or make a U-turn. It should be noted that when the driving direction of the first vehicle is going straight, the driving path of the first vehicle can be a straight line, or the driving path is not necessarily an absolute straight line and may be a slightly curved path. For example, when the first vehicle is driving in a lane, the driving path is not a completely straight line, but the driving path is within one lane and does not deviate from the lane.

[0048] Turning left means that the vehicle turns left during driving. Turning right means that the vehicle turns right during driving. Diagonal means that the vehicle does not drive along the directly forward or directly backward direction. Reversing means that the vehicle drives backward.

[0049] The driving state of the first vehicle can include, but is not limited to, a high-dynamic driving state, a constant-speed driving state, an accelerating state, a decelerating state, a stationary state, a starting state, and a turning state.

[0050] Among them, the driving state of the first vehicle being a uniform driving state can mean that the first vehicle is driving straight at a constant speed without accelerating or decelerating. The driving state of the first vehicle being an accelerating state can mean that the first vehicle is increasing its speed, which may be accelerating from a standstill or while in motion. The driving state of the first vehicle being a decelerating state can mean that the first vehicle is decreasing its speed, which may be to stop or to adapt to traffic conditions. The driving state of the first vehicle being a stationary state can mean that the first vehicle is stopped in place without moving. The driving state of the first vehicle being a starting state can mean that the first vehicle starts moving from a stationary state and accelerates to a certain speed. The driving state of the first vehicle being a turning state can mean that the first vehicle is changing its driving direction, including turning left and turning right.

[0051] When the first vehicle meets the first condition, the driving state of the first vehicle is a high-dynamic driving state. The first vehicle meeting the first condition can include, but is not limited to, one or more of the following: the first vehicle performs an emergency brake; the first vehicle makes a sharp turn; the body of the first vehicle vibrates.

[0052] In a possible implementation, the deceleration of the first vehicle being greater than or equal to the first deceleration, and / or, the braking distance of the first vehicle being less than or equal to the first braking distance, can indicate that the first vehicle performs an emergency brake. Among them, deceleration is the negative value of acceleration, and the unit can be meters per second squared (m / s 2 ). The braking distance refers to the distance between when the brake is detected and when the vehicle comes to a complete stop. Optionally, the difference between the normal braking distance and the first braking distance is greater than a preset distance difference, and the preset distance difference is a positive number. In other words, the first braking distance is much shorter than the normal braking distance. Therefore, the braking distance of the first vehicle being less than or equal to the first braking distance can indicate an emergency brake.

[0053] In a possible implementation, the G value of the first vehicle in the lateral direction being greater than or equal to the first G value, and / or, the rotational angular velocity of the first vehicle being greater than or equal to the first rotational angular velocity, can indicate that the first vehicle makes a sharp turn. Among them, the G value of the first vehicle in the lateral direction refers to the ratio of the acceleration of the first vehicle along the lateral axis in the horizontal plane to the acceleration due to gravity.

[0054] In a possible implementation, the sudden change in the acceleration of the first vehicle on at least one axis, and / or, the sudden change in the rotational angular velocity of the first vehicle, can indicate the vibration of the body of the first vehicle. For example, an uneven road surface may cause the vehicle to jolt and the body to vibrate.

[0055] The three coordinate axes of a vehicle can include: a lateral axis (or side axis), a forward axis (or longitudinal axis), and a vertical axis (or upright axis). Among them, the lateral axis is the axis in the left-right direction of the vehicle and is perpendicular to the traveling direction of the vehicle. When the vehicle turns or skids, the acceleration on the lateral axis is called lateral acceleration or side acceleration, which reflects the acceleration of the vehicle's left-right movement in the horizontal plane. The forward axis is the axis in the front-back direction of the vehicle and is consistent with the traveling direction of the vehicle. The acceleration on the forward axis is called longitudinal acceleration, which reflects the acceleration or deceleration of the vehicle. The vertical axis is the axis in the up-down direction of the vehicle and is perpendicular to the horizontal plane. The acceleration on the vertical axis is called vertical acceleration, which reflects the vehicle's movement in the vertical direction, such as jumping or bumping.

[0056] The deceleration of the first vehicle, the G value of the first vehicle in the lateral direction, the rotational angular velocity of the first vehicle, and the acceleration of the first vehicle on at least one axis can all be measured by the inertial measurement unit (IMU) of the first vehicle. An IMU is a device integrating multiple inertial sensors and is used to measure the motion state of an object (such as a vehicle) in three-dimensional space. The IMU can include but is not limited to one or more of the following sensors: an accelerometer, a gyroscope, and a magnetometer. Among them, the accelerometer can be used to measure the acceleration and deceleration of the vehicle on the three coordinate axes (i.e., the lateral axis, the forward axis, and the vertical axis). The gyroscope can be used to measure the rotational angular velocity of the vehicle around the three coordinate axes. The magnetometer can be used to measure the direction of the earth's magnetic field to help determine the orientation of the vehicle.

[0057] Optionally, the first deceleration, the first braking distance, the preset distance difference, the first G value, and the first rotational angular velocity can all be set by the head-up display device or the default settings of the first vehicle, or the first deceleration, the first braking distance, the preset distance difference, the first G value, and the first rotational angular velocity can all be set or modified by the head-up display device or the first vehicle according to user operations. The embodiments of the present application do not limit the specific values and setting methods of the first deceleration, the first braking distance, the preset distance difference, the first G value, and the first rotational angular velocity. For example, the first deceleration can be 7 m / s 2 or other values, the first braking distance can be 15 meters or other values, the first G value can be 0.3 or other values, and the first rotational angular velocity can be 9° / s or other values.

[0058] The attention information of the driver of the first vehicle can be used to indicate whether the driver's attention is focused on driving. In one possible implementation, the driver's attention information can be obtained based on the vehicle's DMS system. The DMS system is a Driver Monitor System that detects the driver's state during driving. The DMS system includes face ID, fatigue detection, distraction detection, expression recognition, gesture recognition, dangerous action recognition, eye gaze tracking, etc. During driving, the camera samples the driver's eye gaze deviation and face angle deviation; makes a judgment based on the deviation angle threshold; triggers the start of timing for the deviation threshold, and determines the distraction level based on the length of time, thereby obtaining the driver's attention information.

[0059] The congestion situation of the first vehicle can be used to indicate whether congestion has occurred on the road section where the first vehicle is located. In one possible implementation, the congestion situation of the first vehicle can be determined based on the vehicle speed and / or traffic flow length of the first vehicle. Optionally, if the first vehicle exhibits one or more of the following situations, it can indicate that congestion has occurred on the road section where the first vehicle is located: the vehicle speed of the first vehicle is less than or equal to the congestion vehicle speed corresponding to the road section where the first vehicle is located; the duration for which the vehicle speed of the first vehicle is less than or equal to the congestion vehicle speed is greater than the first duration; the traffic flow length with stop-and-go of the first vehicle is greater than the first length; the duration for which the traffic flow length with stop-and-go of the first vehicle is greater than the first length is greater than the first duration. It can be understood that if the first vehicle does not exhibit the above situations, it can indicate that no congestion has occurred on the road section where the first vehicle is located.

[0060] Optionally, the congestion vehicle speed, the first duration, and the first length can all be set by the head-up display device or the first vehicle by default, or the congestion vehicle speed, the first duration, and the first length can all be set or modified by the head-up display device or the first vehicle according to user operations. The embodiments of the present application do not limit the specific values and setting methods of the congestion vehicle speed, the first duration, and the first length. For example, when the road section where the first vehicle is located is a highway, the congestion vehicle speed can be 40 km / h. When the road section where the first vehicle is located is in the urban area, the congestion vehicle speed can be 15 km / h. The first length can be 1 km or other values. The first duration can be 15 minutes or other values.

[0061] In one possible implementation, the congestion situation of the first vehicle can be determined based on the number of vehicles passing through the road section where the first vehicle is located within the current time period. If the number of vehicles passing through the road section where the first vehicle is located within the current time period is small, it can indicate that congestion has occurred on the road section where the first vehicle is located. If the number of vehicles passing through the road section where the first vehicle is located within the current time period is large, it can indicate that no congestion has occurred on the road section where the first vehicle is located. In this case, the congestion situation of the first vehicle can be provided by the navigation system of the first vehicle.

[0062] S202: Adjust the rendered AR content based on the vehicle speed and driving information of the first vehicle.

[0063] After the head-up display device obtains the vehicle speed and driving information of the first vehicle, it can adaptively adjust the rendered AR content based on the obtained information. The rendered AR content is virtual content, and the rendered AR content is projected into the driver's field of view and superimposed on the actual road conditions seen by the driver to form an augmented reality effect. Without leaving the driving field of view, the driver can see this superimposed image information. In this way, the driver can see this superimposed image information without having to lower their head or turn their head during driving, which is beneficial for providing AR content that better conforms to the actual driving scenario, reducing the risk of blind driving, and thus improving driving safety and convenience.

[0064] In the embodiments of the present application, the AR content may include, but is not limited to, one or more of the following: AR content associated with driving, AR content associated with leisure and entertainment services. Among them, the AR content associated with driving may include, but is not limited to, one or more of the following: virtual images corresponding to objects in the real environment, navigation information associated with the object, road traffic information (such as lane lines, traffic lights, etc.), the distance between the object and the first vehicle, the orientation of the object relative to the first vehicle, the speed of the object, road signs, safety warnings.

[0065] The AR content associated with leisure and entertainment services refers to the AR content corresponding to an object associated with leisure and entertainment services (hereinafter referred to as the target object). The target object may include, but is not limited to: shops, shopping malls, scenic spots, parks, public entertainment venues, amusement parks, tourism and leisure areas, restaurants, objects on the street. The AR content corresponding to the target object may include: indication information of the leisure and entertainment services associated with the target object. Taking the target object as a shop as an example, the indication information of the leisure and entertainment services associated with the shop may include, but is not limited to: the product display, product logo, product pictures of the shop.

[0066] In the embodiments of the present application, an object may refer to a movable object or an immovable object in the real environment. For specific content, refer to the previous description and will not be elaborated here. The sensors of the first vehicle can identify the object and measure the distance between the object and the first vehicle. For specific content, refer to the previous description and will not be elaborated here.

[0067] For example, if the object is a road, the AR content corresponding to the road may include, but is not limited to, one or more of the following: lane lines corresponding to the road, navigation information associated with the road, construction area warnings corresponding to the road, road signs, speed limit information of the road. Another example, if the object is a vehicle (such as vehicle a), the AR content corresponding to vehicle a may include, but is not limited to, one or more of the following: a virtual image of vehicle a, the speed of vehicle a, the distance between vehicle a and a first vehicle. Another example, if the object is a store, the AR content corresponding to the store may include, but is not limited to, one or more of the following: the identifier of the store (such as the store name, store icon, store photo), the distance between the store and the first vehicle, the estimated duration for the first vehicle to travel to the store, the indication information of the leisure and entertainment services associated with the store (such as the display of goods in the store, product pictures, etc.).

[0068] In a possible implementation manner, the head-up display device may determine the indication information of the leisure and entertainment services associated with the target object in the following way: Based on the relative position between the target object and the first vehicle sensed by the sensors of the first vehicle, and the known position information of the first vehicle, perform coordinate transformation to obtain the position information of the target object; match the position information of the target object with the map to obtain the relevant information of the target object in the map, and these relevant information can determine the indication information of the leisure and entertainment services associated with the target object. Among them, the position information of the first vehicle and the target object may include global positioning information or longitude and latitude.

[0069] In a possible implementation manner, the driving information of the first vehicle includes the driving direction. The specific implementation manner of S202 may be: When the speed of the first vehicle is greater than the first speed and the driving direction is straight (hereinafter referred to as situation 1), the head-up display device adjusts the rendered AR content. Or, when the duration of situation 1 is greater than the first duration, the head-up display device adjusts the rendered AR content. Situation 1 may indicate that the first vehicle is on a highway and going straight. For example, the first vehicle driving on a highway belongs to situation 1. Among them, the adjusted rendered AR content corresponds to the objects within the first distance range in front of the first vehicle, and the AR content rendered before adjustment corresponds to the objects within the second distance range in front of the first vehicle, and the first distance is greater than the second distance.

[0070] In this way, the head-up display device can adjust from rendering the AR content corresponding to the objects within the second distance range in front of the first vehicle to: rendering the AR content corresponding to the objects within the first distance range in front of the first vehicle. In other words, the head-up display device can render the AR content corresponding to the objects within a farther distance range in front of the first vehicle, which can provide AR content that better conforms to the actual driving scenario corresponding to situation 1, that is, adaptively adjust the rendering focus based on the actual driving scenario, facilitating the driver to make better driving decisions, and thus being beneficial to improving driving safety.

[0071] Exemplarily, taking the second distance as 10 meters, the first distance as 200 meters, the object as a road, and the AR content corresponding to the road as lane lines as an example, before not being in Situation 1, the head-up display device can render the lane lines within 10 meters in front of the first vehicle. When in Situation 1, the lane is relatively straight and the vehicle speed is relatively fast. If the rendered AR content is the same as that of an urban road, the rendering distance of the lane lines is short. If an unexpected situation occurs, the driver cannot be reminded in time, which will increase the driving risk. By implementing the embodiments of the present application, when in Situation 1, the head-up display device renders the lane lines within 200 meters in front of the first vehicle, which is convenient for the driver to make better driving decisions and is beneficial to improving driving safety.

[0072] In a possible implementation manner, during the process of the head-up display device rendering the AR content corresponding to the object within the first distance in front of the first vehicle, it can be rendered based on the logic of near objects being larger and far objects being smaller. For example, the objects within the first distance in front of the first vehicle at least include Vehicle 1 and Vehicle 2, where Vehicle 1 is closer to the first vehicle and Vehicle 2 is farther from the first vehicle. In this case, the virtual image (i.e., the AR content) corresponding to Vehicle 1 obtained by rendering is larger than the virtual image corresponding to Vehicle 2 obtained by rendering. In this way, the driver can more intuitively understand the relative position and distance between the virtual content and the real world, which is convenient for the driver to make better driving decisions and is beneficial to improving driving safety.

[0073] In a possible implementation manner, the driving information of the first vehicle includes the driving state. The specific implementation manner of S202 can be: when the vehicle speed of the first vehicle is less than the second speed and the driving state of the first vehicle is a high-dynamic driving state (hereinafter referred to as Situation 2), adjust the rendered AR content. Or, when the duration of Situation 2 is greater than the second duration, the head-up display device adjusts the rendered AR content. Wherein, the number of the adjusted rendered AR content is greater than the number of the AR content before adjustment, and / or the type number of the adjusted rendered AR content is greater than the type number of the AR content before adjustment. In this way, after adjustment, the head-up display device can render more AR content in terms of quantity and / or type. In this way, the head-up display device can render more detailed AR content and provide AR content more in line with the actual driving scenario corresponding to Situation 2, that is, adaptively adjust the rendering focus based on the actual driving scenario, so as to facilitate the driver to make better driving decisions, thereby being beneficial to improving driving safety.

[0074] Case 2 may indicate that the first vehicle is in a low-speed and high-dynamic driving state. For example, the first vehicle driving at a low speed but making a sharp turn belongs to Case 2. Or, the first vehicle driving at a low speed but making an emergency brake belongs to Case 2. Or, the first vehicle driving at a low speed but with the body shaking belongs to Case 2. For the specific content of the high-dynamic driving state, reference can be made to the description above, which will not be elaborated here.

[0075] In a possible implementation, in Case 2, the adjusted-rendered AR content corresponds to the objects within the third distance range around the first vehicle, and the pre-adjustment-rendered AR content corresponds to the objects within the fourth distance range around the first vehicle, where the third distance is less than or equal to the fourth distance.

[0076] In this way, the head-up display device can adjust from rendering the AR content corresponding to the objects within the fourth distance range around the first vehicle to rendering the AR content corresponding to the objects within the third distance range around the first vehicle. In other words, the head-up display device can render the AR content corresponding to the objects within a closer distance range around the first vehicle in more detail, that is, render the situation around the first vehicle in more detail, which is convenient for the driver to make better driving decisions and is beneficial to improving driving safety. For example, the head-up display device can render more detailed lane lines around the first vehicle, obstacles around the first vehicle (such as curbs, roadside bushes, pedestrians, bicycles, other vehicles, etc.).

[0077] In a possible implementation, the driving information of the first vehicle includes the driver's attention information and the congestion situation. The specific implementation manner of S202 can be: when the first vehicle meets the second condition (hereinafter referred to as Case 3), the rendered AR content is adjusted. Or, when the duration of Case 3 is greater than the third duration, the head-up display device adjusts the rendered AR content. Among them, the first vehicle meeting the second condition includes: the speed of the first vehicle is within the speed range, the section where the first vehicle is located is not congested, and the driver's attention is not focused on driving. The adjusted-rendered AR content includes AR content related to driving and AR content related to leisure and entertainment services; the pre-adjustment-rendered AR content is related to driving. For the specific content of the AR content related to driving and the AR content related to leisure and entertainment services, reference can be made to the description above, which will not be elaborated here.

[0078] Case 3 may indicate that the first vehicle is in a wandering state. For example, taking the maximum speed in the speed range as 10 km / h and the minimum speed as 8 km / h, that is, the speed range is [8 km / h, 10 km / h] as an example, assuming that the average speed of the first vehicle is lower than 10 km / h (but the section where the first vehicle is located is not congested) and the driver's attention is not focused on driving, it belongs to Case 3.

[0079] After adjustment, in addition to rendering AR content related to driving, the head-up display device can additionally render AR content related to entertainment services. In this way, richer AR content can be provided, and AR content more in line with the actual driving scenario corresponding to Scenario 3 can be provided, that is, the focus of rendering is adaptively adjusted based on the actual driving scenario, which facilitates the driver to make better driving decisions, thereby contributing to improving driving safety and convenience.

[0080] Optionally, the AR content rendered before adjustment may or may not include AR content related to entertainment services.

[0081] In a possible implementation, in Scenario 3, the number of AR content related to driving rendered after adjustment is less than the number of AR content related to driving rendered before adjustment, and / or the number of types of AR content related to driving rendered after adjustment is less than the number of types of AR content related to driving rendered before adjustment, and / or the number of AR content related to entertainment services rendered after adjustment is greater than the number of AR content related to entertainment services rendered before adjustment, and / or the number of types of AR content related to entertainment services rendered after adjustment is greater than the number of types of AR content related to entertainment services rendered before adjustment.

[0082] In this way, on the one hand, after adjustment, the head-up display device can reduce the number and / or types of AR content related to driving rendered, that is, the head-up display device can only render the necessary AR content related to driving and reduce the rendering of unnecessary AR content related to driving. On the other hand, after adjustment, the head-up display device can increase the number and / or types of AR content related to entertainment services rendered, and adaptively adjust the focus of rendering based on the actual driving scenario, which is conducive to improving driving safety and convenience.

[0083] For example, when the first vehicle is in a wandering state, the head-up display device can reduce the rendering of road traffic information, such as reducing the rendering of lane lines and road signs, and only retain the rendering of necessary road traffic information such as traffic lights, and additionally render the AR content corresponding to the entertainment service venues around the first vehicle.

[0084] In a possible implementation, in case 3, the number of AR contents associated with leisure and entertainment services rendered before adjustment is less than the number of AR contents associated with driving rendered before adjustment, and / or, the number of types of AR contents associated with leisure and entertainment services rendered before adjustment is less than the number of types of AR contents associated with driving rendered before adjustment. The number of AR contents associated with leisure and entertainment services rendered after adjustment is greater than the number of AR contents associated with driving rendered after adjustment, and / or, the number of AR contents associated with leisure and entertainment services rendered after adjustment is greater than the number of AR contents associated with driving rendered after adjustment. In other words, the focus of rendering before adjustment is on AR contents associated with driving, and the focus of rendering after adjustment is on AR contents associated with leisure and entertainment services, which is beneficial to improving driving safety and convenience.

[0085] In a possible implementation, in case 3, the first vehicle can reduce the frame rate of the sensor delay compensation algorithm. Correspondingly, the first vehicle can also reduce the frame rate of sensor data acquisition. The higher the frame rate, the greater the demand of the algorithm for computing resources. By reducing the frame rate, it is beneficial to reduce the consumption of software resources and hardware resources. The sensor delay compensation algorithm is used to reduce the delay between sensor data acquisition, processing, and rendering. Through the sensor delay compensation algorithm, the data collected by the sensor can be quickly processed and fed back to the rendered image in real time, so that the rendered content is synchronized with the actual situation and the user does not feel the delay. The frame rate of the sensor delay compensation algorithm refers to the frequency at which the algorithm runs to compensate for sensor data delay, and this frequency needs to be synchronized with the frame rate of the rendering system. The frame rate of sensor data acquisition is the rate at which the sensor itself can acquire data. Different sensors have different frame rates. For example, an ordinary camera may support 30 frames per second, while a high-performance camera may support 60 frames per second or higher.

[0086] In a possible implementation, the driving information of the first vehicle may further include the position of the first vehicle. The first vehicle meeting the second condition may further include: the position of the first vehicle is within the area associated with leisure and entertainment services. The area associated with leisure and entertainment services may include but is not limited to: bustling urban areas, scenic spots, business districts, public entertainment venues, amusement parks, tourist and leisure areas, and dining areas. The position of the first vehicle may include the global positioning information or longitude and latitude of the first vehicle.

[0087] In this way, it is possible to more accurately determine that the user hopes to see AR contents associated with leisure and entertainment services, which is beneficial to providing AR contents that more conform to the actual driving scenario corresponding to case 3, thereby facilitating driving.

[0088] In a possible implementation, the driving information of the first vehicle includes the congestion situation. The specific implementation of S202 can be: when the road section where the first vehicle is located is congested (hereinafter referred to as situation 4), the head-up display device adjusts the rendered AR content. Or, when the duration of situation 4 is greater than the fourth duration, the head-up display device adjusts the rendered AR content. Among them, the adjusted rendered AR content includes the AR content corresponding to the second vehicle, and the distance between the second vehicle and the first vehicle is less than the fifth distance. The number of second vehicles can be one or more.

[0089] In this way, the head-up display device can render the AR content corresponding to the second vehicle around the first vehicle, which can provide AR content that more conforms to the actual driving scenario corresponding to situation 4, that is, adaptively adjust the focus of rendering based on the actual driving scenario, which is beneficial to avoiding collisions between the first vehicle and the second vehicle, and thus beneficial to improving driving safety. Among them, the AR content corresponding to the second vehicle can include but is not limited to: the virtual image of the second vehicle, the speed of the second vehicle, and the distance between the second vehicle and the first vehicle.

[0090] In a possible implementation, before situation 4, the AR content rendered by the head-up display device may not include the AR content corresponding to the second vehicle. When in situation 4, the head-up display device can reduce the originally rendered AR content and focus on rendering the AR content corresponding to the second vehicle, which is beneficial to avoiding collisions between the first vehicle and the second vehicle, and thus beneficial to improving driving safety.

[0091] In a possible implementation, before situation 4, the AR content rendered by the head-up display device may include the AR content corresponding to the second vehicle and the AR content corresponding to the third vehicle, and the distance between the third vehicle and the first vehicle is greater than or equal to the fifth distance. When in situation 4, the head-up display device can reduce or suspend rendering the AR content corresponding to the third vehicle and focus on rendering the AR content corresponding to the second vehicle, which is beneficial to avoiding collisions between the first vehicle and the second vehicle, and thus beneficial to improving driving safety. The number of third vehicles can be one or more.

[0092] In a possible implementation, in situation 4, the first vehicle can increase the frame rate of the sensor delay compensation algorithm, which is beneficial to improving the rendering accuracy and further improving driving safety.

[0093] In a possible implementation, when the body of the first vehicle shakes, the head-up display device can perform shake compensation on the rendered AR content, which can make the AR content more conform to the actual real scenario. For example, making the rendered lane lines more conform to the actual lane.

[0094] The head-up display device can perform jitter compensation on the rendered AR content in the following manner: When the body of the first vehicle jitters, predict the pose under normal conditions through the most recent non-jitter trajectory, and determine the offset between the jitter pose detected in real time and the pose under normal conditions. Based on this offset, reverse-compensate the rendered AR content, which can make the rendered AR content conform to the actual situation. For example, when the body is raised, move the display position of the rendered AR content downward. Another example is that when the body shifts to the left, move the display position of the rendered AR content to the right. In this way, the following situation can be avoided: When the body jitters, the rendered AR content will jitter with the body and cannot conform to the actual scene (such as the rendered lane lines not conforming to the actual lanes), and such misalignment will bring a very bad AR experience.

[0095] The IMU of the first vehicle has a high frame rate. Based on this, the head-up display device can detect and compensate the body posture more real-time. For example, the frame rate of the IMU can be 100 frames per second.

[0096] In a possible implementation manner, the first speed, the second speed, the maximum speed of the speed range, the minimum speed of the speed range, the first duration, the second duration, the third duration, and the fourth duration can all be default-set by the head-up display device or the first vehicle, or the first speed, the second speed, the maximum speed of the speed range, the minimum speed of the speed range, the first duration, the second duration, the third duration, and the fourth duration can all be set or modified by the head-up display device or the first vehicle according to user operations. The embodiments of the present application do not limit the specific values and setting methods of the first speed, the second speed, the maximum speed of the speed range, the minimum speed of the speed range, the first duration, the second duration, the third duration, and the fourth duration.

[0097] In a possible implementation manner, the second speed can be less than or equal to the first speed. Optionally, the difference between the first speed and the second speed can be greater than the first difference, and the first difference is a positive number. In other words, the first speed can be much greater than the second speed.

[0098] In a possible implementation manner, the second speed can be less than or equal to the maximum speed of the speed range, or the second speed can be greater than or equal to the maximum speed of the speed range. The embodiments of the present application do not limit the magnitude relationship between the second speed and the maximum speed of the speed range.

[0099] By implementing the embodiments of the present application, the head-up display device can adaptively adjust the rendering focus based on the actual driving scenario, that is, adaptively adjust the rendered AR content, so as to provide AR content that better conforms to the actual driving scenario, which helps to maintain the driver's attention, reduce the risk of blind driving, and thus is beneficial to improving driving safety and convenience.

[0100] Please refer to Figure 3 , Figure 3 which is a schematic structural diagram of an AR content adjustment device provided by an embodiment of the present application. As Figure 3 shown, the AR content adjustment device 30 includes an acquisition unit 301 and an adjustment unit 302. The AR content adjustment device 30 can execute the relevant steps of the head-up display device in the foregoing method embodiments.

[0101] The acquisition unit 301 is configured to acquire the vehicle speed and driving information of the first vehicle, where the driving information includes one or more of the driving direction, driving state, driver's attention information, and traffic congestion situation;

[0102] The adjustment unit 302 is configured to adjust the rendered AR content based on the vehicle speed and the driving information.

[0103] In one implementation, the driving information includes the driving direction; the adjustment unit 302 can be configured to: when the vehicle speed is greater than the first speed and the driving direction is straight, adjust the rendered AR content; wherein, the adjusted rendered AR content corresponds to the objects within the first distance range in front of the first vehicle, and the pre-adjusted rendered AR content corresponds to the objects within the second distance range in front of the first vehicle, and the first distance is greater than the second distance.

[0104] In one implementation, the driving information includes the driving state; the adjustment unit 302 can be configured to: when the vehicle speed is less than the second speed and the driving state is a high-dynamic driving state, adjust the rendered AR content; wherein, the adjusted rendered AR content corresponds to the objects within the third distance range around the first vehicle, and the pre-adjusted rendered AR content corresponds to the objects within the fourth distance range around the first vehicle, and the third distance is less than or equal to the fourth distance; the number of the adjusted rendered AR content is greater than the number of the pre-adjusted rendered AR content, and / or, the type number of the adjusted rendered AR content is greater than the type number of the pre-adjusted rendered AR content.

[0105] In one implementation, when the first vehicle meets the first condition, the driving state of the first vehicle is a high-dynamic driving state; wherein, the first vehicle meeting the first condition includes one or more of the following: the first vehicle makes an emergency brake; the first vehicle makes a sharp turn; the body of the first vehicle shakes.

[0106] In one implementation, the driving information includes the driver's attention information and the congestion situation. Among them, the driver's attention information is used to indicate whether the driver's attention is focused on driving, and the congestion situation is used to indicate whether the section where the first vehicle is located is congested; the adjustment unit 302 can be used to: when the first vehicle meets the second condition, adjust the rendered AR content; where the first vehicle meets the second condition includes: the vehicle speed is within the speed range, the section where the first vehicle is located is not congested, and the driver's attention is not focused on driving; the adjusted rendered AR content includes AR content associated with driving and AR content associated with leisure and entertainment services; the AR content rendered before adjustment is associated with driving.

[0107] In one implementation, the number of AR content associated with driving rendered after adjustment is less than the number of AR content associated with driving rendered before adjustment, and / or, the number of types of AR content associated with driving rendered after adjustment is less than the number of types of AR content associated with driving rendered before adjustment, and / or, the number of AR content associated with leisure and entertainment services rendered after adjustment is greater than the number of AR content associated with leisure and entertainment services rendered before adjustment, and / or, the number of types of AR content associated with leisure and entertainment services rendered after adjustment is greater than the number of types of AR content associated with leisure and entertainment services rendered before adjustment.

[0108] In one implementation, the driving information further includes the position of the first vehicle; the first vehicle meeting the second condition further includes: the position of the first vehicle is within the area associated with leisure and entertainment services.

[0109] In one implementation, the driving information includes the congestion situation, which is used to indicate whether the section where the first vehicle is located is congested; the adjustment unit 302 can be used to: when the section where the first vehicle is located is congested, adjust the rendered AR content; where the adjusted rendered AR content includes AR content corresponding to a second vehicle, and the distance between the second vehicle and the first vehicle is less than a fifth distance.

[0110] Specifically, in this case, the operations performed by the acquisition unit 301 and the adjustment unit 302 can refer to Figures 1-2 the introduction of the head-up display device in the corresponding embodiment.

[0111] Please refer to Figure 4 , Figure 4 which is a schematic structural diagram of a head-up display device 40 provided in an embodiment of the present application. It can be used to implement the functions of the head-up display device in the above method embodiments. The head-up display device 40 may include a processor 401. Optionally, the head-up display device 40 may further include a memory 402. Among them, the processor 401 and the memory 402 may be connected through a bus 403 or other means. The bus is in Figure 4The connection between the central unit is represented by a thick line, and the connection manners between other components are only for illustrative purposes and are not limited thereto. The bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of convenience of representation, Figure 4 it is only represented by a thick line in the figure, but it does not mean that there is only one bus or one type of bus.

[0112] The coupling in the embodiments of the present application is an indirect coupling or communication connection between devices, units or modules, which can be electrical, mechanical or other forms, and is used for information interaction between devices, units or modules. In the embodiments of the present application, the specific connection medium between the above-mentioned processor 401 and the memory 402 is not limited.

[0113] The memory 402 may include a read-only memory and a random access memory, and provide instructions and data to the processor 401. A part of the memory 402 may also include a non-volatile random access memory.

[0114] The processor 401 may be a central processing unit (CPU), and the processor 401 may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor, and optionally, the processor 401 may also be any conventional processor, etc.

[0115] In one example, when the head-up display device adopts Figure 4 the form shown, Figure 4 the processor in it may execute the method executed by the head-up display device in any of the above method embodiments.

[0116] In an alternative embodiment, the memory 402 is used to store computer programs or instructions; the processor 401 is used to call the computer programs or instructions stored in the memory 402 to execute Figures 1-2 the steps executed by the head-up display device in the corresponding embodiment.

[0117] Specifically, Figure 3 the functions / implementation processes of the acquisition unit 301 and the adjustment unit 302 in it can both be implemented by Figure 4 the processor 401 in it calling the computer programs or instructions stored in the memory 402.

[0118] In the embodiments of the present application, the method provided by the embodiments of the present application can be implemented by running a computer program (including program code) capable of executing the steps involved in the above method on a general computing device such as a computer including processing elements and storage elements such as a CPU, a random access memory (RAM), and a read-only memory (ROM). The computer program can be recorded on a computer-readable recording medium, loaded into the head-up display device through the computer-readable recording medium, and run therein.

[0119] Based on the same inventive concept, the principle of solving problems and the beneficial effects of the head-up display device 40 provided in the embodiments of the present application are similar to those of the head-up display device in the method embodiments of the present application. For the principle and beneficial effects of the method implementation, reference can be made thereto. For the sake of brevity, they will not be elaborated here.

[0120] The embodiments of the present application further provide a computer-readable storage medium, in which a computer program or computer instructions are stored. The computer program or computer instructions are adapted to be loaded and executed by the head-up display device to execute the method provided by the above method embodiments.

[0121] The embodiments of the present application further provide a computer program product including a computer program or instructions. When the computer program or instructions run on the head-up display device, the head-up display device is caused to execute the method provided by the above method embodiments.

[0122] The embodiments of the present application further provide a vehicle, including: a vehicle body and a head-up display device disposed in the vehicle body. The head-up display device executes the method provided by the above method embodiments. For the specific content of the vehicle, reference can be made to Figure 1 the relevant description, which will not be elaborated here.

[0123] Regarding each device and product described in the above embodiments, each module / unit included therein can be a software module / unit, a hardware module / unit, or can be partly a software module / unit and partly a hardware module / unit. For example, for each device and product applied to or integrated into a chip, each module / unit included therein can be implemented in the form of hardware such as circuits. Alternatively, at least some of the modules / units can be implemented in the form of a software program that runs on a processor integrated inside the chip, and the remaining (if any) part of the modules / units can be implemented in the form of hardware such as circuits. For each device and product applied to or integrated into a chip module, each module / unit included therein can be implemented in the form of hardware such as circuits. Different modules / units can be located in the same component (such as a chip, a circuit module, etc.) or different components of the chip module. Alternatively, at least some of the modules / units can be implemented in the form of a software program that runs on a processor integrated inside the chip module, and the remaining (if any) part of the modules / units can be implemented in the form of hardware such as circuits. For each device and product applied to or integrated into a head-up display device, each module / unit included therein can be implemented in the form of hardware such as circuits. Different modules / units can be located in the same component (such as a chip, a circuit module, etc.) or different components inside the head-up display device. Alternatively, at least some of the modules / units can be implemented in the form of a software program that runs on a processor integrated inside the head-up display device, and the remaining (if any) part of the modules / units can be implemented in the form of hardware such as circuits.

[0124] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described action sequence, because according to this application, some steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0125] In the above embodiments, the descriptions of the respective embodiments have their own focuses, and any plurality of embodiments can be combined for use. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0126] The steps in the method embodiments of this application can be adjusted, combined, and deleted according to actual needs.

[0127] The modules in the device embodiments of this application can be combined, divided, and deleted according to actual needs.

[0128] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by program instructions and related hardware. The program instructions can be stored in a computer-readable storage medium, which can include: flash drives, ROM, RAM, magnetic disks, or optical discs, etc.

[0129] What has been disclosed above is only one embodiment of the present application, and it is only a part of the embodiments of the present application. It cannot be used to limit the scope of rights of the present application.

Claims

1. A method for adjusting AR content, characterized in that: Applied to a head-up display device, the method comprises: Acquiring a speed and driving information of the first vehicle, wherein the driving information includes one or more of a driving direction, a driving state, a driver's attention information, and a congestion condition; Adjust rendered AR content based on the vehicle speed and the driving information.

2. The method according to claim 1, characterized in that The driving information includes the driving direction; The adjusting the rendered AR content based on the vehicle speed and the driving information includes: When the vehicle speed is greater than the first speed and the driving direction is straight ahead, adjusting the rendered AR content; Among them, the AR content rendered after adjustment corresponds to an object within a first distance range in front of the first vehicle, and the AR content rendered before adjustment corresponds to an object within a second distance range in front of the first vehicle, and the first distance is greater than the second distance.

3. The method according to claim 1, characterized in that The driving information includes the driving status; The adjusting the rendered AR content based on the vehicle speed and the driving information includes: When the vehicle speed is less than the second speed and the driving state is a high-dynamic driving state, adjusting the rendered AR content; the rendered AR content after adjustment corresponds to an object within a third distance range around the first vehicle, and the rendered AR content before adjustment corresponds to an object within a fourth distance range around the first vehicle, and the third distance is less than or equal to the fourth distance; The number of AR contents rendered after the adjustment is greater than the number of AR contents rendered before the adjustment, and / or the number of types of AR contents rendered after the adjustment is greater than the number of types of AR contents rendered before the adjustment.

4. The method according to claim 3, characterized in that When the first vehicle satisfies the first condition, the driving state of the first vehicle is a high dynamic driving state; The first vehicle satisfies the first condition including one or more of the following: The first vehicle performs emergency braking; the first vehicle makes a sharp turn; The body of the first vehicle vibrates.

5. The method according to claim 1, characterized in that The driving information includes the driver's attention information and the congestion situation, wherein the driver's attention information is used to indicate whether the driver is concentrating on driving, and the congestion situation is used to indicate whether congestion occurs on the road section where the first vehicle is located; The adjusting the rendered AR content based on the vehicle speed and the driving information includes: When the first vehicle satisfies a second condition, adjusting the rendered AR content; wherein the first vehicle satisfies the second condition including: the vehicle speed is within a speed range, the road section where the first vehicle is located is not congested, and the driver is not focusing on driving; The AR content rendered after the adjustment includes AR content associated with driving and AR content associated with leisure and entertainment services; the AR content rendered before the adjustment is associated with driving.

6. The method according to claim 5, characterized in that The number of driving-associated AR contents rendered after the adjustment is less than the number of driving-associated AR contents rendered before the adjustment, and / or the number of types of driving-associated AR contents rendered after the adjustment is less than the number of types of driving-associated AR contents rendered before the adjustment; and / or, The number of AR contents associated with the leisure and entertainment services rendered after the adjustment is greater than the number of AR contents associated with the leisure and entertainment services rendered before the adjustment, and / or the number of types of AR contents associated with the leisure and entertainment services rendered after the adjustment is greater than the number of types of AR contents associated with the leisure and entertainment services rendered before the adjustment.

7. The method according to claim 5 or 6, characterized in that: The driving information also includes the location of the first vehicle; The first vehicle satisfying the second condition also includes: the location of the first vehicle is within an area associated with leisure and entertainment services.

8. The method according to claim 1, characterized in that The driving information includes the congestion situation, where the congestion situation is used to indicate whether congestion occurs on the road section where the first vehicle is located; The adjusting the rendered AR content based on the vehicle speed and the driving information includes: When congestion occurs on the road section where the first vehicle is located, adjusting the rendered AR content; The adjusted rendered AR content includes AR content corresponding to a second vehicle, and a distance between the second vehicle and the first vehicle is less than a fifth distance.

9. A head-up display device, characterized in that: The method comprises a memory and at least one processor connected to the memory, wherein the memory is used to store computer programs or instructions, and the at least one processor is used to execute the computer programs or instructions in the memory, and when the computer program or instructions are executed by the processor, the head-up display device executes the method according to any one of claims 1 to 9.

10. A means of transport, characterized in that: include: A vehicle body and a head-up display device arranged in the vehicle body, wherein the head-up display device is used to implement the method as claimed in any one of claims 1 to 9.

Images