A projection control method and vehicle

Abstract

A projection control method and vehicle are disclosed, relating to the field of autonomous driving. The method controls a projection device and a head-up display (HUD) device based on the vehicle's first environmental information. The projection device projects a first pattern to indicate the presence of a first object in the vehicle's environment, and the HUD device displays a first identifier to indicate the relationship between the first pattern and the first object, or the relationship between the vehicle and the first object. The first pattern and first identifier allow the driver to accurately understand the relationship between the vehicle and its surroundings, enabling the driver to make more accurate judgments and better control the vehicle. This allows the driver to better participate in traffic, thereby reducing the probability of traffic accidents and protecting occupants and other road users outside the vehicle.

Description

Technical Field

[0001] This application relates to the field of autonomous driving, and more particularly to a projection control method and vehicle. Background Technology

[0002] All vehicles are equipped with a head-up display (HUD) and indicator lights, which can provide corresponding reminders. The vehicles can be autonomous vehicles (self-piloting automobiles), also known as driverless vehicles, and can also be cars, trucks, motorcycles, public vehicles, lawnmowers, recreational vehicles, amusement park vehicles, trams, golf carts, trains, or handcarts, etc.

[0003] Current vehicle HUDs offer limited alerting functions, only indicating vehicle status. Similarly, existing vehicle indicator lights, such as headlights, taillights, and turn signals, also offer relatively limited alerting functions, only providing reminders or illuminating the driving path. Summary of the Invention

[0004] This application provides a projection control method and a vehicle, relating to the field of autonomous driving. The method can control the vehicle's HUD device and projection device based on the vehicle's first environmental information to assist the driver in better participating in traffic and improve driving safety.

[0005] In a first aspect, embodiments of this application provide a projection control method, comprising: acquiring first environmental information of a vehicle; controlling a projection device to project a first pattern into the environment in which the vehicle is located based on the first environmental information; and controlling a HUD device to display a first identifier based on the first environmental information. The first pattern is used to indicate the presence of a first object in the environment in which the vehicle is located, and the first identifier is used to identify the relationship between the first pattern and the first object, or the relationship between the vehicle and the first object.

[0006] This application embodiment uses the vehicle's first environmental information to control the operation of a projection device and a HUD device. The projection device projects a first pattern to indicate the presence of a first object in the vehicle's environment, and the HUD device displays a first identifier to indicate the relationship between the first pattern and the first object, or the relationship between the vehicle and the first object. The relationship between the first pattern and the first object can be, for example, the distance between the vehicle's lane markings and a pedestrian, or the distance between a turning sign and an intersection. The relationship between the vehicle and the first object can be, for example, the distance between the vehicle and a pedestrian, the distance between the vehicle and a static obstacle, or the relative speed between the vehicle and other vehicles. Therefore, the aforementioned first pattern and first identifier allow the driver to accurately understand the relationship between the vehicle and its surrounding environment, enabling the driver to make more accurate judgments and better control the vehicle, allowing the driver to participate more effectively in traffic, thereby reducing the probability of traffic accidents and protecting occupants and other road users outside the vehicle. Furthermore, based on the first pattern and the first sign, the driver can directly obtain the driving operation that the vehicle needs to perform next. For example, if the first pattern is a turning sign and the first sign indicates that the distance between the turning sign and the turning intersection is 50 meters, then the driver can directly know that "the turning operation needs to be performed at the intersection after 50 meters" based on the first pattern and the first sign. Obviously, this method also helps drivers participate in traffic better and improve driving safety.

[0007] Understandably, the first pattern projected by the projection device and the first sign displayed by the HUD device are both within the driver's field of vision, allowing the driver to obtain them without having to look up, turn their head, or nod. This enables the information presented by the first pattern and the first sign to be conveyed to the driver in a timely manner, allowing the driver to react and correctly control the vehicle to participate in traffic, thereby improving driving safety.

[0008] It is also understood that the embodiments of this application can leverage the advantages of both the HUD device and the projection device to assist drivers in better participating in traffic. For example, the projection device projects a first pattern, which on the one hand helps the driver better observe the surrounding environment of the vehicle, and on the other hand allows interaction with other road users outside the vehicle. However, due to limitations such as the resolution of the projection device or the smoothness of the road surface, the first pattern projected by the projection device often cannot clearly display some precise information (e.g., numbers, text, etc.). However, the HUD device can clearly display some precise information, thereby compensating for the insufficient resolution of the projection device. This allows the content superimposed by the projection device and the HUD device to better assist the driver in participating in traffic, while also accommodating interaction with other road users outside the vehicle.

[0009] Optionally, the vehicle's first environmental information includes information about the environment surrounding the vehicle and / or information about the environment in which the vehicle is located. The information about the environment surrounding the vehicle can be information obtainable through the vehicle's sensors, such as information obtainable through the vehicle's advanced driving assistance system (ADAS). The information about the environment in which the vehicle is located includes environmental information that the vehicle cannot directly perceive through its own onboard sensors, such as map information about the area around the vehicle or information obtained through a vehicle-to-everything (V2X) wireless communication system.

[0010] Optionally, the projection device projects a first pattern into the environment in which the vehicle is located. For example, the projection device projects the first pattern onto one or more of the following: the ground in front of the vehicle, oncoming vehicles, obstacles, green belts, curbs, tunnel entrances, or height restriction frames.

[0011] In one possible implementation, after controlling the projection device to project the first pattern in the environment where the vehicle is located, the method further includes: acquiring the first pattern, and controlling the HUD device to display the first logo based on the first pattern and the first environmental information.

[0012] In the above embodiment, the projection device is first controlled to project a first pattern onto the vehicle's environment based on the first environmental information, and the first pattern is acquired. Then, the HUD device is controlled to display a first identifier based on the first pattern and the first environmental information. This allows the first pattern projected by the projection device and the first identifier displayed by the HUD device to blend better, enabling the first identifier to more accurately identify the relationship between the first pattern and the first object, or the relationship between the vehicle and the first object, thereby better assisting the driver in traffic and improving driving safety. It is understood that the first pattern projected by the projection device may also be deformed or misaligned due to factors such as road surface distortion or vehicle body sway. In this case, since the first identifier projected by the HUD device is determined based on the first pattern and the first environmental information, the first identifier projected by the HUD device can promptly follow the deformation or misalignment of the first pattern, avoiding situations where the first identifier cannot accurately blend with the first pattern.

[0013] It is understood that in the above embodiments, there will be a time interval between the projection of the first pattern by the projection device and the display of the first logo by the HUD device. Correspondingly, the vehicle's environment will also change to some extent. Therefore, controlling the HUD device to display the first logo based on the first environmental information may result in inaccurate display. In view of this, this application provides another possible implementation to reduce the various effects that may be caused by changes in the vehicle's environment.

[0014] In another possible implementation, after controlling the projection device to project the first pattern in the vehicle's environment, the method further includes: acquiring the first pattern and second environmental information of the vehicle, and controlling the HUD device to display the first logo based on the first pattern and the second environmental information.

[0015] In the above embodiments, the second environmental information can be information acquired simultaneously with the first pattern, or it can be understood as the most recently acquired information about the vehicle's environment. Clearly, controlling the HUD device to display the first icon based on the first pattern and the second environmental information allows for better integration of the first icon and the first pattern, presenting more accurate information, thereby better assisting the driver in traffic and improving driving safety.

[0016] In another possible implementation, the first identifier includes a locking frame for locking the first object.

[0017] In the above embodiments, the locking frame in the first identifier is used to lock the first object, which can help the driver better identify the first object. For example, if there is relative motion between the first object and the vehicle, and the first object is also in motion within the driver's field of vision, the locking frame in the first identifier helps the driver lock onto the first object and avoid losing track of it. As another example, if the driver's field of vision includes multiple objects similar to the first object, the locking frame in the first identifier can help the driver better distinguish the first object from other objects. Furthermore, if the boundaries of the first object are somewhat blurred, the locking frame in the first identifier can also help to better identify the boundaries of the first object.

[0018] In another possible implementation, the "relationship" between the first pattern and the first object, or between the vehicle and the first object, includes one or more of the following: distance, relative direction, or relative speed.

[0019] In the above embodiments, "relationship" includes one or more of distance, relative direction, or relative speed, so that the relationship between the vehicle and the surrounding environment can be accurately represented from multiple dimensions by the first pattern and the first mark, thereby enabling the driver to make more accurate judgments to better control the vehicle, enabling the driver to participate in traffic better, and thus reducing the probability of traffic accidents, so as to protect the occupants and other traffic participants outside the vehicle.

[0020] In another possible implementation, the first pattern is projected onto the first object, and the first identifier is also used to identify one or more of the shape, size, speed, or category of the first object.

[0021] In the above embodiments, the projection device projects a first pattern onto the first object. This illuminates the first object or key parts of it, helping the driver better identify the object or alerting them to its presence in the surrounding environment. Furthermore, by projecting the first pattern onto the first object in real time, the projection device can achieve real-time illumination. For example, if a pothole appears in front of a vehicle, the projection device projects a first pattern onto the pothole, with the pattern's shape and size matching the pothole's location. This provides real-time warning to the driver of the pothole, preventing the vehicle from falling into it and causing damage or endangering the lives of passengers. Similarly, if there is a height or width restriction frame in front of a vehicle, projecting a first pattern onto it also assists the driver. However, this method of projecting a first pattern onto the first object typically requires the driver to rely on experience and intuition to further assess the relationship between the vehicle and the object, making a driving decision. For drivers with insufficient experience, this can easily lead to misjudgments and traffic accidents. In view of this, the above embodiments also use a first identifier to identify one or more of the shape, size, speed or category of the first object, so that the driver can directly obtain the relationship between the vehicle and the first object, avoid misjudgment caused by insufficient driver experience, and thus reduce the probability of traffic accidents.

[0022] It is understood that the aforementioned first pattern and first logo can also be used to achieve other functions, such as interaction with other traffic participants or entertainment functions, and this application does not limit them.

[0023] In another possible implementation, the vehicle's environment also includes a second object, and the first identifier is also used to identify the relationship between the first object and the second object, or the relationship between the first pattern and the second object. The second object includes one or more of a pedestrian, another vehicle, a traffic sign, a curb, or an obstacle.

[0024] In the above embodiments, the vehicle's environment also includes a second object. The first identifier is also used to identify the relationship between the first object and the second object, or the relationship between the first pattern and the second object, so that the driver can clearly know one or more of the relationships between the first object and the second object, the relationship between the vehicle and the first object, or the relationship between the vehicle and the second object through the first identifier. This allows the driver to obtain more information and make more correct driving operations based on the information, thereby reducing the probability of traffic accidents and protecting the lives and property of traffic participants.

[0025] Optionally, the first pattern described above is also used to indicate that the environment in which the vehicle is located includes the second object described above.

[0026] Optionally, the first identifier also includes a locking box for locking the second object.

[0027] In another possible implementation, the first object includes one or more of the following: pedestrians, other vehicles, traffic signs, curbs, or obstacles.

[0028] It is understandable that the first object can be any object in the vehicle's environment. In addition to the objects listed above, the first object can also be a tunnel entrance, intersection, tree, railing, street light, or green belt, etc.

[0029] Optionally, the first object can also be an object that cannot be directly obtained by the vehicle's sensors, such as an object obtained through navigation data or a V2X system.

[0030] In another possible implementation, the first pattern and the first logo are used to identify vehicle driving information, which includes at least one of navigation information, driver assistance information, and vehicle data.

[0031] In the above embodiments, the vehicle's driving information is presented through the first pattern and the first logo, so that the driving information can be presented more directly, accurately and three-dimensionally in the driver's field of vision, enabling the driver to make necessary driving judgments more quickly, so as to assist the driver to participate in traffic better and improve driving safety.

[0032] Optionally, the navigation information mentioned above can be a series of planar coordinates indicating the vehicle's arrival at the navigation destination. Navigation information can also consist of various navigation instructions, such as turn signs, straight-ahead signs, U-turn signs, or destination information. The driving assistance information mentioned above can be from the vehicle's ADAS (Advanced Driver Assistance Systems). For example, driving assistance information can be driving intentions, such as going straight, changing lanes, turning, or entering an intersection. The driving assistance information mentioned above can also be emergency decisions, such as emergency braking, emergency avoidance, or vehicle malfunction. The driving assistance information mentioned above can also be vehicle driving prediction events, such as the vehicle being in a safe state or a dangerous state. Vehicle data can be key data displayed on the vehicle's instrument panel (fuel consumption, engine speed, temperature, etc.), vehicle speed information, steering wheel angle information, or vehicle attitude data.

[0033] In another possible implementation, the shape of the first pattern is a driving sign, which is used to indicate the driving intention of the vehicle, and the first mark is used to identify distance information related to the driving sign. The driving sign and the distance information depend on the driving information.

[0034] In the above embodiments, the first pattern is a driving sign, which indicates the vehicle's driving intention. The first mark is used to mark distance information related to the driving sign, so that the driver can determine the next driving operation and the timing of the driving operation based on the first pattern and the first mark, thereby assisting the driver to participate in traffic better and improving driving safety.

[0035] In another possible implementation, the width of the first pattern is equal to the width of the vehicle, and the first mark is used to indicate the distance between the boundary of the first pattern and the first object, or the distance between the vehicle and the first object.

[0036] In the above embodiments, the width of the first pattern is equal to the width of the vehicle, which helps the driver and other road users clearly understand the boundaries of the vehicle. When the first sign is used to indicate the distance between the boundary of the first pattern and the first object, it assists the driver in judging whether the vehicle will collide with the first object during subsequent driving, allowing the driver to make correct driving maneuvers. When the first sign is used to indicate the distance between the vehicle and the first object, it allows the driver to clearly understand the distance between the vehicle and the first object, allowing the driver to make reasonable driving maneuvers.

[0037] Optionally, the first mark is used to indicate the distance between the left / right boundary of the first pattern and the first object, or the first mark is used to indicate the distance between the two sides of the vehicle and the first object.

[0038] In another possible implementation, the length of the first pattern is equal to the distance between the vehicle and the first object, and the first mark is used to indicate the distance between the first pattern and the first object, or the distance between the vehicle and the first object.

[0039] In the above embodiments, the length of the first pattern is equal to the distance between the vehicle and the first object, and the first mark is used to mark the distance between the first pattern and the first object, or the distance between the vehicle and the first object, so that the driver can clearly understand the distance between the vehicle and the first object, so that the driver can make reasonable driving operations.

[0040] Optionally, the first mark is used to indicate the distance between the front of the vehicle and the first object.

[0041] In another possible implementation, the above implementation method further includes: acquiring third environmental information of the vehicle, controlling the HUD device to display a second identifier based on the third environmental information, the second identifier being used to identify the relationship between the vehicle and a third object in the environment where the vehicle is located, controlling the projection device to project a second pattern in the environment where the vehicle is located based on the second identifier, the second pattern being used to indicate the third object, or controlling the projection device to flash at a first frequency based on the second identifier to prompt the third object.

[0042] In the above embodiments, under the premise that the projection device projects a first pattern and the HUD device displays a first identifier, third environmental information is also acquired. Based on the third environmental information, the HUD device is controlled to display a second identifier, and then the projection device is controlled to project a second pattern based on the second identifier. This allows the pattern projected by the projection device to be determined based on the second identifier displayed on the HUD device, enabling the projection device to cooperate with the HUD device to project the required pattern, thereby assisting the driver in driving the vehicle. For example, if another vehicle may collide with the vehicle, the identifier projected by the HUD device serves as a warning to the driver of the collision risk. The driver can then control the projection device to project a specified pattern based on the identifier projected by the HUD device. For example, the projection device can be controlled to flash at a first frequency to warn other vehicles of the collision risk. Another example is controlling the projection device to project a second pattern to illuminate a third object, thereby alerting the driver.

[0043] Optionally, the first frequency can be 10 times / minute or 20 times / minute.

[0044] In another possible implementation, the above implementation method further includes: controlling the projection device to project a third pattern in the environment where the vehicle is located based on the first mark, the third pattern being used to indicate the first object; or, controlling the projection device to flash at a second frequency based on the first mark to prompt the first object.

[0045] In the above embodiments, by controlling the projection device to project a third pattern in the vehicle's environment based on the first identifier to indicate or prompt the first object, the effect of controlling the projection device through the first identifier can be achieved, thereby allowing the projection device to project the required pattern, which in turn works with the HUD device to better assist the driver in participating in traffic, or to meet the interaction needs between the vehicle and other vehicles.

[0046] Optionally, the second frequency can be 10 times / minute or 20 times / minute.

[0047] In another possible implementation, the above method further includes: controlling the projection device to project a fourth pattern into the vehicle's environment based on the first environmental information, the fourth pattern being consistent with the shape of the road segment the vehicle is about to travel on. Controlling the HUD device to display a third identifier based on the first environmental information, the third identifier being used to identify the name of the road segment to be traveled on, and / or the destination corresponding to the road segment.

[0048] In the above embodiments, by projecting a pattern that matches the shape of the road segment to be driven onto the road segment to be driven, and then displaying the name of the road segment to be driven and / or the destination corresponding to the road segment to be driven on with the HUD device, the driver can easily and accurately obtain the vehicle's next driving segment and corresponding destination through the content projected by the projection device and the HUD device, thereby assisting the driver to better participate in traffic and improve driving safety.

[0049] In another possible implementation, the environment in which the vehicle is located includes the ground in front of the vehicle, obstacles, green belts, curbs, tunnel entrances, height restriction frames, or one or more of other objects.

[0050] In another possible implementation, the vehicle also includes headlights, on which the projection device is deployed.

[0051] Secondly, embodiments of this application provide a projection control method, including: acquiring fourth environmental information of a vehicle; controlling a HUD device to display a fourth identifier based on the fourth environmental information; and controlling a projection device to project a fifth pattern in the environment where the vehicle is located based on the fourth identifier. The vehicle includes a projection device and a HUD device. The fourth identifier is used to identify the relationship between the vehicle and a fourth object, and the fifth pattern is used to indicate the fourth object, or flashes at a third frequency to prompt the fourth object.

[0052] Optionally, the third frequency can be 10 times / minute or 20 times / minute.

[0053] In one possible implementation, the fourth identifier includes a locking frame for locking the first object.

[0054] In another possible implementation, the relationship between the fifth pattern and the fourth object, or the relationship between the vehicle and the fourth object, includes one or more of the following: distance, relative direction, or relative speed.

[0055] In another possible implementation, the fifth pattern is projected onto the fourth object, and the fourth identifier is also used to identify one or more of the shape, size, speed, or category of the fourth object.

[0056] In another possible implementation, the fourth object includes one or more of the following: pedestrians, other vehicles, traffic signs, curbs, or obstacles.

[0057] In another possible implementation, the vehicle also includes headlights, on which the projection device is deployed.

[0058] Thirdly, embodiments of this application provide a projection system, including an acquisition unit, a control unit, a projection device, and a HUD device. The acquisition unit acquires first environmental information about the vehicle. The control unit controls the projection device to project a first pattern onto the vehicle's environment based on the first environmental information, and controls the HUD device to display a first identifier based on the first environmental information. The first pattern indicates the presence of a first object in the vehicle's environment, and the first identifier identifies the relationship between the first pattern and the first object, or the relationship between the vehicle and the first object.

[0059] In one possible implementation, after the projection device projects a first pattern into the vehicle's environment, the acquisition unit is further configured to acquire the first pattern. The control unit is also configured to control the HUD device to display a first logo based on the first pattern and first environmental information.

[0060] In another possible implementation, after the projection device projects the first pattern into the vehicle's environment, the acquisition unit is further configured to acquire the first pattern and second environmental information about the vehicle. The control unit is also configured to control the HUD device to display a first logo based on the first pattern and the second environmental information.

[0061] In another possible implementation, the first identifier includes a locking frame for locking the first object.

[0062] In another possible implementation, the "relationship" between the first pattern and the first object, or between the vehicle and the first object, includes one or more of the following: distance, relative direction, or relative speed.

[0063] In another possible implementation, the first pattern is projected onto the first object, and the first identifier is also used to identify one or more of the shape, size, speed, or category of the first object.

[0064] In another possible implementation, the vehicle's environment also includes a second object, and the first identifier is also used to identify the relationship between the first object and the second object, or the relationship between the first pattern and the second object. The second object includes one or more of a pedestrian, another vehicle, a traffic sign, a curb, or an obstacle.

[0065] In another possible implementation, the first object includes one or more of the following: pedestrians, other vehicles, traffic signs, curbs, or obstacles.

[0066] In another possible implementation, the first pattern and the first logo are used to identify vehicle driving information, which includes at least one of navigation information, driver assistance information, and vehicle data.

[0067] In another possible implementation, the shape of the first pattern is a driving sign, which is used to indicate the driving intention of the vehicle, and the first mark is used to identify distance information related to the driving sign. The driving sign and the distance information depend on the driving information.

[0068] In another possible implementation, the width of the first pattern is equal to the width of the vehicle, and the first mark is used to indicate the distance between the boundary of the first pattern and the first object, or the distance between the vehicle and the first object.

[0069] In another possible implementation, the length of the first pattern is equal to the distance between the vehicle and the first object, and the first mark is used to indicate the distance between the first pattern and the first object, or the distance between the vehicle and the first object.

[0070] In another possible implementation, the acquisition unit is further configured to acquire third environmental information about the vehicle, and the control unit is further configured to control the HUD device to display a second identifier based on the third environmental information. The control unit is also configured to control the projection device to project a second pattern into the vehicle's environment based on the second identifier, or to control the projection device to flash at a first frequency to indicate a third object. The second identifier is used to identify the relationship between the vehicle and a third object in the vehicle's environment, and the second pattern is used to indicate the third object.

[0071] In another possible implementation, the control unit is further configured to control the projection device to project a third pattern in the vehicle's environment based on the first identifier, or to control the projection device to flash at a second frequency based on the first identifier to indicate the first object. The third pattern is used to indicate the first object.

[0072] In another possible implementation, the control unit is further configured to control the projection device to project a fourth pattern into the vehicle's environment based on the first environmental information, and then control the HUD device to display a third identifier based on the first environmental information. The fourth pattern corresponds to the shape of the road segment the vehicle is about to travel on, and the third identifier identifies the name of the road segment and / or the destination corresponding to the road segment.

[0073] In another possible implementation, the projection device described above is deployed in the vehicle's headlights.

[0074] Fourthly, embodiments of this application provide a projection system, including an acquisition unit, a control unit, a projection device, and a HUD device. The acquisition unit acquires fourth environmental information about the vehicle. The control unit controls the HUD device to display a fourth identifier based on the fourth environmental information. Then, based on the fourth identifier and the fourth environmental information, the control unit controls the projection device to project a fifth pattern into the vehicle's environment, or controls the projection device to flash at a third frequency to indicate a fourth object. The fourth identifier identifies the relationship between the fifth pattern and the fourth object, or the relationship between the vehicle and the fifth object, while the fifth pattern indicates the fourth object.

[0075] In one possible implementation, the fourth identifier includes a locking frame for locking the first object.

[0076] In another possible implementation, the relationship between the fifth pattern and the fourth object, or the relationship between the vehicle and the fourth object, includes one or more of the following: distance, relative direction, or relative speed.

[0077] In another possible implementation, the fifth pattern is projected onto the fourth object, and the fourth identifier is also used to identify one or more of the shape, size, speed, or category of the fourth object.

[0078] In another possible implementation, the fourth object includes one or more of the following: pedestrians, other vehicles, traffic signs, curbs, or obstacles.

[0079] In another possible implementation, the projection device described above is deployed in the vehicle's headlights.

[0080] Fifthly, embodiments of this application also provide a terminal device, which includes the projection system described in any one of the third or fourth aspects above.

[0081] Sixthly, embodiments of this application also provide a vehicle, which includes the projection system described in any one of the third or fourth aspects above, or the terminal device described in the fifth aspect.

[0082] In a seventh aspect, a program is provided that, when executed by a processor, performs the method provided by any one of the first or second aspects described above.

[0083] Eighthly, a program product, such as a computer-readable storage medium, is provided, comprising the program of any one of the first or second aspects described above.

[0084] Ninth aspect, a computer-readable storage medium is provided, including a program, which, when run by a processor, performs the method provided in either the first or second aspect.

[0085] In a tenth aspect, embodiments of this application provide a chip including a processor, the processor being configured to execute instructions, which, when executed, cause the chip to perform the collision risk determination method described in either the first or second aspect above.

[0086] The beneficial effects of some solutions in aspects three through ten of this application can be referenced to the beneficial effects of the technical solution in aspect one. Attached Figure Description

[0087] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments of this application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0088] Figure 1This is a functional block diagram of one embodiment of the vehicle provided in this application;

[0089] Figure 2 A schematic diagram illustrating the functional division of a projection control system provided in an embodiment of this application;

[0090] Figure 3 A schematic flowchart of a projection control method provided in an embodiment of this application;

[0091] Figures 4A to 4C A schematic diagram illustrating a first scenario provided in an embodiment of this application;

[0092] Figure 5 A schematic diagram illustrating a second scenario provided in an embodiment of this application;

[0093] Figure 6 A schematic diagram illustrating a third scenario provided in an embodiment of this application;

[0094] Figures 7A to 7B A schematic diagram illustrating the fourth scenario provided in the embodiments of this application;

[0095] Figures 8A to 8C A schematic diagram illustrating the fifth scenario provided in the embodiments of this application;

[0096] Figure 9 A schematic diagram illustrating the sixth scenario provided in the embodiments of this application;

[0097] Figures 10A to 10C A schematic diagram illustrating the seventh scenario provided in the embodiments of this application;

[0098] Figures 11A to 11C A schematic diagram illustrating the eighth scenario provided in the embodiments of this application;

[0099] Figures 12A to 12B A schematic diagram of the ninth scenario provided in the embodiments of this application;

[0100] Figures 13A to 13B A schematic diagram illustrating the tenth scenario provided in this application embodiment;

[0101] Figures 14A to 14B A schematic diagram of the eleventh scenario provided in the embodiments of this application;

[0102] Figures 15A to 15B A schematic diagram of the twelfth scenario provided in the embodiments of this application;

[0103] Figures 16A to 16B A schematic diagram of the thirteenth scenario provided in the embodiments of this application;

[0104] Figure 17 A schematic flowchart illustrating another projection control method provided in an embodiment of this application;

[0105] Figure 18 A schematic flowchart illustrating another projection control method provided in an embodiment of this application;

[0106] Figures 19A to 19D A schematic diagram of the fourteenth scenario provided in the embodiments of this application;

[0107] Figures 20A to 20B This is a schematic diagram of the fifteenth scenario provided in the embodiments of this application. Detailed Implementation

[0108] The embodiments described in this application are merely some, not all, of the embodiments described herein. Those skilled in the art will recognize that, with technological advancements and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are equally applicable to similar technical problems.

[0109] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. In this application, "at least one" means one or more, and "more than one" means two or more. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0110] First, the vehicle used in this application will be described; see [link to relevant documentation]. Figure 1 As shown, where, Figure 1 This is a functional block diagram of one embodiment of the vehicle provided in this application. It should be noted that the vehicle 100 can be set to a fully intelligent driving mode or a partially intelligent driving mode. Understandably, when the vehicle 100 is set to a fully intelligent driving mode, the vehicle 100 can perform corresponding operations without human interaction, including but not limited to acceleration, deceleration, and following. When the vehicle 100 is set to a partially intelligent driving mode, the vehicle 100 can not only automatically perform corresponding operations, but also be operated by the driver. For example, determining the vehicle and its surrounding environment, determining the possible behaviors of at least one other vehicle in the surrounding environment, determining the confidence level corresponding to the probability of the other vehicle performing the possible behavior, and then controlling the vehicle 100 based on the determined information.

[0111] Vehicle 100 may include various subsystems, such as an advanced driving assistance system (ADAS) 110, a sensing system 120, one or more peripheral devices 130, a computer system 140, a projection device 150, and a head-up display (HUD) device 160. Optionally, vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and component of vehicle 100 can be interconnected in various ways, for example, via wired or wireless means.

[0112] ADAS110 is used in vehicle 100 to sense the surrounding environment, collect data, identify, detect, and track static and dynamic objects during driving, and combine this data with navigation map data for system calculation and analysis. This allows the driver to anticipate potential dangers, increasing driving comfort and safety. For example, ADAS110 can control the vehicle using data acquired by sensor system 120. Alternatively, ADAS110 can control the vehicle using in-vehicle data, which may include key data from the vehicle's instrument panel (fuel consumption, engine speed, temperature, etc.), vehicle speed information, steering wheel angle information, or vehicle attitude data.

[0113] The ADAS110 can control the vehicle in one or more of the following ways:

[0114] ADAS 110 adjusts the forward direction of vehicle 100. ADAS 110 controls the operating speed of the vehicle's engine and thus the speed of vehicle 100. ADAS 110 operates on images captured by camera 125 to identify objects and / or features in the environment surrounding vehicle 100. In some embodiments, ADAS 110 may be used to map the environment, track objects, estimate the speed of objects, etc. ADAS 110 determines the driving route of vehicle 100, and in some embodiments, ADAS 110 may combine one or more predetermined map data from sensor system 120 to determine the driving route for vehicle 100. ADAS 110 may identify, assess, and avoid or otherwise traverse potential obstacles in the environment of vehicle 100.

[0115] The sensing system 120 may include several sensors for sensing information about the environment surrounding the vehicle 100. For example, the sensing system 120 may include a positioning system 121 (which may be a Global Positioning System (GPS) system, a BeiDou system, or another positioning system), an inertial measurement unit (IMU) 122, a radar 123, a laser rangefinder 124, and a camera 125. The sensing system 120 may also include sensors from systems inside the vehicle 100 (e.g., an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, orientation, speed, etc.), which is a key function for the safe operation of the autonomous vehicle 100. The positioning system 121 can be used to estimate the geographical location of the vehicle 100. The IMU 122 is used to sense changes in the position and orientation of the vehicle 100 based on inertial acceleration. In one embodiment, IMU 122 may be a combination of an accelerometer and a gyroscope, in which case IMU 122 can be used to measure the curvature of vehicle 100. Radar 123 may use radio signals to sense the surrounding environment of vehicle 100, which includes, but is not limited to, surrounding vehicles, infrastructure, and pedestrians. In some embodiments, radar 123 may be used to sense the speed and / or direction of travel of objects in addition to sensing objects. This application does not limit the specific type of radar 123; for example, radar 123 may be millimeter-wave radar or lidar. Laser rangefinder 124 may use lasers to sense objects in the environment in which vehicle 100 is located. In some embodiments, laser rangefinder 124 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components. Camera 125 may be used to capture multiple images of the surrounding environment of vehicle 100. Camera 125 may be a still camera, a video camera, a monocular / binocular camera, or an infrared imager.

[0116] Vehicle 100 interacts with external sensors, other vehicles, other computer systems, or users via peripheral devices 130. Peripheral devices 130 may include a wireless communication system 131, an on-board computer 132, a microphone 133, and / or a speaker 134.

[0117] It should be noted that in some embodiments, the peripheral device 130 provides a means for the user of vehicle 100 to interact with a user interface. For example, the on-board computer 132 can provide information to the user of vehicle 100. The user interface can also operate the on-board computer 132 to receive user input. The on-board computer 132 can be operated via a touchscreen. In other cases, the peripheral device 130 provides a means for vehicle 100 to communicate with other devices located within the vehicle. For example, the microphone 133 can receive audio (e.g., voice commands or other audio input) from the user of vehicle 100. Similarly, the speaker 134 can output audio to the user of vehicle 100.

[0118] The wireless communication system 131 can communicate wirelessly with one or more devices directly or via a communication network. For example, the wireless communication system 131 can use third-generation (3G) cellular communication technologies, such as Code Division Multiple Access (CDMA), Global System for Mobile Communications (GSM), or General Packet Radio Service (GPRS). The wireless communication system 131 can also use fourth-generation (4G) cellular communication technologies, such as Long Term Evolution (LTE). The wireless communication system 131 can also use fifth-generation (5G) cellular communication technologies. The wireless communication system 131 can communicate using a wireless local area network (WLAN). In some embodiments, the wireless communication system 131 can communicate directly with devices using an infrared link, Bluetooth, or ZigBee. The wireless communication system 131 may also utilize various vehicle communication systems. For example, the wireless communication system 131 may include one or more dedicated short-range communications (DSRC) devices, which may include public and / or private data communications between vehicles and / or roadside stations.

[0119] Some or all of the functions of vehicle 100 are controlled by computer system 140. Computer system 140 can control the functions of vehicle 100 based on input received from various systems (e.g., sensor system 120, ADAS 110, peripheral devices 130) and from a user interface. Computer system 140 may include at least one processor 141 that executes instructions stored in a non-transitory computer-readable medium such as memory 142. Computer system 140 may also be multiple computing devices controlling individual components or subsystems of vehicle 100 in a distributed manner.

[0120] This embodiment does not limit the type of processor 141. For example, the processor 141 may be one or more field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), system-on-chips (SoCs), central processing units (CPUs), network processors (NPs), digital signal processing circuits (DSPs), microcontroller units (MCUs), programmable logic devices (PLDs), or other integrated chips, or any combination of the above chips or processors. The processor 141 may be located inside the vehicle, or it may be located remotely from the vehicle and wirelessly communicate with it.

[0121] although Figure 1 The illustrations functionally depict devices such as processors, memory, and computers; however, those skilled in the art will understand that a processor, computer, or memory may actually include multiple processors, computers, or memories that may or may not be housed in the same physical enclosure. For example, memory may be a hard disk drive or other storage media located in an enclosure different from that of a computer. Therefore, references to processors or computers will be understood to include references to a collection of processors or computers or memories that may or may not operate in parallel. Unlike using a single processor to perform the steps described herein, some components, such as steering and deceleration assemblies, may each have their own processor that performs calculations only relevant to the component's specific function.

[0122] In some embodiments, memory 142 may contain instructions (e.g., program logic) that can be executed by processor 141 to perform various functions of vehicle 100. In addition to instructions, memory 142 may also store data such as map data, route information, vehicle position, direction, speed, and other vehicle data. The information stored in memory 142 can be used by vehicle 100 and computer system 140 during operation of vehicle 100 in autonomous, semi-autonomous, and / or manual modes. For example, the current speed of vehicle 100 can be adjusted based on road information of the target road segment and the received target vehicle speed range, thereby enabling vehicle 100 to follow other vehicles at a constant speed.

[0123] Optionally, vehicle 100 may also include one or more of a travel system, a control system, a power supply, or a user interface.

[0124] The propulsion system may include components that power the vehicle 100. In one embodiment, the propulsion system may include an engine, an energy source, a transmission, and wheels / tires. The engine may be an internal combustion engine, an electric motor, an air-compressed engine, or other combinations of engines, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air-compressed engine. The engine converts the energy source into mechanical energy.

[0125] The control system can be used to control the operation of the vehicle 100 and its components. The control system may include multiple elements; in one embodiment, the control system includes a steering system, actuators, a braking unit, a computer vision system, a route control system, an obstacle avoidance system, and a high / low beam switching system.

[0126] Computer vision systems can be used to process and analyze images captured by vision sensors for subsequent operations. They can also identify the surrounding environment of a vehicle 100, the characteristics of objects within that environment, and their motion states. The surrounding environment may include traffic signals, road boundaries, and obstacles. The characteristics of objects within the surrounding environment include, but are not limited to, their surface optical properties, and the motion states include, but are not limited to, being stationary, accelerating, or decelerating. Computer vision systems can utilize color space conversion techniques, object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, the computer vision system includes an image detection system, a neural network-based processing system, etc., and can be used to map the environment, track objects, estimate object speeds, etc.

[0127] The power source can provide power to various components of the vehicle 100. In one embodiment, the power source may include one or more battery packs, wherein the batteries in the battery packs may be rechargeable lithium-ion batteries or lead-acid batteries. It will be understood that in some embodiments, the power source and the energy source may be implemented together.

[0128] The user interface is used to provide information to or receive information from the user of vehicle 100. Optionally, the user interface may include interfaces required by one or more input / output devices in the peripheral devices, such as a universal serial bus (USB) interface, an audio input (auxiliary, AUX) interface, or an on-board diagnostics (OBD) interface.

[0129] The vehicle 100 also includes a projection device 150, which can project a specified pattern into the environment surrounding the vehicle, and can also project a specified pattern onto an object in the environment surrounding the vehicle.

[0130] The vehicle 100 also includes a HUD device 160, which is capable of displaying designated logos.

[0131] Optionally, the projector 150 and the HUD device 160 can be controlled by a single controller, or two controllers can be used to control the projector 150 and the HUD device 160 respectively; this application does not limit this. The projector 150 and the HUD device 160 shown in this embodiment can be applied not only to vehicles, but also to driving vehicles such as ships, airplanes, and helicopters.

[0132] It should be noted that the above-mentioned modules and their components may be added, replaced, or deleted according to actual needs, and this application does not impose any restrictions on this. The above-mentioned vehicle 100 may be a car, truck, motorcycle, bus, ship, recreational vehicle, amusement park vehicle, construction equipment, tram, train, etc., and the embodiments of this application do not limit this.

[0133] Understandable, Figure 1 The structural schematic diagram of the vehicle 100 shown is only an exemplary implementation of the present application. The vehicle in the present application includes, but is not limited to, the above structure.

[0134] This application provides a projection control system for controlling a projection device and a HUD device to project images. The projection control system acquires environmental information about the vehicle's location and then controls the projection device to project a first pattern and the HUD device to display a first identifier based on the acquired environmental information. The first pattern indicates a first object in the vehicle's environment, and the first identifier identifies the relationship between the first pattern and the first object; alternatively, the first identifier identifies the relationship between the vehicle and the first object. The internal units of the projection control system can be divided in various ways, and this application does not limit this division. Figure 2 As an example of a partitioning method, such as Figure 2 As shown below, the functions of each functional unit will be introduced separately.

[0135] The projection control system 200 includes an acquisition unit 210 and a control unit 220. The acquisition unit 210 acquires environmental information about the vehicle, including information about the surrounding environment and / or the environment in which the vehicle is located. The information about the surrounding environment can be obtained through the vehicle's sensors, such as information obtained through the vehicle's ADAS 110. The information about the environment in which the vehicle is located includes environmental information that the vehicle cannot directly perceive through its own sensors, such as map information about the surrounding area or information obtained through a V2X system. Of course, the aforementioned environmental information can also be information obtained through processing, fusion, or inference, such as speed information obtained based on the position information of an object at multiple time points. Furthermore, the aforementioned environmental information can also be information acquired by the sensing system 120 and processed by a computer vision system. The control unit 220 controls the projection device and HUD device to project based on the environmental information acquired by the acquisition unit 210, so that the content projected by the projection device and HUD device can better assist the driver in driving the vehicle in the current scene. Optionally, the control unit may be a processor 141, or a controller composed of a projection device controller and a HUD controller, or a controller capable of controlling the projection device and the HUD device.

[0136] It is understood that the content projected by the projection device and HUD device in this application is intended to better assist drivers in traffic participation and improve driving safety. Regarding how to control the projection device and HUD device to project, the following situations can be considered:

[0137] Scenario 1: Based on the environmental information acquired by the acquisition unit 210, the projection device and HUD device are controlled to project simultaneously.

[0138] Scenario 2: First, based on the environmental information acquired by the acquisition unit 210, control the projection device to project a pattern in the vehicle's environment. Then, acquire the pattern projected by the projection device in the environment through the acquisition unit 210, and control the HUD device to project the target label based on the pattern acquired by the acquisition unit 210.

[0139] Scenario 3: First, based on the environmental information acquired by the acquisition unit 210, control the HUD device to project the target identifier. Then, based on the target identifier, control the projection device to project a pattern in the vehicle's environment.

[0140] Of course, the new solutions obtained by combining the above three situations also fall within the protection scope of this application. For the sake of brevity, they will not be described in detail here. For example, the combination of the above "situation one" and "situation three" is based on the environmental information obtained by the control unit 210, which simultaneously controls the projection device and the HUD device to project, and then controls the projection device to project a new solution based on the target mark projected by the HUD device.

[0141] Next, the control methods for "Scenario 1", "Scenario 2", and "Scenario 3" will be described exemplarily. For "Scenario 1", please refer to... Figure 3 For an introduction, please refer to "Scenario Two". Figure 17 The introduction to "Situation 3" can be referenced. Figure 18 Introduction.

[0142] Please see Figure 3 , Figure 3 This is a flowchart illustrating a projection control method provided in an embodiment of this application. Figure 3 The projection control method shown is "Case 1" as described above. For example... Figure 3 The projection control method shown may include one or more steps S301 to S303B. For example, some solutions may only include steps S301 and S303B. It should be understood that, for ease of description, the method is described in the order of steps S301 to S303B, and is not intended to limit the execution to this order. This application embodiment does not limit the order of execution, the execution time, or the number of executions of the above one or more steps. Steps S301 to S303B are as follows:

[0143] S301, The acquisition unit acquires the first environmental information of the vehicle.

[0144] The relevant description of the acquisition unit can be found in the introduction of acquisition unit 210 above, and will not be repeated here. The first environmental information includes information about the environment surrounding the vehicle, and / or information about the environment in which the vehicle is located. The description of the information about the environment surrounding the vehicle and the environment in which the vehicle is located can also be found in the corresponding descriptions above, and will not be repeated here.

[0145] S302, The acquisition unit sends the first environmental information to the control unit.

[0146] The relevant description of the control unit can be found in the description of control unit 220 above, and will not be repeated here. Regarding the specific method by which the acquisition unit sends the first environmental information to the control unit, it can be via wired communication or wireless communication; this application does not limit this. For example, the acquisition unit can send the first environmental information to the control unit via a controller area network (CAN) bus.

[0147] S303A, the control unit controls the projection device to project the first pattern based on the first environmental information.

[0148] S303B, the control unit controls the HUD device to display the first identifier based on the first environmental information.

[0149] It should be noted that this application does not limit the order in which S303A and S303B are executed. For example, S303A can be executed simultaneously, or in the order of S303A and S303B, or in the order of S303B and S303A. The key point is that the environmental information used by the controller to control the projection device or HUD device is the same.

[0150] In one possible implementation, the aforementioned first pattern is used to indicate the presence of a first object in the vehicle's environment, and the first identifier is used to identify the relationship between the first pattern and the first object, or the first identifier is used to identify the relationship between the vehicle and the first object. The first object can be various objects in the vehicle's environment, and can also be an object composed of one or more objects. For example, the first object can be another vehicle, a pedestrian, an obstacle, a curb, an intersection, a pothole, a green belt, a traffic sign, a height restriction frame, a tunnel entrance, or a road direction, etc. The "relationship" in the aforementioned relationship between the first pattern and the first object, or the relationship between the vehicle and the first object, can refer to a positional relationship, a speed relationship, or an indicative relationship, etc. Positional relationships include distance, relative position, or relative direction, and speed relationships include relative speed, relative acceleration, or relative deceleration, etc.

[0151] In another possible implementation, the projection device projects the first pattern, which can be done by projecting the first pattern into the environment in which the vehicle is located. For example, the projection device can project the first pattern onto one or more of the following objects: the ground in front of the vehicle, obstacles, green belts, curbs, tunnel entrances, height restriction frames, or other vehicles. Examples of the projection device projecting the first pattern can be found in the corresponding descriptions below.

[0152] Optionally, the projection device can be deployed in the vehicle's headlights, or partially deployed in the vehicle's headlights and partially deployed in other locations on the vehicle, or the projection device can be deployed entirely outside the headlights. Of course, the headlights can also be considered as part of the projection device.

[0153] For a detailed description of the first pattern and the first logo mentioned above, please refer to the implementation method shown below.

[0154] Please see Figure 4A ,from Figure 4A The image shows a car directly in front of the driver and another car to the right, as well as pedestrians on the zebra crossing in the distance. Understandably, in poor lighting conditions (e.g., at dusk or night) or when visibility is obstructed, drivers may have difficulty spotting pedestrians on the zebra crossing, increasing the risk of traffic accidents.

[0155] exist Figure 4B In the scene shown, the first pattern includes a pedestrian sign and an arrow, the first marker includes the words "50 meters," and the first object is a pedestrian. From Figure 4B As can be seen from this, the first pattern and the first sign can remind the driver that there are pedestrians 50 meters ahead of the road, thus prompting the driver to drive cautiously and avoid traffic accidents.

[0156] Optionally, the first pattern changes with the relative position of the vehicle and the first object. For example, an arrow moves with the movement of a pedestrian and points to the pedestrian's location. Similarly, a pedestrian sign moves with the movement of the vehicle and is projected at a preset position in front of the vehicle. Likewise, the first marker also changes with the relative position of the vehicle and the first object. For example, the word "50 meters" changes with the distance between the vehicle and the pedestrian. Specifically, if the actual distance between the vehicle and the pedestrian changes to 49 meters, the HUD device will update the word "50 meters" to "49 meters". Furthermore, the wording of the first marker also moves with the movement of an arrow and is displayed at a preset position on the arrow (e.g., the middle of the arrow).

[0157] Optionally, the first sign may refer to the distance between the pedestrian sign and the first object, or the distance between the vehicle and the first object, or the distance between the front of the vehicle and the first object, etc.

[0158] It is evident that the aforementioned first pattern and first symbol enable the driver to accurately understand the relationship between the vehicle and its surroundings (the first object within the surrounding environment), thereby allowing the driver to make more accurate judgments and better control the vehicle. This, in turn, allows the driver to better participate in traffic, reducing the probability of traffic accidents and protecting occupants and other road users outside the vehicle. Of course, the above... Figure 4A and Figure 4BThis is just one example provided in this application. More possible examples will be introduced as the content unfolds, but will not be detailed here.

[0159] Understandably, the first pattern projected by the projection device and the first sign displayed by the HUD device are both within the driver's field of vision, allowing the driver to obtain them without having to look up, turn their head, or nod. This enables the information presented by the first pattern and the first sign to be conveyed to the driver in a timely manner, allowing the driver to react and correctly control the vehicle to participate in traffic, thereby improving driving safety.

[0160] In another possible implementation, the first identifier includes a locking box used to lock the first object.

[0161] Please see Figure 4C , Figure 4C Compared to the above Figure 4B The first identifier shown has a lock box added, i.e. Figure 4C The first sign shown includes the words "50 meters" and a locking frame. (As...) Figure 4C As shown, the locking frame is used to lock onto pedestrians, allowing drivers to better identify pedestrians and their locations. Furthermore, as vehicles and pedestrians move, the pedestrians appear to be constantly moving within the driver's field of vision, and the locking frame will continuously lock onto the first object, enabling the driver to accurately observe the pedestrian and avoid losing track of them. Clearly, the real-time locking of pedestrians by the locking frame also helps drivers better distinguish pedestrians from other objects.

[0162] As can be seen, the locking frame in the first sign is used to lock onto the first object, helping the driver to better identify it. For example, if there is relative motion between the first object and the vehicle, and the first object is also in motion within the driver's field of vision, the locking frame in the first sign helps the driver lock onto the first object, preventing loss of focus. Furthermore, if the driver's field of vision includes multiple objects similar to the first object, the locking frame in the first sign helps the driver better distinguish the first object from the others. Additionally, if the boundaries of the first object are somewhat blurred, the locking frame in the first sign can further help to better identify the boundaries of the first object.

[0163] In another possible implementation, the "relationship" between the first pattern and the first object, or between the vehicle and the first object, includes one or more of the following: distance, relative direction, or relative speed.

[0164] For example, the first identifier can be used to identify the distance, relative direction, or relative speed between the first pattern and the first object; the first identifier can also be used to identify the distance, relative direction, or relative speed between a vehicle and the first object. For example, in Figure 5In the scene shown, the first object includes two vehicles, the first pattern includes two arrows, and the first sign includes the text "Distance: 35 meters, Relative direction: Directly ahead, Relative speed: 10 km / h" and "Relative direction: Right front". Figure 5 As can be seen, the two arrows point to two different vehicles, and two markings are located on the arrows to indicate the relationship between the other vehicle and the vehicle itself. For example, the markings "Distance: 35 meters, Relative direction: Directly ahead, Relative speed: 10 km / h" indicate that the other vehicle is directly in front of the vehicle, the distance between them is 35 meters, and the relative speed is 10 km / h. Another example is the marking "Relative direction: Right front," which indicates that the other vehicle is to the right front of the vehicle, or that there is a vehicle to the right front of the vehicle.

[0165] Optionally, the relative speed in this application can be the relative speed of the vehicle relative to another vehicle, or it can be the relative speed of another vehicle relative to the vehicle itself; this application does not limit this. For example, if the relative speed is the relative speed of the vehicle relative to another vehicle, a relative speed of 10 km / h means that the vehicle is 10 km / h faster than the other vehicle. As another example, if the relative speed is the relative speed of another vehicle relative to the vehicle itself, a relative speed of 10 km / h means that the vehicle is 10 km / h slower than the other vehicle.

[0166] It is evident that when the aforementioned "relationship" includes one or more of the following: distance, relative direction, or relative speed, the first pattern and the first sign can accurately represent the relationship between the vehicle and its surrounding environment from multiple dimensions. This allows the driver to make more accurate judgments and better control the vehicle, enabling the driver to participate more effectively in traffic and thereby reducing the probability of traffic accidents, thus protecting the occupants and other road users outside the vehicle.

[0167] Optionally, the first object, the first pattern, and the first symbol can each be one or more, and this application does not limit this. For example, the above... Figure 4B In the scenario shown, there is one first object, one first pattern, and one first identifier. Figure 5 In the scene shown, there are two objects, two first patterns, and two first logos.

[0168] Furthermore, to better assist drivers in participating in traffic, the first sign may also include prompts or warnings.

[0169] For example, in Figure 6 In the scenario shown, the first object includes the vehicle in front, the first pattern includes an arrow, and the first sign includes the words "The distance between the two vehicles is less than the braking distance." Figure 6As can be seen, the arrow points from the vehicle in front to the vehicle in front. "The distance between the two vehicles is less than the braking distance" means that the distance between the vehicle in front and the vehicle in front is less than the braking distance of the vehicle in front. This is used to remind the driver that a traffic accident is likely to occur under the current conditions, so that the driver can take timely action to avoid a traffic accident.

[0170] In another possible implementation, the first pattern is projected onto the first object, and the first identifier is also used to identify one or more of the first object's shape, size, speed, or category. Here, "the first pattern is projected onto the first object" can mean that the first pattern is projected onto all or part of the surface of the first object. For a more detailed explanation, please refer to the following text. Figures 7A to 7B , Figures 8A to 8C Related descriptions.

[0171] Please see Figure 7A ,from Figure 7A As can be seen, there is a pothole in the road ahead of the vehicle. In poor lighting conditions, potholes are not easily noticed by the driver, or by the time the driver notices the pothole, it is too late to control the vehicle to avoid it effectively, which can easily cause damage to the vehicle or threaten the life and property safety of the passengers.

[0172] exist Figure 7B In the scene shown, the first object includes a pothole-covered road surface, the first pattern includes light spots similar to the edges of the pothole-covered road surface, and the first marker includes the words "25 meters" and a locking frame. From Figure 7B As can be seen, while illuminating the potholes, the locking frame in the first sign also marks the potholes. Combined with the distance indication text in the first sign, this allows drivers to promptly detect potholes in the middle of the road and the distance between the potholes and their own vehicles, giving drivers ample time to take evasive action and thus preventing damage to vehicles from potholes and protecting the lives and property of passengers.

[0173] Optionally, the first identifier is also used to identify the category of the first object. For example, the first identifier may also include the words "pothole road surface" to indicate that the first object is a pothole road surface.

[0174] Alternatively, the first object can also be a mound of earth or a pile of stones.

[0175] Optionally, the first object can also be a movable object, such as an animal or a rolling stone. When the first object is a movable object, the first identifier also indicates the speed of movement of the first object; for example, the first identifier may include the words "5 km / h" to indicate that the speed of movement of the first object is 5 km / h.

[0176] For implementation methods where the first object is a mound of earth, a pile of stones, or a movable object, please refer to the specific implementation where the first object is a "pothole road surface" as described above, which will not be repeated here.

[0177] It is understandable that both the first pattern and the first logo will change as the relative position of the vehicle and the first object changes; for specific examples, please refer to the aforementioned examples. Figure 4A and Figure 4B The relevant information will not be repeated here.

[0178] Please see Figure 8A , Figure 8A The scene shown depicts a vehicle about to enter a tunnel. Figure 8A In the scenario shown, the vehicle can turn on its headlights to illuminate the road ahead, such as... Figure 8B As shown. However, the height or width of some tunnels may not be suitable for vehicle passage, or, in poor lighting conditions, drivers may not be able to detect that a vehicle is about to enter the tunnel in time. In such cases, it is easy for drivers to misjudge and cause traffic accidents.

[0179] In response to the above Figure 8A or Figure 8B As shown in the scenario, the solution provided in this application can achieve the following: Figure 8C The effect shown. Figure 8C In the image, the first object includes a tunnel entrance, the first pattern includes a light spot similar to the edge of the tunnel entrance, and the first sign includes the inscription "Height: 2 meters, Width: 5 meters". From Figure 8C As can be seen, the first pattern can illuminate the tunnel entrance, allowing drivers to clearly observe it. Combined with the text "Height: 2 meters, Width: 5 meters" in the first sign, it enables drivers to judge whether their vehicles can pass through the tunnel, reducing driver misjudgment.

[0180] Optionally, the first sign may also include the words "tunnel accessible" or "tunnel not accessible" to directly inform the driver whether they can continue.

[0181] Optionally, the first object can also be a width-limited frame or a height-limited frame. For implementations where the first object is a width-limited frame or a height-limited frame, please refer to the specific implementation described above where the first object is a "tunnel entrance," which will not be repeated here.

[0182] In combination with the above Figure 7A , Figure 7B , Figure 8A , Figure 8B and Figure 8CAccording to the relevant introduction, combining the first pattern and the first mark projected on the first object allows the driver to directly obtain the relationship between the vehicle and the first object, avoiding misjudgment caused by insufficient driver experience, thereby reducing the probability of traffic accidents.

[0183] In another possible implementation, the vehicle's environment also includes a second object, and the first identifier is also used to identify one or more of the relationships between the first object and the second object, or between the first pattern and the second object, or between the vehicle and the second object.

[0184] Please see Figure 9 , Figure 9 In the scene shown, the first object includes the vehicle in front of the vehicle, the second object includes the vehicle to the right front of the vehicle, the first pattern includes two one-way arrows and one two-way arrow, and the first sign includes the words "Speed: 50 km / h", "Speed: 30 km / h", and "Spacing 20 meters". Combined with... Figure 9 Based on the aforementioned information, we know that "Speed: 50 km / h" indicates the speed of the vehicle in front is 50 km / h, "Speed: 30 km / h" indicates the vehicle to the right front, and "Distance 20 meters" indicates a distance of 20 meters between the vehicle in front and the vehicle to the right front. Therefore, the driver... Figure 9 The first pattern and first symbol shown clearly indicate the relationship between the vehicle and the first object, the relationship between the vehicle and the second object, and the relationship between the first object and the second object, thereby enabling the driver to make correct driving operations based on these relationships. For example, if the speed of the vehicle in front is greater than the speed of the vehicle to the right, and the distance between the vehicle in front and the vehicle to the right is large, the driver can perform an overtaking operation based on this situation.

[0185] Please see Figure 10A , Figure 10A In the scenario shown, the vehicle is traveling on a two-lane road with poor lighting conditions. When an oncoming vehicle approaches, the vehicle's adaptive high beam system (ADB) adjusts its projected pattern based on the vehicle's position and size to avoid interfering with the other vehicle's normal driving. Figure 10B As shown. However, the above Figure 10B The implementation scheme shown can also lead to drivers of other vehicles not being able to accurately perceive their outlines or positions, easily causing traffic accidents. Therefore, the embodiment provided in this application uses a first identifier to identify the relationship between the driver and other vehicles, as well as between other vehicles and their surrounding environment, thereby enabling the driver to accurately identify the outlines and positions of other vehicles and thus assisting the driver in safe driving. Figure 10C In the scene shown, the first pattern is Figure 10C The area of ​​medium brightness (i.e.) Figure 10C (The white area in the image); the first object is the oncoming vehicle; the second object is the area composed of diagonal stripes. It should be noted that... Figures 10A to 10C In the diagram, the area composed of slanted stripes is used to represent roadside green belts, trees, or buildings; the first marking includes the words "0.5 meters," "3 meters," and "5 meters," along with corresponding arrows. For example, "0.5 meters" indicates the distance between an oncoming vehicle and the green belt, "3 meters" indicates the distance between the driver and an oncoming vehicle, and "5 meters" indicates the distance between an oncoming vehicle and the right edge of the road where the driver is located. Thus, after obtaining this information, the driver can clearly know the relative position of their vehicle and oncoming vehicles, as well as the outline of the oncoming vehicles, enabling them to make correct driving maneuvers and ensure driving safety.

[0186] Combination Figure 9 , Figures 10A to 10C The scenario shown illustrates that, as can be understood, the driver can accurately obtain information about the relationship between the vehicle and its surrounding environment, as well as the relationship between the first object and the second object in the surrounding environment, through the first pattern and the first sign. This information enables the driver to make more accurate driving operations, thereby reducing the probability of traffic accidents and protecting the lives and property of traffic participants.

[0187] In another possible implementation, the first pattern and the first logo are used to identify vehicle driving information, which includes at least one of navigation information, driver assistance information, and vehicle data.

[0188] Optionally, the navigation information mentioned above can be a series of planar coordinates indicating the vehicle's arrival at the navigation destination. Navigation information can also consist of various navigation instructions, such as turn signs, straight-ahead signs, U-turn signs, or destination information. The driving assistance information mentioned above can be from the vehicle's ADAS (Advanced Driver Assistance Systems). For example, driving assistance information can be driving intentions, such as going straight, changing lanes, turning, or entering an intersection. The driving assistance information mentioned above can also be emergency decisions, such as emergency braking, emergency avoidance, or vehicle malfunction. The driving assistance information mentioned above can also be vehicle driving prediction events, such as the vehicle being in a safe state or a dangerous state. Vehicle data can be key data displayed on the vehicle's instrument panel (fuel consumption, engine speed, temperature, etc.), vehicle speed information, steering wheel angle information, or vehicle attitude data.

[0189] Understandably, presenting vehicle driving information through the first pattern and the first logo allows the driving information to be presented more directly, accurately, and three-dimensionally in the driver's field of vision, enabling the driver to make necessary driving judgments more quickly, thereby assisting the driver to participate in traffic better and improving driving safety.

[0190] For example, the shape of the first pattern is a road type, which is used to indicate the road that will appear in front of the vehicle, and the first mark is used to identify distance information related to the road in front of the vehicle. The road type and distance information depend on the driving information.

[0191] Please see Figure 11A ,exist Figure 11A In the scenario depicted, the vehicle is on a town street in poor lighting conditions, making it difficult for the driver to detect the upcoming intersection in time. This hinders the driver's ability to make effective driving predictions, leading to misjudgments and increasing the risk of traffic accidents. Therefore, the solution provided in this application projects the type of the upcoming intersection using a projection device and combines this with the content displayed on the HUD device to indicate the intersection's position relative to the vehicle. This allows the driver to make driving predictions, such as slowing down, accelerating, turning, or making a U-turn, thereby reducing driver misjudgments and preventing traffic accidents. Figure 11B As shown, in Figure 11B In the scene shown, the first image is a crossroads, the first object is the crossroads that will appear in front of the vehicle, and the first sign includes the words "100 meters". It is understandable that... Figure 11B The first pattern and first sign shown are used to indicate that there is a crossroads 100 meters ahead of the vehicle. Of course, the first pattern can also be an elevated road, a T-junction, a sharp turn, or a ramp, etc., and this application does not limit it to this.

[0192] For example, the shape of the first pattern is a driving sign, which is used to indicate the driving intention of the vehicle, and the first mark is used to identify distance information associated with the driving sign. The driving sign and the distance information depend on the driving information.

[0193] It is understandable that drivers rely heavily on navigation information when driving on unfamiliar roads. Therefore, drivers frequently need to turn their heads to check the navigation, which can easily distract them and lead to traffic accidents. In view of this, the solution provided in this application can project navigation information, driving assistance information, or vehicle data through a projection device and a HUD device. This allows drivers to obtain navigation information, driving assistance information, or vehicle data without turning their heads, thereby assisting them in performing safer driving operations. Please see [link to application]. Figure 11C ,exist Figure 11CIn the scenario shown, the first image includes a "right turn sign," the first object is the right turn intersection in front of the vehicle, and the first sign includes the words "150 meters." It is understandable that... Figure 11C The first pattern and first sign shown are used to indicate that a right turn is required 150 meters in front of the vehicle, so that the driver can make the correct driving operation based on this information, so as to better participate in traffic and improve driving safety.

[0194] Alternatively, the first symbol may also be a "U-turn sign", "left turn sign" or "straight ahead sign", etc., and this application does not limit it.

[0195] In another possible implementation, the width of the first pattern is equal to the width of the vehicle, and the first identifier is used to indicate the distance between the boundary of the first pattern and the first object, or the distance between the vehicle and the first object. It is understood that the first object can be a dynamic object, such as another vehicle or pedestrian. The first object can also be a static object, such as a bollard, a pothole, or a curb. In the following text, Figure 12A and Figure 12B In the scenario shown, the first object includes dynamic objects. Figure 13A and Figure 13B In the scenario shown, the first object includes static objects.

[0196] Please see Figure 12A ,exist Figure 12A In the scenario depicted, a vehicle is traveling on a town street, with a bicycle on its right front. In situations where the street is narrow or the driver lacks experience, the driver may misjudge the situation, potentially leading to a traffic accident between the vehicle and the bicycle on the right front. Therefore, the solution provided in this application enables the driver to accurately determine the relationship between the vehicle and the bicycle on the right front, allowing the driver to make the correct driving maneuvers.

[0197] For example, please see Figure 12B ,exist Figure 12B In the scene shown, the first pattern includes Figure 12B The beam of light shown on the left includes a vehicle riding on the roadside as its first object, and the first marker includes the words "2 meters" and its corresponding double-headed arrow. It is evident that... Figure 12B The first pattern and first symbol shown are used to identify the bicycle being ridden, with a spacing of 2 meters between the first pattern and the bicycle. Optionally, Figure 12B The beam of light on the left could be the vehicle's marker line, i.e. Figure 12B The beam of light on the left is an extension of the left boundary of the bicycle. Therefore, the first pattern also indicates that the distance between the bicycle and the cyclist is 2 meters. In summary, it can be seen that the driver can accurately know, based on the first pattern and the first sign, that the distance between the cyclist and the bicycle is 2 meters, and can pass safely. Of course, the above... Figure 12B The beam on the left can also be used to alert cyclists to oncoming traffic and the approximate distance between them and oncoming traffic. This also helps other road users participate in traffic better and improves driving safety.

[0198] Optionally, the first pattern may also include Figure 12B The beam of light shown on the right also includes a curb as the first object, and the first marker includes the words "1 meter" and its corresponding double-headed arrow. It is evident that... Figure 12B The first pattern and first symbol shown also indicate that the distance between the curb and the first pattern is 1 meter. Of course, Figure 12B The beam of light on the right could be the vehicle's marker line, i.e. Figure 12B The line on the right is an extension of the right boundary of the vehicle. Therefore, the first pattern also indicates that the distance between the vehicle and the curb is 1 meter. In summary, it can be seen that the driver can accurately know, based on the first pattern and the first sign, that the distance between the vehicle and the curb is 1 meter, and can pass safely.

[0199] Optionally, the first object can also be a pedestrian or another vehicle; this application does not limit this.

[0200] The above Figure 12B In the scenario shown, the vehicle has a wide enough distance between itself and objects in its environment (e.g., a cyclist or a curb) to allow the driver to pass safely. However, in some scenarios, the distance between the vehicle and objects in its environment may be too narrow to allow normal passage. In such cases, the driver may need to take appropriate driving actions (e.g., braking or steering) to avoid a traffic accident.

[0201] Please see Figure 13A ,exist Figure 13A In the scenario depicted, the road in front of the vehicle contains two obstacles, making it difficult for the driver to accurately determine whether the vehicle can pass normally. This may require the driver to get out of the vehicle to observe, impacting traffic efficiency. Therefore, the solution provided in this application allows the driver to accurately understand the relationship between the vehicle and the obstacles ahead, enabling the driver to make correct driving maneuvers.

[0202] For example, please see Figure 13B ,exist Figure 13BIn the illustrated scenario, the first pattern includes two beams of light, the first object includes obstacles located on either side of the road, and the first marking includes the letters "30cm" and "20cm". It can be understood that the "30cm" marking indicates the distance between the obstacle on the left and the beam of light on the left, and the "20cm" marking indicates the distance between the obstacle on the right and the beam of light on the right. Optionally, the two beams of light included in the first pattern can also be the vehicle's marker lines, in which case the "30cm" and "20cm" markings also indicate the distances between the two obstacles and the sides of the vehicle, respectively. Therefore, the first pattern and the first marking allow the driver to clearly see whether the vehicle can pass the obstacle ahead, and also assist the driver in passing the obstacle.

[0203] In another possible implementation, the length of the first pattern is equal to the distance between the vehicle and the first object, and the first identifier is used to identify the distance between the first pattern and the first object, or the distance between the vehicle and the first object.

[0204] Please see Figure 14A ,exist Figure 14A In the scenario shown, there is another vehicle traveling in front of the vehicle in its lane. If the distance between the vehicle and the vehicle in front is too close, a traffic accident is likely to occur. Therefore, the solution provided in this application achieves the following effect: Figure 14B As shown, this allows the driver to accurately understand the relationship between their vehicle and the first object, thus enabling the driver to make accurate driving judgments. Figure 14B In the scene shown, the first pattern includes Figure 14B The light carpet shown in the image, with the first object being the vehicle in front, and the first marking including the words "20 meters." (Combined with...) Figure 14B The first pattern and first sign shown can make drivers clearly understand the distance between their vehicle and the vehicle in front, thereby avoiding traffic accidents.

[0205] Optionally, when the distance between the vehicle and the vehicle in front is too close, the first sign may also include the words "Warning!!! The distance between the two vehicles is less than the braking distance" to clearly inform the driver that a traffic accident is likely to occur in this situation, so that the driver can take relevant driving actions to avoid a traffic accident.

[0206] In another possible implementation, the first pattern corresponds to the shape of the road segment where the vehicle is waiting to travel, and the first identifier is used to identify the name of the road segment and / or the destination corresponding to the road segment. Here, the road segment can be understood as the road segment ahead of the vehicle.

[0207] Please see Figure 15A ,exist Figure 15AIn the scenario shown, the vehicle is traveling at a bend in the road. To help the driver clearly see the road ahead and its name, a projection device can project a pattern matching the road's shape onto the road, and this pattern can be combined with a HUD (Head-Up Display) to display the road's name, such as "XXX Avenue." Figure 15B As shown. It is understandable that, in Figure 15B In the first pattern, there is a pattern that is the same as the shape of the road, the first object is the road in front of the vehicle, and the first sign is the words "XXX Avenue".

[0208] Please see Figure 16A ,exist Figure 16A In the scenario shown, a vehicle is approaching a ramp, and the two roads on the ramp lead to different destinations. To help the driver clearly understand which ramp to enter, a projection device can project a pattern matching the road shape onto the road, and a HUD device can be used to display the corresponding destination, such as "To XXX". Figure 16B As shown. It is understandable that, in Figure 16B In the first pattern, there is a pattern that is the same as the shape of a road, the first object is the destination corresponding to the road, and the first sign is the words "To XXX".

[0209] It is understood that the scenarios provided above and the display effects of the first pattern and the first logo are exemplary and should not be taken as limitations of this application.

[0210] Optionally, the various implementations shown above can be combined with each other, and this application is not limited thereto. For example, Figure 4C The first identifier includes a lock box. Figure 12B In the scenario shown, the first identifier may also include a locking frame for locking the riding vehicle. It is understood that the embodiments provided in this application are diverse and cannot be exhaustively described. Therefore, any implementation meeting the above conditions, or simple variations thereof, falls within the protection scope of this application.

[0211] Please see Figure 17 , Figure 17 This is a schematic flowchart illustrating another projection control method provided in an embodiment of this application. Figure 17 The projection control method shown is "Case Two" as described above. For example... Figure 17The projection control method shown may include one or more steps S1701 to S1706. For example, some solutions may only include steps S1701 and S1706. It should be understood that, for ease of description, the steps S1701 to S1706 are described in this way, and it is not intended to limit the execution to the above order. This application embodiment does not limit the order of execution, the execution time, or the number of executions of one or more of the above steps. Steps S1701 to S1706 are as follows:

[0212] S1701, The acquisition unit acquires the first environmental information of the vehicle.

[0213] S1702, The acquisition unit sends the first environmental information to the control unit.

[0214] S1703, The control unit controls the projection device to project the first pattern based on the first environmental information. A detailed description of the first pattern can be found in the implementation method described above, and will not be repeated here. For example, Figure 4B The pedestrian signs and arrows shown, for example, Figure 7B The light spot shown resembles the edge of a pothole.

[0215] For the specific implementations of S1701, S1702 and S1703, please refer to the relevant introductions of S301, S302 and S303A mentioned above, which will not be repeated here.

[0216] S1704. The acquisition unit acquires the first pattern. Exemplarily, the acquisition unit can acquire the first pattern by taking a picture and then performing image analysis. This application does not limit the specific implementation of acquiring the first pattern.

[0217] Optionally, the obtained first pattern includes one or more of the following: the size of the first pattern, the shape of the first pattern, or the position of the first pattern.

[0218] Optionally, the acquisition unit acquires the second environmental information simultaneously with the first pattern. It is understood that the vehicle's environment is constantly changing, and there is a gap between the acquisition unit acquiring the first environmental information and acquiring the first pattern. Therefore, when the vehicle acquires the first pattern, its environment may have already changed.

[0219] S1705. The acquisition unit sends the first pattern to the control unit. The specific method by which the acquisition unit sends the first pattern to the control unit can be either wired or wireless communication; this application does not limit this. For example, the acquisition unit can send the first pattern to the control unit via CAN.

[0220] S1706, The control unit controls the HUD device to display a first identifier based on the first pattern. A detailed description of the first identifier can be found in the implementation method described above, and will not be repeated here. For example, Figure 4B The phrase "50 meters" in the text, for example, Figure 4C The lock box shown.

[0221] Optionally, the control unit controls the HUD device to display the first identifier based on the first pattern and the aforementioned first environmental information. That is, the control unit comprehensively considers the first pattern and the first environmental information to control the HUD device to display the first identifier, so that the first identifier can better match the first pattern, thereby conveying more accurate information to the driver, helping the driver to participate in traffic better and improving driving safety.

[0222] Optionally, the control unit controls the HUD device to display the first logo based on the first pattern and the aforementioned second environmental information. It is understood that the second environmental information is acquired simultaneously with the first pattern. Therefore, controlling the HUD device to display the first logo based on the second environmental information and the first pattern allows the first logo to better match the first pattern, conveying more accurate information to the driver, thereby helping the driver participate better in traffic and improving driving safety.

[0223] In combination with the above Figure 17 From the introduction, it can be seen that Figure 17 The proposed solution requires acquiring the first pattern projected by the projection device, and then controlling the HUD device to display a first sign based on the first pattern. This allows the first sign to better match the first pattern, thereby enabling the first pattern and first sign to better assist the driver in traffic and improve driving safety. For possible implementations of the first pattern, first sign, and first object, please refer to the above. Figures 4A to 4C , Figure 5 , Figure 6 , Figure 7A , Figure 7B , Figures 8A to 8C , Figure 9 , Figures 10A to 10C , Figures 11A to 11C , Figure 12A , Figure 12B , Figure 13A , Figure 13B , Figure 14A , Figure 14B , Figure 15A , Figure 15B , Figure 16A or Figure 16B This refers to one or more of the following. Of course, in some possible scenarios, the first identifier may also be used to identify a second object, as mentioned above. Figure 9 As shown, in this scenario, Figure 17 The solution shown is also applicable.

[0224] Please see Figure 18 , Figure 18 This is a flowchart illustrating a projection control method provided in an embodiment of this application. Figure 18 The projection control method shown is "Case 1" as described above. For example... Figure 18 The projection control method shown may include one or more steps S1801 to S1804. For example, some solutions may only include steps S1801 and S1804. It should be understood that, for ease of description, the steps S1801 to S1804 are described in this way, and it is not intended to limit the execution to the above order. This application embodiment does not limit the order of execution, the execution time, or the number of executions of the above one or more steps. Steps S1801 to S1804 are as follows:

[0225] S1801, the acquisition unit acquires the vehicle's third environmental information. The description of the third environmental information can be found in the previous step S301 regarding the first environmental information; it will not be repeated here.

[0226] S1802, The acquisition unit sends third environmental information to the control unit.

[0227] S1803, The control unit controls the HUD device to display a second identifier based on the first environmental information. Optionally, the second identifier is used to identify the first object.

[0228] For the specific implementations of S1801, S1802 and S1803, please refer to the relevant introductions of S301, S302 and S303B mentioned above, which will not be repeated here.

[0229] S1804. The control unit controls the projection device to project a second pattern based on the second identifier. Optionally, the second pattern is used to indicate the first object, or to flash at a target frequency to prompt the first object. The target frequency can be 10 times / minute or 20 times / minute, and this application does not limit it.

[0230] It is understandable that the information required for driver assistance will vary depending on the scenario and the driver's experience. In some scenarios, a driver may only need the second signage displayed on the HUD device or the second pattern projected by the projection device to effectively participate in traffic. In other scenarios, a driver needs to combine both the second signage and the second pattern to participate effectively. Therefore, the above... Figure 18 The projection control method shown can fully take into account the driver's driving needs and driving experience, so as to assist the driver to participate in traffic better and improve driving safety.

[0231] Next, referring to the attached diagram, Figure 18 The projection control method shown is described exemplarily.

[0232] Please see Figure 19A ,exist Figure 19A In the scenario depicted, other vehicles are traveling to the right front of the vehicle, and the ambient lighting is poor, making it easy for the driver to overlook obstacles or other road users, potentially leading to traffic accidents. However, the vehicle's acquisition unit can use various sensors such as cameras, millimeter-wave radar, or lidar to promptly detect obstacles and other road users in the vehicle's environment and alert the driver via a HUD (Head-Up Display). Figure 19B As shown, the HUD device displays a second indicator to remind the driver that there are other objects at the location indicated by the second indicator, so as to remind the driver to drive carefully.

[0233] Obviously, in Figure 19B In the scenario shown, the driver still cannot observe the other objects indicated by the second sign. To allow the driver to better observe these other objects, the projection device can be controlled to project a second pattern onto the location indicated by the second sign, thus facilitating the driver's observation of the other objects. Figure 19C As shown.

[0234] For example, the driver's instructions can be received in such a way as to control the projection device to project the second pattern onto the location indicated by the second sign.

[0235] Method 1: The camera in the cockpit identifies whether the driver stares at the second sign for a longer than a preset value. When the driver stares at the second sign for a longer than the preset value, the projection device is controlled to project the second pattern. The preset value can be 1s, 2s, or 3s, etc., and this application does not limit it.

[0236] Method 2: The camera in the cockpit identifies whether the driver is in a preset pose. When the preset pose is detected, the projection device is controlled to project a second image. The preset pose can be an OK sign, a 'V' sign, or a heart sign, etc. This application does not limit this.

[0237] Method 3: Obtain the driver's confirmation to project the second image through the human-machine interface, and then control the projection device to project the second image. For example, the driver can control the projection device to project the second image by clicking a control on the vehicle screen or a physical button in the cabin.

[0238] Optionally, the second sign may also include the words "Moving object, dimensions: 5 meters × 2 meters × 1.8 meters," such as... Figure 19DAs shown. It is understandable that the phrase "moving object, dimensions: 5 meters × 2 meters × 1.8 meters" indicates that the other object indicated by the second sign is a moving object with dimensions of 5 meters × 2 meters × 1.8 meters. Clearly, by identifying the type, size, and other attributes of other objects, drivers can better understand their characteristics, thus assisting them in better participating in traffic and improving driving safety.

[0239] Optionally, in Figure 18 The projection control method shown can be described above, where the second pattern and the second identifier can be... Figures 4A to 4C , Figure 5 , Figure 6 , Figure 7A , Figure 7B , Figures 8A to 8C , Figure 9 , Figures 10A to 10C , Figures 11A to 11C , Figure 12A , Figure 12B , Figure 13A , Figure 13B , Figure 14A , Figure 14B , Figure 15A , Figure 15B , Figure 16A or Figure 16B The first pattern and first symbol described in one or more of them.

[0240] The above Figure 18 The projection control method shown introduces a method requiring driver intervention, allowing the driver to decide whether to project a second pattern based on a second marker, thus better meeting the driving needs of various drivers. Similarly, Figure 17 The projection control method shown also allows the driver to decide whether to display a second logo based on a second pattern, thereby better meeting the driver's driving needs. For example, please continue to see... Figure 7A When the vehicle's acquisition unit detects potholes in front of the vehicle, it controls the projection device to project images onto the potholes. Figure 7B In the case of the pattern shown, the driver can choose whether to display the HUD device as needed. Figure 7B The first indicator is shown in the diagram. For example, if the driver cannot accurately identify potholes under the illumination of the projection device, the driver can control the HUD device to display the first indicator to assist the driver in better observing the road conditions. Conversely, if the driver can accurately identify potholes under the illumination of the projection device, the driver can control the HUD device not to display the first indicator.

[0241] For example, the driver's instruction can be received in the following manner to control the projection device to display the first sign.

[0242] Method 1: The camera in the cockpit identifies whether the driver stares at the first pattern for a longer than a preset value. When the driver stares at the first pattern for a longer than the preset value, the HUD device is controlled to display the first indicator. The preset value can be 1 second, 2 seconds, or 3 seconds, etc., and this application does not limit it.

[0243] Method 2: The camera in the cockpit identifies whether the driver is in a preset posture. When the preset posture is detected, the HUD device is controlled to display the first icon. The preset posture can be an OK gesture, a 'V' gesture, or a heart gesture, etc. This application does not limit this.

[0244] Method 3: Obtain the driver's confirmation to display the first identifier through the human-machine interface, and then control the HUD device to display the first identifier. For example, the driver can control the HUD device to display the first identifier by clicking a control on the vehicle's infotainment screen or a physical button in the cabin.

[0245] It is understood that the HUD device can also be controlled to display the first logo in other ways, or the projection device can be controlled to project the second pattern. This application does not limit this. For example, the HUD device can be controlled to display the first logo by voice, or the projection device can be controlled to project the second pattern.

[0246] It is understandable that the projection control method described above can be repeatedly executed as the vehicle moves or other traffic participants move. The difference lies in the information acquired by the acquisition unit, the pattern projected by the projection device, and the logo displayed by the HUD device. For example, in the above... Figure 3 Based on the projection control method shown, the acquisition unit can also acquire fourth environmental information, and the control unit controls the projection device to project the third pattern and the HUD device to display the third logo based on the fourth environmental information. For example, in the above... Figure 17 Based on the projection control method shown, the acquisition unit can also acquire fifth environmental information. The control unit then controls the projection device to project a fourth pattern based on the fifth environmental information. The acquisition unit will then acquire the fourth pattern again, and the control unit will then control the HUD device to display the fourth logo based on the fourth pattern. For example, in the above... Figure 18 Based on the projection control method shown, the acquisition unit can also acquire sixth environmental information. The control unit then controls the HUD device to display a fifth identifier based on the sixth environmental information, and the control unit further controls the projection device to project a fifth pattern based on the fifth identifier. For a detailed description of the above-mentioned repeated execution scheme, please refer to the corresponding content described above; it will not be repeated here.

[0247] Optionally, when repeated execution Figure 3 , Figure 17 or Figure 18 In the case of the projection control method shown, the new pattern projected by the projection device can be used to indicate the first object or a new object. For example, the third pattern can be used to indicate a third object, which may be the same as or different from the first object. Accordingly, when repeatedly executed... Figure 3 , Figure 17 or Figure 18 In the case of the projection control method shown, the logo displayed by the HUD device may be the same as the first logo / second logo mentioned above, or it may be different from the first logo / second logo mentioned above.

[0248] Optionally, the above Figure 3 , Figure 17 or Figure 18 The projection control methods shown can also be combined to provide richer functions, thereby better assisting drivers in participating in traffic, or better interacting with other traffic participants.

[0249] In one possible implementation, in addition to the projection device projecting the first pattern and the HUD device displaying the first identifier, the seventh environmental information of the vehicle is also acquired. Based on the seventh environmental information, the HUD device is controlled to display a sixth identifier, which is used to identify the relationship between the vehicle and a fourth object in the vehicle's environment. Based on the sixth identifier, the projection device is controlled to project a sixth pattern in the vehicle's environment, which is used to indicate the fourth object. Alternatively, the projection device is controlled to flash at a first frequency based on the sixth identifier to prompt the sixth object.

[0250] For example, as described above Figure 12A and Figure 12B Taking the aforementioned scenario as an example, the distance between the vehicle and objects in its environment (such as other vehicles or curbs) is relatively wide, allowing the driver to pass with confidence. However, in some scenarios, the distance between the vehicle and objects in its environment may be narrow, posing a risk of traffic accidents, such as... Figure 11C As shown, from Figure 11C As shown in the scenario, the distance between the bicycle and the cyclist, or between the bicycle and the curb, is 0.1 meters. If the bicycle continues to proceed, there is a risk of a traffic accident. In this situation, honking the horn directly would not only generate a lot of noise, disturbing the rest of residents in the residential area, but might also startle the cyclist.

[0251] In view of this, the solution provided in this application can be based on Figure 12A The scenario shown is executed. Figure 3 The projection control method shown yields the following results: Figure 12BThe scenario is shown. As the bicycle and the cyclist move, the acquisition unit acquires seventh environmental information and controls the HUD device to display the information based on this information. Figure 20A The sixth sign shown includes two "0.1 meters" markings and the words "too close together." Figure 20A As shown in the scenario, the distance between the cyclist and the left-hand beam is 0.1 meters, and the distance between the cyclist and the right-hand curb is also 0.1 meters. Under these conditions, a traffic accident is likely to occur. Accordingly, [action can be performed]. Figure 18 The projection control method shown is used to control the projection device to display new patterns, for example, by using a camera in the cockpit to identify whether the driver is looking at the image. Figure 20A The duration of the first indicator shown (the words "spacing too close") exceeds a preset value, thereby controlling the projection device to project a new pattern (such as...). Figure 20B The sixth pattern shown is used to warn cyclists that they are too close to the vehicle, increasing the risk of an accident, and to request that they give way. Optionally, Figure 20B The sixth pattern shown can be a beam of light flashing at a first frequency. The first frequency can be 10 times / minute or 20 times / minute, and this application does not limit it.

[0252] In another possible implementation, based on the projection device projecting a first pattern and the HUD device displaying a first identifier, the projection device is directly controlled to project a sixth pattern in the vehicle's environment based on the first identifier. The sixth pattern is used to indicate the first object. Alternatively, the projection device is controlled to flash at a second frequency based on the first identifier to prompt the first object.

[0253] For example, with Figure 12A Taking the scenario shown as an example, the first pattern projected by the projection device is directly projected as... Figure 20A The first pattern shown is the logo directly displayed on the HUD device. Figure 20A The sixth sign shown can directly control the projection device to project new patterns into the vehicle's environment based on the first sign. For example, it can use a camera in the cockpit to identify whether the driver is looking at it. Figure 20A The duration of the first indicator shown (the words "spacing too close") exceeds a preset value, thereby controlling the projection device to project a new pattern (such as...). Figure 20B The sixth pattern shown is used to warn cyclists that they are too close to the vehicle, increasing the risk of an accident, and to request that they give way. Optionally, Figure 20B The sixth pattern shown can be a beam of light flashing at a second frequency. The second frequency can be 10 times / minute or 20 times / minute, and this application does not limit it.

[0254] Optionally, the aforementioned first object, second object, third object, fourth object, fifth object, or sixth object includes one or more of the following: pedestrian, other vehicle, traffic sign, curb, intersection, waiting section of road, or obstacle.

[0255] Optionally, the aforementioned first, second, third, fourth, fifth, and sixth symbols, as well as the first, second, third, fourth, fifth, or sixth symbols, may have different colors for better illustration. For example, the aforementioned... Figure 14B The text “Warning!!! The distance between the two vehicles is less than the braking distance” can be displayed in yellow to better remind the driver.

[0256] Optionally, the scenarios described above can be evening, night, cloudy days, or other scenarios with poor lighting.

[0257] As can be seen from the solutions presented above, by combining Figure 3 and Figure 18 The projection control method shown can achieve richer functions to better meet the needs of drivers, thereby better assisting drivers or other traffic participants in participating in traffic and improving driving safety.

[0258] In summary, the solution provided in this application, by displaying a first sign (second sign) using a HUD device and projecting a first pattern (second pattern) using a projection device, allows the information presented by the superposition of the first sign (second sign) and the first pattern (second pattern) to better assist drivers in participating in traffic and to better enable the vehicle to interact with other road users. Furthermore, Figure 18 The projection control method shown also allows the driver to control whether the projection device projects a second pattern according to their needs, thereby better meeting the driver's requirements and greatly enhancing the driving experience. Furthermore, the various projection control methods provided in this application can be combined to provide richer projection functions, thereby better assisting drivers and other traffic participants in participating in traffic and improving driving safety.

[0259] This application also provides a projection system, which includes an acquisition unit, a control unit, a projection device, and a HUD device, wherein the acquisition unit may be one of the above-described components. Figure 2 The acquisition unit 210 shown can also be the one described above. Figure 3 , Figure 17 or Figure 18 The acquisition unit shown, the control unit can be the one described above. Figure 2 The control unit 220 shown can also be the one described above. Figure 3 , Figure 17 or Figure 18The control unit shown, correspondingly, the projection device and the HUD device can also be the aforementioned... Figure 3 , Figure 17 or Figure 18 The projection device or HUD device shown. The projection system described above is used to perform the above... Figure 3 , Figure 17 or Figure 18 The projection control method obtained by combining it with other methods.

[0260] This application also provides a projection control device, which includes a processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program, causing the device to perform the above-described actions. Figure 3 , Figure 17 or Figure 18 The projection control method obtained by combining it with other methods.

[0261] This application also provides a terminal device, which includes the above-described projection system or projection control device.

[0262] Optionally, the terminal can be a vehicle, drone, robot, or other intelligent terminal or transportation tool; alternatively, the terminal can also be industrial equipment. It should be understood that the terminal involved in this application can include intelligent terminals or transportation tools such as vehicles, robots, drones, ships, and vessels. Here, "vehicle" is a vehicle in a broad sense, and can be transportation tools (such as commercial vehicles, passenger cars, motorcycles, flying cars, trains, etc.), industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), agricultural equipment (such as lawnmowers, harvesters, etc.), etc. For example, a robot can be an automated guided vehicle (AGV), a walking conversational robot, a service robot, etc. Industrial equipment includes industrial robots, robotic arms, etc. Leisure and entertainment equipment includes virtual reality (VR) devices, mixed reality (MR) devices, or 4D cinema cabins, etc.

[0263] This application provides a computer program product, comprising: a computer program (also referred to as code or instructions); when the computer program is run, it causes a computer to perform the above-described actions. Figure 3 , Figure 17 or Figure 18 The projection control method obtained by combining it with other methods.

[0264] This application provides a chip including a processor, which executes instructions. When the processor executes the instructions, the chip performs the aforementioned actions. Figure 3 , Figure 17 or Figure 18 The projection control method obtained by combining it with other methods.

[0265] This application also provides a computer-readable storage medium storing instructions that, when executed on at least one processor, implement the above-described... Figure 3 , Figure 17 or Figure 18 The projection control method obtained by combining it with other methods.

[0266] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

Claims

1. A projection control method, characterized in that, The method includes: Acquire first environmental information about the vehicle, wherein the vehicle includes a projection device and a head-up display (HUD) device; Based on the first environmental information, the projection device is controlled to project a first pattern in the environment where the vehicle is located. The first pattern is used to indicate the presence of a first object in the environment where the vehicle is located. The first pattern is acquired, and the HUD device is controlled to display a first identifier based on the first pattern and the first environmental information. The first identifier is used to identify the relationship between the first pattern and the first object.

2. The method according to claim 1, characterized in that, The first identifier includes a locking frame, which is used to lock the first object.

3. The method according to claim 1 or 2, characterized in that, The relationship includes one or more of the following: distance, relative direction, or relative speed.

4. The method according to any one of claims 1-3, characterized in that, The first pattern is projected onto the first object, and the first identifier is also used to identify one or more of the shape, size, speed, or category of the first object.

5. The method according to any one of claims 1-4, characterized in that, The vehicle's environment also includes a second object; the first identifier is also used to identify the relationship between the first object and the second object, or the relationship between the first pattern and the second object, wherein the second object includes one or more of pedestrians, other vehicles, traffic signs, curbs, or obstacles.

6. The method according to any one of claims 1-5, characterized in that, The first object includes one or more of the following: pedestrians, other vehicles, traffic signs, curbs, or obstacles.

7. The method according to claim 1 or 2, characterized in that, The first pattern and the first logo are used to identify the vehicle's driving information, which includes at least one of navigation information, driver assistance information, and vehicle data.

8. The method according to any one of claims 7, characterized in that, The first pattern is shaped like a driving sign, which is used to indicate the driving intention of the vehicle. The first identifier is used to identify distance information related to the driving sign. The driving sign and the distance information depend on the driving information.

9. The method according to claim 1 or 2, characterized in that, The width of the first pattern is equal to the width of the vehicle, and the first mark is used to indicate the distance between the boundary of the first pattern and the first object, or the distance between the vehicle and the first object.

10. The method according to claim 1 or 2, characterized in that, The length of the first pattern is equal to the distance between the vehicle and the first object, and the first identifier is used to identify the distance between the first pattern and the first object, or the distance between the vehicle and the first object.

11. The method according to any one of claims 1-10, characterized in that, The method further includes: Obtain the second environmental information of the vehicle; Based on the second environmental information, the HUD device is controlled to display a second identifier, which is used to identify the relationship between the vehicle and a third object in the environment where the vehicle is located; Based on the second identifier, the projection device is controlled to project the second pattern into the environment where the vehicle is located, the second pattern being used to indicate the third object; or... Based on the second identifier, the projection device is controlled to flash at a first frequency to prompt the third object.

12. The method according to any one of claims 1-11, characterized in that, The method further includes: Based on the first identifier, the projection device is controlled to project a third pattern into the environment where the vehicle is located, the third pattern being used to indicate the first object; or... Based on the first identifier, the projection device is controlled to flash at a second frequency to prompt the first object.

13. The method according to claims 1-12, characterized in that, The method further includes: Based on the first environmental information, the projection device is controlled to project a fourth pattern in the environment where the vehicle is located, and the fourth pattern is consistent with the shape of the road segment where the vehicle is about to travel. Based on the first environmental information, the HUD device is controlled to display a third identifier, which is used to identify the name of the road segment to be driven and / or the destination corresponding to the road segment to be driven.

14. The method according to any one of claims 1-13, characterized in that, The vehicle also includes headlights, and the projection device is deployed on the headlights.

15. The method according to any one of claims 1-14, characterized in that, The environment in which the vehicle is located includes the ground in front of the vehicle, obstacles, green belts, curbs, tunnel entrances, height restriction frames, or one or more of other objects.

16. A projection system, characterized in that, Includes an acquisition unit, a control unit, a projection device, and a HUD device; The acquisition unit is used to acquire the vehicle's first environmental information; The control unit is also configured to control the projection device to project a first pattern in the environment where the vehicle is located based on the first environmental information, wherein the first pattern is used to indicate the presence of a first object in the environment where the vehicle is located; The acquisition unit is also used to acquire the first pattern; The control unit is also configured to control the HUD device to display a first identifier based on the first pattern and the first environmental information, wherein the first identifier is used to identify the relationship between the first pattern and the first object.

17. The system according to claim 16, characterized in that, The acquisition unit is also used to acquire second environmental information of the vehicle; The control unit is also configured to control the HUD device to display a second identifier based on the second environmental information, the second identifier being used to identify the relationship between the vehicle and a third object in the environment in which the vehicle is located; The control unit is further configured to control the projection device to project a second pattern in the environment where the vehicle is located based on the second identifier, the second pattern being used to indicate the third object; or, the control unit is further configured to control the projection device to flash at a first frequency based on the second identifier to prompt the third object.

18. The system according to claim 16 or 17, characterized in that, The system also includes: The control unit is further configured to control the projection device to project a third pattern in the vehicle's environment based on the first identifier, the third pattern being used to indicate the first object; or... The control unit is also configured to control the projection device to flash at a second frequency based on the first identifier to prompt the first object.

19. The system according to any one of claims 16-18, characterized in that, The control unit is also configured to control the projection device to project a fourth pattern in the environment where the vehicle is located based on the first environmental information, the fourth pattern being consistent with the shape of the road segment to be traveled by the vehicle. The control unit is also configured to control the HUD device to display a third identifier based on the first environmental information, the third identifier being used to identify the name of the road segment to be driven and / or the destination corresponding to the road segment to be driven.

20. A vehicle, characterized in that, The vehicle includes a projection system as described in any one of claims 16-19.

21. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, which, when executed, performs the method as described in any one of claims 1 to 15.

22. A computer program product, characterized in that, include: Instructions or computer programs; When the instructions or the computer program are executed, the method as described in any one of claims 1 to 15 is implemented.

Images