A projection-based destination guidance method, apparatus, and terminal device

Abstract

This application relates to the field of assisted driving technology, and proposes a projection-based destination guidance method, device, and terminal equipment. The method includes: acquiring a road surface image in front of the vehicle; determining the location of the vehicle's navigation destination in the road surface image by combining map information; determining the target position of a marker pattern used to indicate the destination in the projection area of ​​a projection device installed in the vehicle, based on the location of the destination in the road surface image; and controlling the projection device to project the marker pattern onto the target position in the projection area. This method allows the driver to conveniently know the specific location of the destination from the driver's perspective without interfering with driving.

Description

Technical Field

[0001] This application relates to the field of driver assistance technology, and in particular to a projection-based destination guidance method, apparatus, and terminal device. Background Technology

[0002] Currently, projection technology used in driver assistance systems primarily involves using cameras to capture the driver's view, marking information such as vehicle speed, lane, destination, and traffic lights. This information is then projected onto the vehicle's windshield or in-car screen to achieve a superior immersive navigation experience. However, existing technology only projects destination information onto the lower part of the windshield. Drivers can only know where they are going, not their location, through the projected information. Furthermore, projecting large amounts of information onto the windshield can interfere with normal driving. Summary of the Invention

[0003] In view of this, embodiments of this application provide a projection-based destination guidance method, apparatus, and terminal device, which enables drivers to conveniently know the specific location of the destination from the driver's perspective without interfering with driving.

[0004] A first aspect of this application provides a projection-based destination guidance method, comprising:

[0005] Acquire an image of the road surface in front of the vehicle;

[0006] By combining map information, the location of the vehicle navigation destination in the road image is determined;

[0007] Based on the location of the destination in the road image, determine the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device installed in the vehicle;

[0008] The projection device is controlled to project the marking pattern onto the target position in the projection area.

[0009] In this embodiment, firstly, an image of the road surface in front of the vehicle is acquired. Then, combined with map information, the location of the vehicle's navigation destination in the road surface image is determined. Next, based on the location of the destination in the road surface image, the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device can be determined. Finally, the projection device is controlled to project the marker pattern onto the target position in the projection area. With this setup, the driver can easily determine the specific location of the destination from the driver's perspective by observing the position of the projected marker pattern. Moreover, since the projected information is only a marker pattern, it will not interfere with the driver's normal driving.

[0010] In one implementation of this application, determining the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device installed on the vehicle, based on the location of the destination in the road image, may include:

[0011] Mark the first coordinate point of the marking pattern in the road surface image according to the stated orientation;

[0012] Based on the first coordinate point, determine the second coordinate point of the marked pattern in the projection area;

[0013] The position corresponding to the second coordinate point is determined as the target position.

[0014] Furthermore, determining the second coordinate point of the marked pattern in the projection area based on the first coordinate point may include:

[0015] Obtain the driver's eye position and viewing direction information of the vehicle;

[0016] Based on the eye position information and the viewing direction information, the road surface image is adjusted to a simulated image from the driver's perspective;

[0017] Map the first coordinate point to the corresponding position in the simulation image;

[0018] Based on the coordinates of the corresponding position in the simulation image, the second coordinate point of the marker pattern in the projection area is determined.

[0019] Furthermore, after adjusting the road surface image to a simulated image from the driver's perspective, the method may further include:

[0020] The projection device is controlled to project the simulated image onto the projection area.

[0021] In one implementation of this application, after controlling the projection device to project the mark pattern onto the target position in the projection area, the method may further include:

[0022] The display parameters of the projected marker pattern are set according to the occlusion of objects in the direction pointed to by the target location.

[0023] Furthermore, setting the display parameters of the projected marker pattern based on the occlusion of objects in the direction pointed to by the target location may include:

[0024] If the direction indicated by the target location is obstructed by an object other than the vehicle, the transparency and / or display brightness of the projected marker pattern are set according to the number and size of the obstructing objects; wherein the transparency is directly proportional to the number, and the display brightness is inversely proportional to the number.

[0025] If the direction indicated by the target location is not obstructed by any object other than the vehicle, then the transparency of the projected marker pattern is set to a preset minimum value, and / or the display brightness of the projected marker pattern is set to a preset maximum value.

[0026] In one implementation of this application, the method may further include:

[0027] Based on the map information, the distance between the vehicle's current location and the destination is determined, as well as the orientation of the destination relative to the current location is determined.

[0028] The projection device is controlled to project the distance information and the orientation information onto the projection area.

[0029] In one implementation of this application, the projection area may be the windshield area of ​​the vehicle.

[0030] A second aspect of this application provides a projection-based destination guidance device, comprising:

[0031] The image acquisition module is used to acquire images of the road surface in front of the vehicle;

[0032] The orientation determination module is used to determine the orientation of the vehicle navigation destination in the road surface image by combining map information;

[0033] The location determination module is used to determine the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device installed on the vehicle, based on the orientation of the destination in the road image.

[0034] A marking pattern projection module is used to control the projection device to project the marking pattern onto the target position in the projection area.

[0035] A third aspect of this application provides a terminal device including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the projection-based destination guidance method provided in the first aspect of this application.

[0036] A fourth aspect of this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the projection-based destination guidance method provided in the first aspect of this application.

[0037] The fifth aspect of this application provides a computer program product that, when run on a terminal device, causes the terminal device to execute the projection-based destination guidance method provided in the first aspect of this application.

[0038] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0039] Figure 1 This is a flowchart of a projection-based destination guidance method provided in an embodiment of this application;

[0040] Figure 2 This is a schematic diagram of the operation flow of the projection-based destination guidance method provided in this application embodiment in a practical application scenario;

[0041] Figure 3 This is a schematic diagram illustrating the effect of projecting a marking pattern onto a vehicle's windshield, as provided in an embodiment of this application.

[0042] Figure 4 This is a structural framework diagram of a projection-based destination guidance device provided in an embodiment of this application;

[0043] Figure 5 This is a schematic diagram of a terminal device provided in an embodiment of this application. Detailed Implementation

[0044] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application can also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail. Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," etc., are used only for distinguishing descriptions and should not be construed as indicating or implying relative importance.

[0045] Augmented Reality (AR) technology is a technique that cleverly integrates virtual information with the real world. Existing technologies have publicly disclosed the use of AR and other projection devices to project information such as vehicle speed, lanes, destinations, and traffic lights onto the windshield or in-vehicle screen, enhancing the user's driving experience and achieving immersive navigation. However, drivers can only know the destination from the projected information, not its specific location from the driver's perspective. Furthermore, projecting large amounts of information onto the windshield can interfere with normal driving. To address this issue, this application provides a projection-based destination guidance method, device, terminal equipment, and storage medium, enabling drivers to easily obtain the specific location of the destination from their perspective without interfering with driving. For more specific technical implementation details of this application's embodiments, please refer to the method embodiments described below.

[0046] It should be understood that the execution subject of the various method embodiments of this application can be various types of terminal devices or servers, such as mobile phones, tablets, wearable devices, vehicle terminals, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), large-screen TVs, etc. The embodiments of this application do not impose any restrictions on the specific type of terminal device and server.

[0047] Please see Figure 1 This illustration shows a projection-based destination guidance method provided in an embodiment of this application, comprising:

[0048] 101. Obtain an image of the road surface in front of the vehicle;

[0049] The execution entity in this application embodiment can be a vehicle-mounted terminal, which can be connected to devices such as cameras and projection equipment installed in the vehicle to acquire and analyze images captured by the cameras, and control the projection equipment based on the results of image analysis and processing. First, one or more cameras installed in front of the vehicle can acquire road surface images from the perspective of the vehicle's front. After acquiring the road surface images, the vehicle-mounted terminal performs subsequent image analysis and processing.

[0050] 102. Based on map information, determine the location of the vehicle navigation destination in the road surface image;

[0051] In-vehicle terminals can obtain map information through networks or local storage. Combining this map information with the navigation information, they can determine the location of the vehicle's navigation destination within the road surface image. Specifically, after navigation is activated, the positioning system determines the vehicle's current location. This, combined with map information, determines the location of the navigation destination relative to the vehicle's current location, and thus, the destination's location within the road surface image viewed from the vehicle's front. For example, assuming the map information indicates the destination is northeast of the vehicle's current location, then the destination's location within the road surface image viewed from the vehicle's front would be close to the upper right corner of the image.

[0052] 103. Based on the location of the destination in the road image, determine the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection equipment installed on the vehicle;

[0053] The vehicle is equipped with projection equipment, which can be various types of projection devices such as AR projection or holographic projection. This equipment projects virtual information used to assist driving onto a designated projection area, such as the in-vehicle screen, the windshield, or the road surface in front of the vehicle—areas easily visible to the driver. Preferably, to avoid the driver's gaze constantly switching between the road surface and the in-vehicle screen, this embodiment of the application places the projection area of ​​the projection equipment on the windshield. This allows the driver to simultaneously view the real road conditions and the projected virtual information while keeping their gaze focused on the road ahead.

[0054] Based on the location of the destination in the road image, the vehicle-mounted terminal can determine the position (represented by the target position) of the marker pattern used to indicate the destination in the projection area. For example, if the destination is located near the upper right corner of the road image, it can be roughly determined that the marker pattern indicating the destination is also located in the upper right corner of the projection area. The marker pattern can be any character or graphic pattern, such as a circle, a triangle, the letter "D," or other patterns, etc., and is primarily used to indicate the location of the destination from the driver's perspective.

[0055] In one implementation of this application, determining the target position of the marker pattern indicating the destination in the projection area of ​​the projection device installed on the vehicle, based on the location of the destination in the road image, may include:

[0056] (1) Mark the first coordinate point of the marking pattern on the road surface image according to this orientation;

[0057] (2) Determine the second coordinate point of the marked pattern in the projection area based on the first coordinate point;

[0058] (3) Determine the position corresponding to the second coordinate point as the target position.

[0059] To more accurately determine the position of the marker pattern in the projection area, after determining the orientation of the destination in the road image, coordinate points (represented by a first coordinate point) can be marked on the road image according to that orientation to indicate the position of the marker pattern. For example, a coordinate point can be marked directly above that orientation in the road image. After marking the coordinate points of the marker pattern in the road image, the corresponding coordinate point in the projection area (represented by a second coordinate point) can be found using the coordinate mapping relationship between the road image and the projection area. The position of this second coordinate point can then be determined as the target position for the projection of the marker pattern.

[0060] Furthermore, determining the second coordinate point of the marker pattern in the projection area based on the first coordinate point may include:

[0061] (1) Obtain the driver's eye position and viewing direction information;

[0062] (2) Based on eye position information and viewing direction information, adjust the road image to a simulated image from the driver's perspective;

[0063] (3) Map the first coordinate point to the corresponding position in the simulation image;

[0064] (4) Determine the second coordinate point of the marker pattern in the projection area based on the coordinates of the corresponding position in the simulation image.

[0065] When determining the coordinates of a marked pattern in the projection area based on the coordinates of the marked pattern in the road image, the driver's eye position and viewing direction information can be obtained first. Specifically, this can be achieved by using a camera or other device in the cockpit to capture the driver's facial image, which is then analyzed to obtain information such as eye position and viewing direction. Next, based on the obtained driver's eye position and viewing direction information, the road image can be adjusted to a simulated image from the driver's perspective. This can be achieved using various deep learning-based image processing algorithms currently available. Then, the first coordinate point in the road image is mapped onto the simulated image to find its corresponding position. Finally, based on the coordinates of this corresponding position in the simulated image, the second coordinate point of the marked pattern in the projection area can be determined through mapping and other methods, thus determining the target position of the projected marked pattern. With this setup, the target position of the projected marked pattern will adjust in real time according to the driver's eye position and viewing direction, resulting in a better destination guidance experience.

[0066] Furthermore, after adjusting the road surface image to a simulated image from the driver's perspective, it may also include:

[0067] The control projector projects the simulated image onto the projection area.

[0068] In another implementation, the vehicle terminal can also control the projection device to project the obtained simulated image onto the projection area, so that the driver can directly view the simulated image from the driver's perspective in the projection area, thereby obtaining an immersive assisted driving experience.

[0069] 104. Control the projection equipment to project the marked pattern onto the target position in the projection area.

[0070] After determining the target location of the marker pattern within the projection area, the in-vehicle terminal can control the projection device to project the marker pattern onto that target location, thereby providing the driver with directional guidance to their destination. Furthermore, the projected virtual information contains only one marker pattern, so it will not interfere with the driver's normal driving behavior.

[0071] In one implementation of this application embodiment, after controlling the projection device to project the mark pattern onto the target position in the projection area, the method may further include:

[0072] The display parameters of the projected marker pattern are set according to the occlusion of objects in the direction the target location points to.

[0073] To further enhance the user experience, the in-vehicle terminal can also adjust the display parameters of the projected marker pattern based on the occlusion status of objects pointing towards the target location. Specifically, by analyzing images captured by the vehicle's front camera, it can be determined whether there are obstructions such as buildings, trees, or vehicles in the direction pointed to by the target location, thus determining the occlusion status. Then, display parameters such as the color, brightness, or transparency of the projected marker pattern can be adjusted based on the occlusion status.

[0074] Furthermore, setting the display parameters of the projected marker pattern based on the occlusion of objects in the direction pointed to by the target location may include:

[0075] (1) If the direction pointed to by the target location is blocked by an object other than the vehicle, the transparency and / or display brightness of the projected mark pattern shall be set according to the number and size of the blocking objects; wherein, the transparency is directly proportional to the number and the display brightness is inversely proportional to the number.

[0076] (2) If the direction pointed to by the target location is not obstructed by objects other than the vehicle, the transparency of the projected mark pattern is set to the preset minimum value, and / or the display brightness of the projected mark pattern is set to the preset maximum value.

[0077] Specifically, if the direction indicated by the target location is obstructed by buildings or other vehicles outside the vehicle, the transparency and / or brightness of the projected marker pattern can be adjusted to indicate the obstruction. Furthermore, by recognizing the target in the image, the number of obstructing objects in that direction can be counted, and the transparency and / or brightness of the projected marker pattern can be set based on this number. The transparency setting is directly proportional to the number of obstructing objects, while the brightness setting is inversely proportional. For example, the more obstructing objects there are, the higher the transparency of the projected marker pattern should be, or the lower the brightness should be, and so on. In particular, if the direction indicated by the target location is not obstructed (e.g., the background is sky), the transparency of the projected marker pattern can be set to a preset minimum value, such as 0 transparency. Similarly, the brightness of the projected marker pattern can be set to a preset maximum value to indicate an unobstructed state. With these settings, the driver can intuitively determine whether the direction of the destination is obstructed by the transparency or brightness of the projected marker pattern, thereby effectively improving the driving experience.

[0078] In one implementation of this application, the projection-based destination guidance method may further include:

[0079] (1) Combine map information to determine the distance between the vehicle’s current location and the destination, and the orientation of the destination relative to the current location;

[0080] (2) Control the projection device to project the distance information and the orientation information onto the projection area.

[0081] In addition to projecting markers to indicate the destination's location, the in-vehicle terminal can also combine map information to determine the distance between the vehicle's current location and the destination, as well as the destination's orientation relative to the current location. This distance and orientation information are then projected to a designated location within the projection area, such as the lower left corner or directly below the markers. For example, if the map information determines that the destination is 30km northeast of the vehicle's current location, the distance information can be set to "30km" and the orientation to "northeast." Then, these virtual values ​​can be projected directly below the markers in the projection area. With this setup, the driver can not only know the destination's specific orientation from their perspective but also the distance between the vehicle's current location and the destination, as well as the destination's actual orientation relative to the vehicle's current location.

[0082] In this embodiment, firstly, an image of the road surface in front of the vehicle is acquired. Then, combined with map information, the location of the vehicle's navigation destination in the road surface image is determined. Next, based on the location of the destination in the road surface image, the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device can be determined. Finally, the projection device is controlled to project the marker pattern onto the target position in the projection area. With this setup, the driver can easily determine the specific location of the destination from the driver's perspective by observing the position of the projected marker pattern. Moreover, since the projected information is only a marker pattern, it will not interfere with the driver's normal driving.

[0083] To facilitate understanding of the projection-based destination guidance method provided in the embodiments of this application, a practical application scenario is given below. For example... Figure 2 The diagram shown illustrates the operation flow of the projection-based destination guidance method provided in this application embodiment in a practical application scenario. Figure 2 First, the vehicle's camera captures images of the road surface. Then, combined with positioning information from the map system, the coordinates of the navigation target (destination) in the two-dimensional road image are determined. Next, based on the driver's eye position and viewing direction, coordinate mapping is used to calculate the target's coordinates on the vehicle's windshield (the projection area of ​​the projection device). Finally, a marker indicating the destination's location is projected onto the corresponding position on the windshield. Furthermore, by combining positioning information from the map system, the straight-line distance and actual orientation between the destination and the vehicle can also be determined, and this distance and orientation are also projected onto the windshield.

[0084] like Figure 3 The image shown illustrates the effect of projecting a marked pattern onto a vehicle's windshield. Figure 3 In this context, the vehicle's windshield serves as the projection area for the projection device. The method provided in this application allows for the projection of a marker pattern indicating the location of a destination onto the corresponding position. Figure 3 The circular marker is shown in the image. Additionally, directly below this marker, the straight-line distance (30km) between the vehicle's current location and its destination, as well as its actual orientation (northeast), are projected.

[0085] In summary, the embodiments of this application project a navigation destination marker onto the windshield or other areas of the vehicle using projection technology in a way that does not interfere with the driver's normal driving. This combines virtual information with the real world, providing the driver with accurate guidance on the location and distance of the destination, thereby achieving a better driving experience.

[0086] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0087] The above mainly describes a projection-based destination guidance method. The following will describe a projection-based destination guidance device.

[0088] Please see Figure 4 One embodiment of a projection-based destination guidance device in this application includes:

[0089] Image acquisition module 401 is used to acquire images of the road surface in front of the vehicle;

[0090] The orientation determination module 402 is used to determine the orientation of the vehicle navigation destination in the road image by combining map information;

[0091] The location determination module 403 is used to determine the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device provided on the vehicle, based on the orientation of the destination in the road image.

[0092] The marking pattern projection module 404 is used to control the projection device to project the marking pattern onto the target position in the projection area.

[0093] In one implementation of this application, the location determination module may include:

[0094] A coordinate point annotation unit is used to annotate the first coordinate point of the marking pattern in the road surface image according to the orientation;

[0095] A coordinate point determination unit is used to determine a second coordinate point of the mark pattern in the projection area based on the first coordinate point;

[0096] A position determination unit is used to determine the position corresponding to the second coordinate point as the target position.

[0097] Furthermore, the coordinate point determination unit may include:

[0098] The driver information acquisition subunit is used to acquire the driver's eye position information and viewing direction information of the vehicle.

[0099] The image adjustment subunit is used to adjust the road image into a simulated image from the driver's perspective based on the eye position information and the viewing direction information.

[0100] A coordinate point mapping subunit is used to map the first coordinate point to the corresponding position in the simulation image;

[0101] The coordinate point determination subunit is used to determine the second coordinate point of the mark pattern in the projection area based on the coordinates of the corresponding position in the simulation image.

[0102] Furthermore, the coordinate point determination unit may further include:

[0103] A simulated image projection unit is used to control the projection device to project the simulated image onto the projection area.

[0104] In one implementation of this application, the projection-based destination guidance device may further include:

[0105] The display parameter setting module is used to set the display parameters of the projected mark pattern according to the occlusion of objects in the direction pointed to by the target position.

[0106] Furthermore, the display parameter setting module may include:

[0107] The first parameter setting unit is used to set the transparency and / or display brightness of the projected mark pattern according to the number and size of the objects obstructing the direction pointed to by the target location; wherein the transparency is directly proportional to the number of objects, and the display brightness is inversely proportional to the number of objects.

[0108] The second parameter setting unit is used to set the transparency of the projected mark pattern to a preset minimum value and / or set the display brightness of the projected mark pattern to a preset maximum value if the direction pointed to by the target position is not obstructed by an object other than the vehicle.

[0109] In one implementation of this application, the projection-based destination guidance device may further include:

[0110] The distance and orientation information determination module is used to combine the map information to determine the distance information between the current position of the vehicle and the destination, and to determine the orientation information of the destination relative to the current position;

[0111] The distance and orientation information projection module is used to control the projection device to project the distance information and the orientation information onto the projection area.

[0112] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the projection-based destination guidance method as described in any of the above embodiments.

[0113] This application also provides a computer program product that, when run on a terminal device, causes the terminal device to execute a projection-based destination guidance method as described in any of the above embodiments.

[0114] Figure 5 This is a schematic diagram of a terminal device provided in an embodiment of this application. For example... Figure 5 As shown, the terminal device 5 in this embodiment includes: a processor 50, a memory 51, and a computer program 52 stored in the memory 51 and executable on the processor 50. When the processor 50 executes the computer program 52, it implements the steps in the embodiments of the various projection-based destination guidance methods described above, for example... Figure 1 Steps 101 to 104 are shown. Alternatively, when the processor 50 executes the computer program 52, it implements the functions of each module / unit in the above-described device embodiments, for example... Figure 4 The functions of modules 401 to 404 are shown.

[0115] The computer program 52 can be divided into one or more modules / units, which are stored in the memory 51 and executed by the processor 50 to complete this application. The one or more modules / units can be a series of computer program instruction segments capable of performing specific functions, which describe the execution process of the computer program 52 in the terminal device 5.

[0116] The processor 50 may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0117] The memory 51 can be an internal storage unit of the terminal device 5, such as a hard disk or memory of the terminal device 5. The memory 51 can also be an external storage device of the terminal device 5, such as a plug-in hard disk, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the terminal device 5. Furthermore, the memory 51 can include both internal and external storage units of the terminal device 5. The memory 51 is used to store the computer program and other programs and data required by the terminal device. The memory 51 can also be used to temporarily store data that has been output or will be output.

[0118] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0119] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0120] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0121] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0122] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the system embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units through some interfaces, and may be electrical, mechanical, or other forms.

[0123] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of this application, depending on actual needs.

[0124] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0125] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, portable hard drives, magnetic disks, optical disks, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately added or removed according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electrical carrier signals and telecommunication signals.

[0126] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A projection-based destination guidance method, characterized in that, include: Acquire an image of the road surface in front of the vehicle; By combining map information, the location of the vehicle navigation destination in the road image is determined; Based on the location of the destination in the road image, determine the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device installed in the vehicle; The projection device is controlled to project the marking pattern onto the target position in the projection area; If the direction indicated by the target location is obstructed by an object other than the vehicle, the transparency and / or display brightness of the projected marker pattern are set according to the number and size of the obstructing objects; wherein the transparency is directly proportional to the number, and the display brightness is inversely proportional to the number. If the direction indicated by the target location is not obstructed by any object other than the vehicle, then the transparency of the projected marker pattern is set to a preset minimum value, and / or the display brightness of the projected marker pattern is set to a preset maximum value.

2. The method as described in claim 1, characterized in that, The step of determining the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device installed on the vehicle, based on the location of the destination in the road image, includes: Mark the first coordinate point of the marking pattern in the road surface image according to the stated orientation; Based on the first coordinate point, determine the second coordinate point of the marked pattern in the projection area; The position corresponding to the second coordinate point is determined as the target position.

3. The method as described in claim 2, characterized in that, Determining the second coordinate point of the marked pattern in the projection area based on the first coordinate point includes: Obtain the driver's eye position and viewing direction information of the vehicle; Based on the eye position information and the viewing direction information, the road surface image is adjusted to a simulated image from the driver's perspective; Map the first coordinate point to the corresponding position in the simulation image; Based on the coordinates of the corresponding position in the simulation image, the second coordinate point of the marker pattern in the projection area is determined.

4. The method as described in claim 3, characterized in that, After adjusting the road surface image to a simulated image from the driver's perspective, the process also includes: The projection device is controlled to project the simulated image onto the projection area.

5. The method as described in claim 1, characterized in that, Also includes: Based on the map information, the distance between the vehicle's current location and the destination is determined, as well as the orientation of the destination relative to the current location is determined. The projection device is controlled to project the distance information and the orientation information onto the projection area.

6. The method according to any one of claims 1 to 5, characterized in that, The projection area is the windshield area of ​​the vehicle.

7. A projection-based destination guidance device, characterized in that, include: The image acquisition module is used to acquire images of the road surface in front of the vehicle; The orientation determination module is used to determine the orientation of the vehicle navigation destination in the road surface image by combining map information; The location determination module is used to determine the target position of the marker pattern used to indicate the destination in the projection area of ​​the projection device installed on the vehicle, based on the orientation of the destination in the road image. A marking pattern projection module is used to control the projection device to project the marking pattern onto the target position in the projection area; The first parameter setting unit is used to set the transparency and / or display brightness of the projected mark pattern according to the number and size of the objects obstructing the direction pointed to by the target location; wherein the transparency is directly proportional to the number of objects, and the display brightness is inversely proportional to the number of objects. The second parameter setting unit is used to set the transparency of the projected mark pattern to a preset minimum value and / or set the display brightness of the projected mark pattern to a preset maximum value if the direction pointed to by the target position is not obstructed by an object other than the vehicle.

8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the projection-based destination guidance method as described in any one of claims 1 to 6.

Images