A point of interest display method and device, electronic equipment and storage medium

Abstract

The application discloses a point-of-interest display method and device, electronic equipment and a storage medium, and relates to the field of head-up display technology. The method comprises the following steps: determining candidate points of interest within a preset range from a vehicle based on the collected position of the vehicle; selecting a target point of interest with the highest priority from the candidate points of interest; determining the type of the target point of interest and the current distance between the target point of interest and the vehicle; determining the content to be displayed and the display form of the content to be displayed of the target point of interest based on the type and the current distance, and displaying the content to be displayed on the windshield of the vehicle based on the display form. The technical scheme provided by the application can ensure the accuracy of the target point of interest, can more intelligently display the information of the point of interest, and can improve the driving experience of the user.

Description

Technical Field

[0001] This application relates to the field of head-up display technology, and in particular to a method, apparatus, electronic device, and storage medium for displaying points of interest. Background Technology

[0002] When a driver passes a key location that might interest them while driving (such as a shopping mall, gas station, restaurant, home, office, or school), vehicle navigation or mobile phone navigation cannot provide a point-of-interest (POI) display service, showing the location and information of the POI (such as promotional information or event reminders). In recent years, Head-Up Display (HUD) technology has been increasingly applied to automobiles. Therefore, accurately identifying the POI information that users are interested in and intelligently displaying it on the HUD to improve the user experience has become a pressing issue. Summary of the Invention

[0003] This application provides a method, device, electronic device, and storage medium for displaying points of interest, which can ensure the accuracy of the target points of interest, display the information of the points of interest more intelligently, and improve the user's driving experience.

[0004] Firstly, this application provides a method for displaying points of interest, the method comprising:

[0005] Based on the collected vehicle location, candidate points of interest within a preset range of the vehicle are determined;

[0006] Select the target interest point with the highest priority from the candidate interest points;

[0007] Determine the type of the target point of interest and the current distance between the target point of interest and the vehicle;

[0008] Based on the type and the current distance, the content to be displayed for the target point of interest and the display format of the content to be displayed are determined, and the content to be displayed is displayed through the windshield of the vehicle based on the display format.

[0009] This application identifies candidate points of interest (POIs) based on the vehicle's location, and then selects the target POI that the user is most interested in from the candidate POIs according to a preset priority strategy, which can ensure the accuracy of the target POI. Different display formats are set according to the distance between the vehicle and the target POI, and the content to be displayed for the target POI is determined according to the type of the target POI and the current distance, which can more intelligently display the information of the POI and improve the user's driving experience.

[0010] Furthermore, determining candidate points of interest (POIs) within a preset range from the vehicle based on the collected vehicle position includes: obtaining a first POI in a preset direction from the navigation map based on the vehicle's position, and determining the latitude and longitude coordinates of the first POI; constructing a vehicle coordinate system based on the vehicle's position, the latitude and longitude coordinates of the first POI, and the collected vehicle pose angle; determining the distance between the first POI and the vehicle in the vehicle coordinate system; and determining the first POI within the preset range as the candidate POI.

[0011] Furthermore, determining the content to be displayed and the display format of the target point of interest based on the type and the current distance includes: if the current distance is within a first region, determining the animation content corresponding to the type and determining the display format of the animation content as a global animation; if the current distance is within a second region, determining the identification pattern corresponding to the type and determining the display format of the identification pattern as an augmented reality (AR) format; if the current distance is within a third region, determining the graphic information corresponding to the type and determining the display format of the graphic information as an information presentation format; wherein the first region is farther than the second region, and the second region is farther than the third region.

[0012] Furthermore, when the current distance is within the second area, displaying the content to be displayed through the vehicle's windshield based on the display format includes: acquiring the coordinate data of the target point of interest in the vehicle's coordinate system, determining the imaging position of the target point of interest in the windshield based on the coordinate data, and displaying the content to be displayed at the imaging position in the windshield based on the display format.

[0013] Furthermore, selecting the target interest point with the highest priority from the candidate interest points includes: determining whether the vehicle state and driver state meet normal driving conditions; if they do, determining whether the distance difference between each candidate interest point and the vehicle is greater than a preset value; if not, determining the demand degree of each candidate interest point, and determining the interest point with the highest demand degree as the target interest point.

[0014] Furthermore, after determining whether the vehicle status and driver status meet the normal driving conditions, the method further includes: if the vehicle status does not meet the normal driving conditions, then a second point of interest is determined as the target point of interest, wherein the second point of interest includes at least one of a gas station, a charging station, and a repair station; if the driver status does not meet the normal driving conditions, then a third point of interest is determined as the target point of interest, wherein the third point of interest includes at least one of a rest stop, a service station, and a public restroom.

[0015] Furthermore, after determining whether the distance difference between each candidate point of interest and the vehicle is greater than a preset value, the method further includes: if it is greater, then the candidate point of interest closest to the vehicle is determined as the target point of interest.

[0016] Furthermore, after determining the demand level of each candidate point of interest, the method further includes: determining the number of points of interest with the highest demand level; if the number is one, then performing the operation of determining the point of interest with the highest demand level as the target point of interest; if the number is not one, then determining the point of interest with the highest demand level that is closest to the vehicle as the target point of interest.

[0017] Secondly, this application provides a point-of-interest display device, the device comprising:

[0018] The point of interest determination module is used to determine candidate points of interest within a preset range of the vehicle based on the collected vehicle's location.

[0019] The point of interest filtering module is used to select the target point of interest with the highest priority from the candidate points of interest;

[0020] The information determination module is used to determine the type of the target point of interest and the current distance between the target point of interest and the vehicle;

[0021] The point of interest display module is used to determine the content to be displayed for the target point of interest and the display format of the content to be displayed based on the type and the current distance, and to display the content to be displayed through the windshield of the vehicle based on the display format.

[0022] Thirdly, this application provides an electronic device comprising:

[0023] At least one processor; and

[0024] A memory communicatively connected to the at least one processor; wherein,

[0025] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the point-of-interest display method described in any embodiment of this application.

[0026] Fourthly, this application provides a computer-readable storage medium storing computer instructions that, when executed by a processor, implement the point-of-interest display method described in any embodiment of this application.

[0027] It should be noted that the aforementioned computer instructions may be stored, in whole or in part, on a computer-readable storage medium. This computer-readable storage medium may be packaged together with the processor of the point-of-interest display device, or it may be packaged separately from the processor of the point-of-interest display device; this application does not impose any limitations on this.

[0028] The descriptions of the second, third, and fourth aspects in this application can be referenced to the detailed description of the first aspect; and the beneficial effects described in the second, third, and fourth aspects can be referenced to the analysis of the beneficial effects of the first aspect, which will not be repeated here.

[0029] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description.

[0030] It is understood that before using the technical solutions disclosed in the various embodiments of this application, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this application in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 A first flowchart illustrating a method for displaying points of interest provided in an embodiment of this application;

[0033] Figure 2 A schematic diagram illustrating the display format of the content to be displayed as provided in an embodiment of this application;

[0034] Figure 3a A schematic diagram of a global animation provided in the embodiments of this application;

[0035] Figure 3b The schematic diagram provided for the embodiments of this application is in AR format;

[0036] Figure 3c A schematic diagram illustrating the information presentation format provided in the embodiments of this application;

[0037] Figure 4 This is a second flowchart illustrating a method for displaying points of interest provided in an embodiment of this application.

[0038] Figure 5A schematic diagram of the structure of a point-of-interest display device provided in an embodiment of this application;

[0039] Figure 6 This is a block diagram of an electronic device used to implement a method for displaying points of interest according to an embodiment of this application. Detailed Implementation

[0040] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this application.

[0041] It should be noted that the terms "first," "second," "target," and "original," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in sequences other than those illustrated or described herein. Furthermore, the terms "comprising," "having," and any variations thereof are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0042] Before introducing the embodiments of this application, a brief overview of HUD is provided. A HUD system mainly includes an image generator, an imaging optical path component, and an image display component. The image generator generates digital image signals (i.e., real images) containing point-of-interest (POI) information and converts these signals into light carrying image information. The image generator can be an optical engine made using Digital Light Processing (DLP) or Liquid Crystal on Silicon (LCOS) technology, including an illumination component and a projection component. The projection component can be a micro-projection lens. The imaging optical path component performs functions such as reflecting and projecting the real image. The image display component displays the virtual image; depending on the application scenario, the image display component will vary. When the application scenario is projecting a movie in a cinema, the image display component is a projection screen or display screen; when the application scenario is displaying driving information on a vehicle's windshield, the image display component is the vehicle's windshield. In this application, the image display component is the vehicle's windshield, used to display PIO information.

[0043] Figure 1 This is a first flowchart illustrating a method for displaying points of interest (POIs) according to an embodiment of this application. This embodiment is applicable to determining POI information of interest to a user while the user is driving a vehicle, and displaying the location and information of the POIs through the vehicle's windshield. The POI display method provided in this embodiment can be executed by the POI display device provided in this embodiment. This device can be implemented through software and / or hardware and integrated into the electronic device executing the method. Preferably, the electronic device in this embodiment can be a HUD, and the vehicle in this embodiment is equipped with a HUD.

[0044] See Figure 1 The method in this embodiment includes, but is not limited to, the following steps:

[0045] S110. Based on the collected vehicle location, determine candidate points of interest within a preset range from the vehicle.

[0046] In this embodiment, the vehicle may also have a positioning device, which may be a Global Positioning System (GPS), a Galileo satellite navigation system, a Russian GLONASS system, or a BeiDou satellite navigation system. This application does not limit the specific positioning device to this type.

[0047] The positioning device collects the vehicle's location in real time, such as latitude and longitude coordinates in the world coordinate system, and uploads the collected vehicle location to the HUD. The HUD determines candidate points of interest within a preset range of the vehicle based on its location.

[0048] Furthermore, based on the collected vehicle location, candidate points of interest (POIs) within a preset range from the vehicle are determined, including: the HUD maps the vehicle's location to the navigation map, determines the vehicle's corresponding position on the navigation map, obtains the first POI existing in a preset direction (such as the current surroundings of the vehicle) from the navigation map, and determines the latitude and longitude coordinates of the first POI, and can also determine the basic information of the first POI (such as name or category); constructs a vehicle coordinate system based on the vehicle's location, the latitude and longitude coordinates of the first POI, and the collected vehicle pose angle; determines the distance between the first POI and the vehicle in the vehicle coordinate system, and can also determine the coordinate data of the first POI in the vehicle coordinate system; and identifies the first POI within a preset range (such as 5 kilometers) as candidate POIs.

[0049] The specific process of constructing the vehicle coordinate system can be as follows: establish a coordinate system with the current location of the vehicle as the origin (for example, it can be a northeast-central coordinate system or other station-centered coordinate system), calculate the corresponding coordinate values ​​of each first point of interest in the coordinate system relative to the origin based on the latitude and longitude coordinates of each first point of interest, rotate the coordinate system according to the vehicle's pose angle based on the corresponding coordinate values, so that the vehicle's driving direction is the positive x-direction, thereby establishing the vehicle coordinate system.

[0050] Optionally, a pose sensor can also be installed in the vehicle to obtain the vehicle's pose angle.

[0051] S120. Select the target interest point with the highest priority from the candidate interest points.

[0052] In this embodiment, candidate points of interest within a preset range around the vehicle are determined through step S110. If there is only one candidate point of interest, it is directly determined as the target point of interest to be displayed. If there are multiple candidate points of interest, they need to be prioritized according to a priority strategy, and the point of interest with the highest priority is selected as the target point of interest to be displayed.

[0053] The priority strategy can be based on the distance from the vehicle, the user's preference, or other criteria.

[0054] S130. Determine the type of the target point of interest and the current distance between the target point of interest and the vehicle.

[0055] The types of target points of interest can include at least one or more of the following: restaurants, medical facilities, schools, accommodations, and shopping malls. Optionally, the navigation map can categorize all common points of interest according to their functions and represent them using a preset number of classification codes. The classification code mapping table for points of interest can be stored in a preset storage unit, as shown in Table 1 below.

[0056] Table 1. Classification Code Correspondence Table for Points of Interest

[0057] type Classification code Food and beverage 1100 Medical 1200

[0058] In this embodiment, the navigation map sends the classification code of the target point of interest to the HUD via the vehicle's infotainment system. The HUD receives the classification code and retrieves the classification code mapping table of the target point of interest from the preset storage unit to find the classification code of the target point of interest, thereby obtaining the type of the target point of interest. The current distance between the target point of interest and the vehicle changes in real time while the user is driving, and this distance can be obtained in real time through the vehicle's location and the navigation map.

[0059] S140. Determine the content to be displayed and the display format of the target point of interest based on the type and current distance, and display the content to be displayed through the windshield of the vehicle based on the display format.

[0060] In this embodiment of the application, after determining the type of the target point of interest and the current distance between the target point of interest and the vehicle in step S130, it is necessary to determine the content to be displayed for the target point of interest and the display format of the content. The content to be displayed may include animated videos, logos, or detailed information; the display format may include global animation, augmented reality (AR), or detailed information display.

[0061] Furthermore, the distance between the target point of interest and the vehicle is used as a condition for determining the display format. The current straight-line distance between the target point of interest and the vehicle is obtained from the navigation map, and a range judgment is made on the distance. If the distance between the current vehicle location and the target point of interest location is not within the appropriate range, the target point of interest will not be displayed; if the distance between the current vehicle location and the target point of interest location is within the appropriate range, the target point of interest will be displayed in the HUD, and will be refined into three different display formats based on the current distance between the target point of interest and the vehicle: global animation format, AR format, and information presentation format.

[0062] Specifically, the content to be displayed and the display format of the content to be displayed for the target point of interest are determined based on the type and the current distance. This includes: if the current distance is in the first region, the animation content corresponding to the type is determined, and the display format of the animation content is determined to be a global animation; if the current distance is in the second region, the logo pattern corresponding to the type is determined, and the display format of the logo pattern is determined to be AR; if the current distance is in the third region, the graphic and text information corresponding to the type is determined, and the display format of the graphic and text information is determined to be an information presentation format. Among these, compared with the distance to the target point of interest, the first region is farther than the second region, and the second region is farther than the third region.

[0063] like Figure 2 The diagram shows the display formats of the content to be displayed. The display format is determined based on the current distance between the target point of interest and the vehicle. When the user is driving, if the current distance is between 100m and 150m (i.e., the first area mentioned above), the target point of interest is displayed as a global animation; if the current distance is between 20m and 100m (i.e., the second area mentioned above), the target point of interest is displayed as an AR (Animation & Reality) display; and if the current distance is between 0m and 20m (i.e., the third area mentioned above), the target point of interest is displayed as an information presentation.

[0064] like Figure 3a This is a schematic diagram of a global animation. If the current distance is between 100m and 150m (i.e., the first area mentioned above), a global animation effect (such as a building model or special effect of the point of interest) corresponding to the type of the target point of interest will be played in the HUD display area. The building model or special effect of the point of interest is a model animation video created by 3D modeling technology. The animation video is bound to a range signal. Entering the first area will trigger this signal to play the animation video, thereby providing a preview prompt for the point of interest.

[0065] like Figure 3b This is an AR-style illustration. If the current distance is between 20m and 100m (i.e., the second area mentioned above), the content to be displayed is shown through the vehicle's windshield. This includes: determining the HUD identifier corresponding to the type of the target point of interest; obtaining the coordinate data of the target point of interest in the vehicle's coordinate system; determining the imaging position of the target point of interest in the windshield based on the coordinate data; and displaying the content to be displayed at the imaging position in the windshield. Specifically, the x and y coordinates of the target point of interest in the HUD display area are modified according to its real-time coordinates in the vehicle's coordinate system to ensure that the virtual image and the actual location of the point of interest in the external environment coincide in the driver's field of vision, allowing the user to observe the location information of the target point of interest in real time while driving.

[0066] Optionally, all common points of interest in daily life can be categorized by function, and identification patterns with their respective characteristics can be pre-set / made for each type of point of interest.

[0067] like Figure 3c This is a schematic diagram of the information presentation format. If the current distance is between 0m and 20m (i.e., the third area mentioned above), the display format will be changed to display detailed information about the point of interest, such as: sub-information of the building interior, merchant information of each floor of a shopping mall, and the image display position will no longer move with the actual coordinate position, but will be fixed in the left and right sides of the HUD display area.

[0068] The technical solution provided in this embodiment determines candidate points of interest (POIs) within a preset range from the vehicle's location; selects the highest-priority target POI from the candidate POIs; determines the type of the target POI and the current distance between the target POI and the vehicle; determines the content to be displayed for the target POI and its display format based on the type and current distance; and displays the content to be displayed through the vehicle's windshield based on the display format. This application determines candidate POIs by the vehicle's location and then selects the target POI most interesting to the user from the candidate POIs according to a preset priority strategy, ensuring the accuracy of the target POIs. By setting different display formats based on the distance between the vehicle and the target POI, and by determining the content to be displayed for the target POI based on its type and current distance, the information of the POIs can be displayed more intelligently, improving the user's driving experience.

[0069] The method for displaying points of interest provided in the embodiments of this application is further described below. Figure 4 This is a schematic diagram of the second process of a method for displaying points of interest provided in an embodiment of this application. This embodiment is an optimization based on the above embodiment, specifically an optimization of the process for determining the target points of interest (i.e., Figure 1 The corresponding embodiment will be explained in detail in step S120.

[0070] See Figure 4 The method in this embodiment includes, but is not limited to, the following steps:

[0071] S210. Determine whether the vehicle status and driver status meet the conditions for normal driving.

[0072] Vehicle status can include fuel level, battery level, and malfunction status. Driver status can include driving time and driver hunger. Normal driving conditions are necessary for safe driving, provided that both the vehicle and driver are in good condition.

[0073] In this embodiment, the vehicle may also have a driving assistance device, which may include an Advanced Driving Assistance System (ADAS) or other driving assistance systems. The driving assistance system acquires the vehicle and driver states, and then determines whether the vehicle and driver states meet normal driving conditions. In this step, normal driving conditions are used as the criterion, and the types of points of interest whose abnormal states can be resolved are set to the highest priority.

[0074] For example, if the current fuel level or battery level of the vehicle is less than a preset value, then the current vehicle status cannot meet the user's driving needs; if the user's driving time exceeds a preset value, which is likely to cause fatigue driving, then the current driver status cannot perform safe driving.

[0075] S220. If the vehicle status does not meet the normal driving conditions, then the second point of interest is determined as the target point of interest.

[0076] The second point of interest includes at least one of gas stations, charging stations, and repair stations.

[0077] In this embodiment of the application, when a vehicle experiences insufficient fuel, insufficient battery, or a malfunction, it is determined that the current vehicle status does not meet the conditions for normal driving. In this case, the priority of points of interest such as gas stations, charging stations, or repair stations is changed to the highest priority, i.e., they are identified as target points of interest.

[0078] S230. If the driver's condition does not meet the normal driving conditions, then the third point of interest is determined as the target point of interest.

[0079] The third point of interest includes at least one of the following: rest stops, service stations, and public restrooms.

[0080] In this embodiment of the application, when a driver experiences situations such as driving for too long, hunger, or an urgent need to use the restroom, it is determined that the current driver status does not meet the conditions for normal driving. In this case, the priority of points of interest such as rest stops, service stations, or public restrooms is changed to the highest priority, i.e., they are identified as target points of interest.

[0081] Ideally, physical buttons or virtual buttons can be pre-set so that users can actively trigger the selection of rest stops, service stations, or public restrooms as target points of interest.

[0082] S240. If the vehicle status and driver status meet the normal driving conditions, determine whether the distance difference between each candidate point of interest and the vehicle is greater than the preset value.

[0083] In this embodiment of the application, when the vehicle and driver are in good condition and the normal driving conditions are met, the distance between each candidate point of interest and the vehicle is judged, the distance between each candidate point of interest and the vehicle is calculated in turn, the difference between the maximum distance and the minimum distance is calculated, and the relationship between the difference and the preset value is judged.

[0084] S250, if greater than, then the candidate point of interest closest to the vehicle is determined as the target point of interest.

[0085] In this embodiment, if the difference between the maximum and minimum distances is greater than a preset value, meaning the distances between the candidate points of interest and the vehicle vary significantly, then the candidate point of interest corresponding to the minimum distance is determined as the target point of interest. In this step, the distance to the vehicle is used as the criterion; the closer a candidate point of interest is to the vehicle, the higher its priority.

[0086] S260. If it is not greater than, then determine the demand degree of each candidate point of interest, and determine the point of interest with the highest demand degree as the target point of interest.

[0087] In this embodiment, if the difference between the maximum and minimum distances is not greater than a preset value (i.e., the distances between each candidate point of interest and the vehicle are roughly the same), then the demand level of each candidate point of interest is determined, and the point of interest with the highest demand level is identified as the target point of interest. In this step, the user's demand level is used as the criterion; the higher the demand level of a candidate point of interest, the higher its priority.

[0088] Optionally, multiple samples of drivers' demand levels for points of interest can be collected in advance, and these samples can be organized to select the sorting method that satisfies most drivers as the default sorting standard. Alternatively, drivers can pre-modify their demand levels for each type of point of interest using a HUD configuration file before driving. The HUD system will then use software logic to prioritize the display based on the driver's demand level for that type of point of interest, with higher demand levels resulting in higher priority.

[0089] Furthermore, after determining the demand level of each candidate point of interest, the process also includes: determining the number of points of interest with the highest demand level; if the number is one, then the operation of determining the point of interest with the highest demand level as the target point of interest is performed; if the number is not one, then the point of interest with the highest demand level that is closest to the vehicle is determined as the target point of interest. Finally, after sorting by the above scheme, the candidate point of interest with the highest priority level is selected as the target point of interest to be displayed.

[0090] The technical solution provided in this embodiment determines whether the vehicle and driver states meet normal driving conditions. If the vehicle state does not meet normal driving conditions, a second point of interest (POI) is designated as the target POI. If the driver state does not meet normal driving conditions, a third POI is designated as the target POI. If both the vehicle and driver states meet normal driving conditions, the distance difference between each candidate POI and the vehicle is determined to be greater than a preset value. If it is greater, the candidate POI closest to the vehicle is designated as the target POI. If it is not greater, the demand level of each candidate POI is determined, and the POI with the highest demand level is designated as the target POI. This application uses a priority strategy based on normal driving conditions, distance from the vehicle, and user demand level to filter the target POIs most interesting to the user, ensuring the accuracy of the target POIs and enabling more intelligent display of POI information, thereby improving the user's driving experience.

[0091] Figure 5 This is a schematic diagram of the structure of a point-of-interest display device provided in an embodiment of this application, such as... Figure 5 As shown, the device 500 may include:

[0092] The point of interest determination module 510 is used to determine candidate points of interest within a preset range of the vehicle based on the collected vehicle's location.

[0093] The interest point filtering module 520 is used to select the target interest point with the highest priority from the candidate interest points;

[0094] The information determination module 530 is used to determine the type of the target point of interest and the current distance between the target point of interest and the vehicle;

[0095] The point of interest display module 540 is used to determine the content to be displayed for the target point of interest and the display format of the content to be displayed based on the type and the current distance, and to display the content to be displayed through the windshield of the vehicle based on the display format.

[0096] Furthermore, the aforementioned point of interest determination module 510 can be specifically used to: obtain a first point of interest in a preset direction of the vehicle from the navigation map based on the vehicle's position, and determine the latitude and longitude coordinates of the first point of interest; construct a vehicle coordinate system based on the vehicle's position, the latitude and longitude coordinates of the first point of interest, and the collected pose angle of the vehicle; determine the distance between the first point of interest and the vehicle in the vehicle coordinate system; and determine the first point of interest whose distance is within a preset range as the candidate point of interest.

[0097] Furthermore, the aforementioned point of interest display module 540 can be specifically used for: if the current distance is within a first region, determining the animation content corresponding to the type, and determining that the display form of the animation content is a global animation; if the current distance is within a second region, determining the identification pattern corresponding to the type, and determining that the display form of the identification pattern is an augmented reality (AR) form; if the current distance is within a third region, determining the graphic information corresponding to the type, and determining that the display form of the graphic information is an information presentation form; wherein, the first region is farther than the second region, and the second region is farther than the third region.

[0098] Furthermore, the aforementioned point of interest display module 540 can be specifically used to: when the current distance is within the second region, acquire the coordinate data of the target point of interest in the vehicle body coordinate system, determine the imaging position of the target point of interest in the windshield based on the coordinate data, and display the content to be displayed at the imaging position in the windshield based on the display format.

[0099] Furthermore, the aforementioned point of interest filtering module 520 can be specifically used to: determine whether the vehicle status and driver status meet normal driving conditions; if they do, determine whether the distance difference between each candidate point of interest and the vehicle is greater than a preset value; if not, determine the demand degree of each candidate point of interest, and determine the point of interest with the highest demand degree as the target point of interest.

[0100] Furthermore, the aforementioned point of interest filtering module 520 can be specifically used to: after determining whether the vehicle status and driver status meet normal driving conditions, if the vehicle status does not meet normal driving conditions, then a second point of interest is determined as the target point of interest, the second point of interest including at least one of a gas station, a charging station, and a repair station; if the driver status does not meet normal driving conditions, then a third point of interest is determined as the target point of interest, the third point of interest including at least one of a rest stop, a service station, and a public restroom.

[0101] Furthermore, the aforementioned point of interest filtering module 520 can be specifically used to: after determining whether the distance difference between each candidate point of interest and the vehicle is greater than a preset value, if it is greater, then determine the candidate point of interest closest to the vehicle as the target point of interest.

[0102] Furthermore, the aforementioned point of interest filtering module 520 can be specifically used to: after determining the demand degree of each of the candidate points of interest, determine the number of points of interest with the highest demand degree; if the number is one, then perform the operation of determining the point of interest with the highest demand degree as the target point of interest; if the number is not one, then determine the point of interest with the highest demand degree that is closest to the vehicle as the target point of interest.

[0103] The point-of-interest display device provided in this embodiment can be applied to the point-of-interest display method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0104] Figure 6 This is a block diagram of an electronic device used to implement a method for displaying points of interest according to embodiments of this application. The electronic device 10 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present application described and / or claimed herein.

[0105] like Figure 6 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12 or a random access memory (RAM) 13, communicatively connected to the at least one processor 11. The memory stores computer programs executable by the at least one processor. The processor 11 can perform various appropriate actions and processes based on the computer program stored in the ROM 12 or loaded from storage unit 18 into the RAM 13. The RAM 13 may also store various programs and data required for the operation of the electronic device 10. The processor 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0106] Multiple components in electronic device 10 are connected to I / O interface 15, including: input unit 16, such as keyboard, mouse, etc.; output unit 17, such as various types of displays, speakers, etc.; storage unit 18, such as disk, optical disk, etc.; and communication unit 19, such as network card, modem, wireless transceiver, etc. Communication unit 19 allows electronic device 10 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0107] Processor 11 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 11 performs the various methods and processes described above, such as the point-of-interest display method.

[0108] In some embodiments, the point-of-interest (POI) display method may be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the POI display method described above may be performed. Alternatively, in other embodiments, processor 11 may be configured to perform the POI display method by any other suitable means (e.g., by means of firmware).

[0109] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0110] Computer programs used to implement the methods of this application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0111] In the context of this application, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0112] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0113] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0114] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0115] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

[0116] The specific embodiments described above do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A method for displaying points of interest, characterized in that, The method includes: Based on the collected vehicle location, candidate points of interest within a preset range of the vehicle are determined; Selecting the highest priority target interest point from the candidate interest points includes: determining whether the vehicle status and driver status meet normal driving conditions; if they do, determining whether the distance difference between each candidate interest point and the vehicle is greater than a preset value; if not, determining the demand degree of each candidate interest point, and determining the interest point with the highest demand degree as the target interest point. Determine the type of the target point of interest and the current distance between the target point of interest and the vehicle; Based on the type and the current distance, the content to be displayed for the target point of interest and the display format of the content to be displayed are determined, and the content to be displayed is displayed through the windshield of the vehicle based on the display format.

2. The method for displaying points of interest according to claim 1, characterized in that, The step of determining candidate points of interest within a preset range of the vehicle based on the collected vehicle location includes: Based on the vehicle's location, a first point of interest is obtained from the navigation map in a preset direction of the vehicle, and the latitude and longitude coordinates of the first point of interest are determined. A vehicle coordinate system is constructed based on the vehicle's position, the latitude and longitude coordinates of the first point of interest, and the collected vehicle pose angles. Determine the distance between the first point of interest and the vehicle in the vehicle coordinate system; The first point of interest whose distance is within the preset range is determined as the candidate point of interest.

3. The method for displaying points of interest according to claim 2, characterized in that, The process of determining the content to be displayed for the target point of interest and the display format of the content to be displayed based on the type and the current distance includes: If the current distance is within the first region, then the animation content corresponding to the type is determined, and the display format of the animation content is determined to be a global animation. If the current distance is within the second region, then the corresponding identification pattern for the type is determined, and the display form of the identification pattern is determined to be augmented reality (AR). If the current distance is within the third region, then the graphic and text information corresponding to the type is determined, and the display format of the graphic and text information is determined to be an information presentation format; The first region is farther than the second region, and the second region is farther than the third region.

4. The method for displaying points of interest according to claim 3, characterized in that, When the current distance is within the second area, displaying the content to be displayed through the vehicle's windshield based on the display format includes: Acquire the coordinate data of the target point of interest in the vehicle coordinate system, and determine the imaging position of the target point of interest in the windshield based on the coordinate data; The content to be displayed is shown at the imaging position in the windshield based on the aforementioned display format.

5. The method for displaying points of interest according to claim 1, characterized in that, After determining whether the vehicle status and driver status meet the normal driving conditions, the process also includes: If the vehicle status does not meet the normal driving conditions, then the second point of interest is determined as the target point of interest, and the second point of interest includes at least one of a gas station, a charging station, and a repair station; If the driver's condition does not meet the normal driving conditions, then the third point of interest is determined as the target point of interest, which includes at least one of a rest stop, service station, and public restroom.

6. The method for displaying points of interest according to claim 1, characterized in that, After determining whether the distance difference between each candidate point of interest and the vehicle is greater than a preset value, the method further includes: If the value is greater than the target value, the candidate point of interest closest to the vehicle is determined as the target point of interest.

7. The method for displaying points of interest according to claim 1, characterized in that, After determining the demand for each of the candidate points of interest, the method further includes: Determine the number of points of interest with the highest demand. If the quantity is one, then the operation of determining the interest point with the highest demand as the target interest point is performed; If the number is not one, then the interest point closest to the vehicle among the interest points with the highest demand is determined as the target interest point.

8. A device for displaying points of interest, characterized in that, The device includes: The point of interest determination module is used to determine candidate points of interest within a preset range of the vehicle based on the collected vehicle's location. The point of interest filtering module is used to select the target point of interest with the highest priority from the candidate points of interest; The information determination module is used to determine the type of the target point of interest and the current distance between the target point of interest and the vehicle; The point of interest display module is used to determine the content to be displayed for the target point of interest and the display format of the content to be displayed based on the type and the current distance, and to display the content to be displayed through the windshield of the vehicle based on the display format. Specifically, the point of interest (POI) filtering module is used to determine whether the vehicle status and driver status meet the normal driving conditions; if they do, it determines whether the distance difference between each candidate POI and the vehicle is greater than a preset value; if not, it determines the demand degree of each candidate POI and identifies the POI with the highest demand degree as the target POI.

9. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to enable the at least one processor to perform the point of interest display method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method for displaying points of interest as described in any one of claims 1 to 7.

Images