Lane change prompting method, device, electronic equipment and vehicle
By obtaining and analyzing driving road information, determining the timing of lane change in real time and sending prompts, the existing navigation system solves the problem of lane change miss caused by unfamiliar roads, and improves the accuracy and safety of lane change.
Patent Information
- Application Number
- CN202211331707.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-27
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-10-27
AI Technical Summary
The existing driving navigation system only sends lane change prompts when it is about to reach an intersection, causing the driver to miss the opportunity to enter the target lane, especially on unfamiliar roads, and traffic may be triggered by misjudgment and tension in human judgment. ACCIDENT.
By obtaining driving road information, we can determine whether there is a lane change demand, obtain the target road conditions and driving information in real time, automatically determine the lane change timing, and send lane change prompt information at the right time to help the driver perform lane change operations at the right time.
The lane change preparation time is shortened, and the risk of misjudgment caused by driver experience and observation errors is avoided, ensuring that the driver can enter the target lane smoothly, and reducing the probability of traffic accidents.
Smart Images

Figure CN115662171B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle technology, and in particular to a lane change prompt method, device, electronic equipment and vehicle. Background Art
[0002] Existing driving navigation will automatically plan the driving route according to the departure and destination, and remind the driver to turn or continue to go straight when approaching the intersection. However, for unfamiliar roads, the driver may not be able to change lanes in time after the navigation reminder, thus missing the opportunity to enter the target lane. Summary of the invention
[0003] In view of this, the purpose of the present application is to propose a lane change reminder method, device, electronic device and vehicle to solve the problem that the driver does not have time to change lanes and misses the opportunity to enter the target lane due to failure to send a lane change reminder at an appropriate time.
[0004] Based on the above purpose, the first aspect of the present application provides a lane change prompt method, comprising:
[0005] Obtain driving road information;
[0006] Based on the driving road information, determine whether there is a need to change lanes;
[0007] When the vehicle has the lane change requirement, obtaining the road condition and driving information of the target lane in real time;
[0008] Based on the road condition and driving information of the target lane, determining whether a lane change opportunity has arrived;
[0009] When the lane change opportunity arrives, a lane change prompt message is sent.
[0010] Based on the same concept, the second aspect of the present application provides a lane change prompting device, including:
[0011] an acquisition module, configured to acquire driving road information; and further configured to acquire the target lane road condition and driving information in real time when the vehicle has the lane change requirement;
[0012] a determination module configured to determine whether there is a lane change requirement based on the driving road information;
[0013] a timing judgment module, configured to judge whether a lane change timing has been reached based on the road condition and driving information of the target lane;
[0014] The prompt module is configured to send a lane change prompt message when the lane change opportunity arrives.
[0015] Based on the same concept, the third aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first aspect is implemented.
[0016] Based on the same concept, the fourth aspect of the present application provides a vehicle, including the electronic device as described in the third aspect.
[0017] As can be seen from the above, the lane change prompt method, device, electronic device and vehicle provided by the present application obtain the driving road information and judge whether there is a lane change demand based on the driving road information, so that the judgment process of the lane change timing is only started when there is a lane change demand, which helps to save computing resources and memory resources. When there is a lane change demand, the target lane road condition and driving information are obtained in real time, and the position and driving conditions of other vehicles on the target lane and the current position and driving conditions of the vehicle are known. Compared with the driver manually performing the above operations, the lane change preparation time is greatly shortened. Through the target lane road condition and driving information, the present application can automatically judge whether the lane change time has arrived. Compared with the driver's manual judgment, on the one hand, it can avoid the risk of misjudgment caused by factors such as driver experience and observation errors, and on the other hand, it also greatly shortens the lane change preparation time. Sending lane change prompt information when the lane change opportunity arrives can enable the driver to perform lane change operations at an appropriate time according to the lane change prompt information, so as to smoothly enter the target lane. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0019] Figure 1 A schematic diagram of a process flow of a lane change prompting method according to an embodiment of the present application;
[0020] Figure 2 A schematic diagram of a process for determining whether there is a lane change requirement in a lane change prompt method according to an embodiment of the present application;
[0021] Figure 3 A schematic diagram of a process for determining the current lane in the lane change prompting method according to an embodiment of the present application;
[0022] Figure 4 A schematic diagram of a process for determining a target lane in a lane change prompting method according to an embodiment of the present application;
[0023] Figure 5 , Figure 6, Figure 7 , Figure 8 and Fig. 9 A schematic diagram of determining the current lane in the lane change prompting method according to an embodiment of the present application;
[0024] Fig.10 A schematic diagram of lane changing in a non-congested state in the lane changing prompt method according to an embodiment of the present application;
[0025] Fig.11 A schematic diagram of lane changing in congestion in the lane changing prompt method of an embodiment of the present application;
[0026] Fig.12 and Fig.13 A schematic diagram of two lane changes during congestion in the lane change prompt method of an embodiment of the present application;
[0027] Fig.14 and Fig.15 A schematic diagram of two lane changes in a non-congested state in the lane change prompt method in an embodiment of the present application;
[0028] Fig.16 A schematic diagram of a lane change prompting device according to an embodiment of the present application;
[0029] Fig.17 A schematic diagram of a determination module of a lane change prompting device according to an embodiment of the present application;
[0030] Fig.18 A schematic diagram of a first determination unit of a lane change prompting device according to an embodiment of the present application;
[0031] Fig.19 A schematic diagram of a second determination unit of the lane change prompting device according to an embodiment of the present application;
[0032] Fig. 20 It is a schematic diagram of the hardware structure of an electronic device;
[0033] Fig.21 A schematic diagram of a lane change prompt device in a vehicle according to an embodiment of the present application;
[0034] Fig. 22 A flowchart of a lane change prompt method according to an embodiment of the present application is provided. DETAILED DESCRIPTION
[0035] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.
[0036] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0037] As described in the above background technology section, if a left turn is required at the next intersection in the direction of the vehicle's travel, but the driver is not familiar with the road, he will not consciously change lanes to the left when he is far away from the intersection so as to enter the left turn lane in advance. Usually, after the navigation issues a prompt such as "turn left at the next intersection", he will observe the type of lane in front, such as the current lane is a lane that can only go straight, and entering the left turn lane requires at least one left lane change. At this time, if there are fewer vehicles around, there is still a chance to change lanes and enter the left turn lane; if there are more vehicles around or the response is not timely, it is likely that in order to wait for the opportunity to change lanes, the driver will stop and occupy the road, causing traffic congestion, or miss the opportunity to enter the left turn lane and need to re-plan the route, resulting in a detour (such as the vehicle has entered the part of the lane line that is a solid line, and it cannot change lanes at this time).
[0038] At the same time, since the navigation in the relevant technology will only issue a prompt when it is about to reach an intersection, if two or more lane changes are required to enter the target lane, and there are many vehicles at the intersection, it is likely that the driver will become nervous, impatient and have negative psychological emotions due to time constraints, which can easily cause traffic accidents.
[0039] Through the above research, the applicant found that in order to ensure that the driver can drive the vehicle smoothly from the non-target lane into the target lane, the timing of sending the lane change prompt information is crucial. If the lane change prompt information can be sent to the driver at the appropriate time, the driver can easily grasp the opportunity to change lanes and smoothly enter the target lane.
[0040] In view of this, if Figure 1 and Fig. 22 As shown, the embodiment of the present application proposes a lane change prompt method, including:
[0041] Step S101, obtaining driving road information.
[0042] Exemplarily, the driving road information may include relevant image information or data information of the vehicle's current road and the road it is about to travel, etc., which can be obtained in real time by shooting and detecting by on-board cameras, sensors installed on the vehicle or other monitoring devices, or by information transmission by terminals such as mobile phones and on-board computers (ECU) (for example, from navigation and other application software).
[0043] Step S102: determining whether there is a lane change requirement based on the driving road information.
[0044] In order to determine the appropriate time to change lanes, it is necessary to first determine whether the driver has a need to change lanes through the driving road information. If there is no need to change lanes, the driver will not be reminded to change lanes, and the process of determining the time to change lanes will not be carried out.
[0045] Step S103: When the vehicle has the lane change requirement, the road condition and driving information of the target lane are acquired in real time.
[0046] The traffic conditions of the target lane include congestion and non-congestion, which can be obtained through navigation. Usually, the navigation will judge the traffic conditions of each section according to the current traffic flow and output the judgment result. When there are many vehicles on the lane and the driving is relatively slow, the judgment result is congestion, such as Fig.11 When there are fewer vehicles on the lane and the driving is smoother, the judgment result is non-congestion, such as Fig.10 .
[0047] Driving information can be obtained through sensors installed on the vehicle, such as distance sensors installed on the front, rear and both sides of the vehicle. Through the distance sensors, the driver can know the position of other vehicles or obstacles around the vehicle, and the distance between them and the vehicle.
[0048] For example, when one lane change is required to travel from the current lane to the target lane, the road condition and driving information of the target lane can be directly obtained. When two or more lane changes are required to travel from the current lane to the target lane, the action of traveling from the current lane to the target lane can be divided into multiple lane change processes according to the number of lane changes. In each lane change process, the vehicle enters a lane adjacent to the current lane and facing the target lane from the current lane until it finally enters the target lane. At this time, the road condition and driving information are the road condition and driving information of the lane to be entered in each lane change process.
[0049] The process of obtaining the target lane's road condition and driving information in real time is to observe the positions and driving conditions of other vehicles in the target lane, as well as the current position and driving conditions of the vehicle. Compared with the prior art, in this embodiment, the above process no longer requires manual operation by the driver, which greatly shortens the lane change preparation time.
[0050] Step S104: determining whether a lane change opportunity has been reached based on the target lane condition and driving information.
[0051] The process of judging whether the time to change lanes has arrived based on the road condition and driving information of the target lane is the process of selecting and determining the appropriate time to change lanes. In the prior art, this process is manually judged by the driver after the above observations combined with his own driving experience. In this embodiment, the above process no longer requires manual judgment by the driver, which can avoid the risk of misjudgment due to factors such as driver experience and observation errors, and greatly shorten the lane change preparation time.
[0052] Step S105, when the lane change opportunity arrives, send a lane change prompt message.
[0053] Exemplarily, the lane change prompt information may be one or more combinations of text information, voice information, image information, animation information and light information.
[0054] When the time to change lanes arrives, a lane change prompt message is immediately sent to the driver so that the driver can change lanes at this time, eliminating the need for the driver to manually observe the vehicle conditions in the target lane and look for lane change opportunities.
[0055] The lane change prompt method provided in this embodiment obtains the driving road information and determines whether there is a lane change demand based on the driving road information, so that the judgment process of the lane change timing is only started when there is a lane change demand, which helps to save computing resources and memory resources. When there is a lane change demand, the target lane road condition and driving information are obtained in real time, and the positions and driving conditions of other vehicles on the target lane and the current position and driving conditions of the vehicle are known. Compared with the driver manually performing the above operations, the lane change preparation time is greatly shortened. Through the target lane road condition and driving information, this embodiment can automatically determine whether the lane change timing has arrived. Compared with the driver's manual judgment, on the one hand, it can avoid the risk of misjudgment caused by factors such as driver experience and observation errors, and on the other hand, it also greatly shortens the lane change preparation time. Sending lane change prompt information when the lane change timing arrives can enable the driver to perform lane change operations at an appropriate time according to the lane change prompt information, so as to smoothly enter the target lane.
[0056] In some embodiments, the driving road information includes lane image information, lane number information and a planned driving route.
[0057] Lane image information refers to image information related to the lane where the vehicle is located, which can be obtained by photographing a vehicle-mounted camera installed on the vehicle. The vehicle-mounted camera can be installed at the front of the vehicle, the rear of the vehicle, or around the vehicle body. In some embodiments, the vehicle-mounted camera is part of the vehicle intelligent driving system, and the vehicle intelligent driving system obtains lane image information such as lane line type information or lane type information through the vehicle-mounted camera.
[0058] The lane number information refers to the number of motor vehicle lanes included in the road along the vehicle travel direction (single direction), such as two lanes, four lanes, five lanes, etc. For example, the lane number information can be obtained through a navigation system or an in-vehicle navigation system (hereinafter referred to as navigation system) that is connected to the vehicle in communication.
[0059] The planned driving route refers to the driving route from the current location to the target location or from the designated location to the target location, and the driving route is planned according to rules, which can be set by the navigation system or manually set by the user. For example, there are three different driving routes from the current location to the target location. When determining the driving route, the driving route with the shortest distance recommended by the navigation system can be selected as the planned driving route, or the driving route with smoother driving can be selected as the planned driving route based on the user's driving experience.
[0060] like Figure 2 As shown, step S102 includes:
[0061] Step S201, determining the current lane in which the vehicle is traveling based on the lane image information and the lane number information.
[0062] The reason why a vehicle has a lane change requirement is first because the road the vehicle is traveling on has two or more lanes to choose from. Since there is more than one lane, it is necessary to first determine which lane the vehicle is currently traveling in.
[0063] Step S202: determining a target lane based on the planned driving route and the lane image information.
[0064] After the current lane of the vehicle is determined, the target lane can be determined.
[0065] Step S203, comparing the current lane and the target lane to see whether they are the same lane.
[0066] Step S204: In response to the current lane and the target lane being different lanes, the vehicle has the lane change requirement.
[0067] After determining the current lane and the target lane, the intelligent driving system can compare the two. If the two are in the same lane, it is determined that there is no need to change lanes. If the two are in different lanes, it is determined that there is a need to change lanes. Of course, when the comparison result shows that there is a need to change lanes, the number of lane changes can also be obtained at the same time. Figure 5 Take the five lanes in the example as an example. If the current lane is the middle lane and the target lane is the first lane on the right, then you need to change lanes to the right twice to get from the current lane to the target lane. If the current lane is the right edge lane and the target lane is the first lane on the right, then you need to change lanes to the right once to get from the current lane to the target lane.
[0068] The purpose of lane changing is to make the vehicle drive in the target lane. Therefore, the determination of the current lane and the target lane is the basis for judging whether there is a need to change lanes. By comparing and judging the current lane and the target lane, it can be known whether the vehicle needs to change lanes.
[0069] In some embodiments, Figure 3 As shown, step S201 includes:
[0070] Step S301, identifying the line type information of the lane line according to the acquired lane image information.
[0071] The lane image information may be a static or dynamic image, and the line type information of the lane line in the image can be identified by, for example, an intelligent driving system. The lane line is a marking line formed on both sides of the lane on the road surface, and the marking line includes a solid line (such as a single solid line or a double solid line) or a dotted line, etc. In the related art, a solid line indicates that the vehicle cannot cross during normal driving, such as between a non-motor vehicle lane and a motor vehicle lane, and between the current driving direction and the opposite direction. It can be seen that, when not at an intersection, a solid line is often used to indicate the left and right edges of the motor vehicle lane in the current driving direction. Of course, in some roads, the left and right edges of the motor vehicle lane are also indicated by the roadbed. In this embodiment, both the roadbed and the solid line indicate that the vehicle cannot cross during normal driving.
[0072] The dotted line indicates that the vehicle can cross it during normal driving, that is, the vehicle can cross the dotted line from the current lane to the adjacent lane, that is, change lanes. In other words, the dotted line is often used to divide different lanes in the motor vehicle lane in the current driving direction.
[0073] Step S302: determining the corresponding current lane based on the different line type information.
[0074] The line type information includes a second line type corresponding to the edge lane line, ie, the solid line and roadbed mentioned above.
[0075] like Figure 5 , Figure 6 , Figure 7, Figure 8 and Fig. 9 As shown, an on-board camera capable of acquiring four lane lines is used as an example for explanation, and the acquired four lane lines are respectively a first lane line 1 adjacent to the left side of the vehicle, a second lane line 2 adjacent to the right side of the vehicle, a third lane line 3 adjacent to the left side of the first lane line 1, and a fourth lane line 4 adjacent to the right side of the second lane line 2. The first lane line 1 and the second lane line 2 form the current lane where the vehicle is located, while the third lane line 3 and the first lane line 1 form the left lane adjacent to the current lane, and the fourth lane line 4 and the second lane line 2 form the right lane adjacent to the current lane.
[0076] When the recognized line type information of the first lane line 1 or the second lane line 2 adjacent to the vehicle is the second line type, the edge lane is used as the current lane.
[0077] For example, Figure 5 As shown, when the intelligent driving system recognizes that the line type information of the first lane line 1 is a solid line or a roadbed, it can be determined that the vehicle is traveling in the first lane on the left among the five lanes, that is, the current lane is the left edge lane.
[0078] For example, Figure 6 As shown, when the line type information of the second lane line 2 is identified as a solid line or a roadbed, it can be determined that the vehicle is traveling in the first lane on the right among the five lanes, that is, the current lane is the right edge lane.
[0079] When the line type information of the third lane line 3 or the fourth lane line 4 identified as being spaced apart from the vehicle is the second line type, the edge spacing lane is used as the current lane; wherein the edge spacing lane is a lane spaced apart from the edge lane.
[0080] For example, Figure 7 As shown, when the intelligent driving system recognizes that the line type information of the third lane line 3 is a solid line or a roadbed, it can be determined that the left lane adjacent to the current lane is the left edge lane, and the current lane is the second lane on the left among the five lanes, that is, the left edge interval lane.
[0081] For example, Figure 8 As shown, when the line type information of the fourth lane line 4 is identified as a solid line or a roadbed, it can be determined that the right lane adjacent to the current lane is the right edge lane, and the current lane is the second lane on the right among the five lanes, that is, the right edge interval lane.
[0082] The line type information includes a first line type corresponding to the middle lane line, that is, the above-mentioned dotted line.
[0083] When the line type information of all recognized lane lines is the first line type, the middle lane is used as the current lane.
[0084] For example, Fig. 9 As shown, when the intelligent driving system recognizes that there are no solid lines or roadbeds in the acquired first lane line 1, second lane line 2, third lane line 3 and fourth lane line 4, but they are all dotted lines, it can be determined that the current lane, the left lane and the right lane adjacent to the current lane are not edge lanes, that is, the current lane is the middle lane among the five lanes.
[0085] The linear information of the lane line is information that is closely related to the lane and is reliable. The above method can accurately determine the relative position of the current lane on the road based on the linear information.
[0086] In some embodiments, Figure 4 As shown, step S202 includes the following:
[0087] Step S401, determining the driving action at the next intersection location according to the planned driving route.
[0088] After the planned driving route is selected, the locations of multiple intersections included in the planned driving route and the driving actions of the vehicle after it reaches each intersection are also determined. The driving action is to turn left, turn right or continue to go straight when the vehicle reaches the intersection so that the vehicle enters the next section of the planned driving route.
[0089] Step S402: determining the lane type of each lane according to the lane image information.
[0090] In addition to being able to identify the lane line information in the image, the intelligent driving system can also determine the lane type of the lane by identifying the guide arrow in the lane. For example, if the guide arrow in the lane indicates straight ahead, the lane type of the lane is a straight ahead lane. For another example, if the guide arrow in the lane indicates a left turn, the lane type of the lane is a left turn and U-turn (change of driving direction) lane. For another example, if the guide arrow in the lane indicates a straight ahead and a right turn, the lane type of the lane is a right turn and straight ahead lane.
[0091] Step S403: determine a lane type that matches the driving action, and use the lane corresponding to the lane type as the target lane.
[0092] After the intelligent driving system determines the driving action and lane type of the next intersection along the driving direction of the vehicle, it can determine the target lane. For example, according to the planned driving route, the vehicle needs to turn left at the next intersection, and the driving action of the vehicle at the intersection is to turn left. In this case, the vehicle needs to enter the left turn lane or the left turn through lane or other lanes that allow left turns in advance before driving to the intersection. In this case, the lane type that allows left turns, such as the left turn lane or the left turn through lane, is the target lane of the vehicle at the intersection.
[0093] The planned driving route is a route that meets the driver's driving needs. In order for the vehicle to travel along the route, corresponding driving actions need to be performed at each intersection. The process of determining the target lane is the basis for guiding the vehicle into the target lane and performing driving actions in the target lane. Since the lane image information is reliable and accurate information, the target lane determined by the lane image information is accurate and reliable and meets the driver's driving needs.
[0094] In some embodiments, the driving information includes a free distance in the target lane; step S104 includes, when the target lane is in congested condition and the free distance is greater than a first preset distance, the opportunity to change lanes has arrived.
[0095] like Fig.11 , the free distance in the target lane is the distance a between the front of the vehicle and the rear of the first vehicle 5 closest to the target lane, and the distance b between the rear of the vehicle and the front of the second vehicle 6 closest to the target lane, obtained by the distance sensor. Of course, there is no other vehicle between the first vehicle 5 and the second vehicle 6. In addition, the free distance can also represent the distance c between the first vehicle closest to the front of the vehicle and the second vehicle closest to the rear of the vehicle in the target lane. Similarly, there is no other vehicle between the first vehicle 5 and the second vehicle 6.
[0096] When the free distance is greater than a first preset distance (the first preset distance can be set according to the length of the vehicle from the front to the rear before obtaining lane image information, lane number information and planning the driving route), it means that the vehicle can enter the space within the free distance, that is, it can enter the target lane through the free distance to complete the lane change. Because the traffic condition of the target lane is congested at this time, there are many other vehicles in the target lane, and the opportunities that meet the above situation are rare. Therefore, as long as the free distance is greater than the first preset distance, it means that the right time to change lanes has been reached. Immediately send a lane change reminder message to help the driver grasp the opportunity to change lanes, such as Fig.12 and Fig.13 shown.
[0097] In some embodiments, the driving information includes the free distance in the target lane, the first lane change distance, the driving speed of the vehicle, and the number of lane changes from the current lane to the target lane; wherein the first lane change distance is the distance between the vehicle and the adjacent intersection ahead along the direction of travel. Step S104 includes determining a prompt distance based on the driving speed and the number of lane changes when the target lane is in a non-congested road condition, and when the free distance is greater than a first preset distance and the first lane change distance is equal to the prompt distance, the lane change opportunity arrives.
[0098] like Fig.10The first lane change distance may be the distance d between the front of the vehicle and the stop line 7 of the adjacent intersection in the front along the traveling direction. When the vehicle passes the stop line 7, it is necessary to perform the driving action at the intersection. Therefore, the vehicle needs to complete the lane change in advance before the stop line 7 and enter the target lane that matches the driving action.
[0099] Exemplarily, the calculation formula of the prompt distance is:
[0100] L=v*0.28*X
[0101] In the formula, L is the warning distance in meters; v is the current speed of the vehicle in kilometers per hour; 0.28 is the unit conversion configuration parameter, and X is the configurable time parameter in seconds. Among them, X = n*15, where n is the number of lane changes from the current lane to the target lane.
[0102] For example, Fig.14 , when the traffic condition of the target lane is non-congested and the free distance of the target lane is greater than the first preset distance. The vehicle speed is 60km / h at this time, and the vehicle needs to change lanes twice from the current lane to the target lane (right edge lane). Then, according to the above formula, the configurable time parameter X=2*15=30 and the prompt distance L=60*0.28*30=504 are calculated, that is, the lane change prompt information is immediately sent when the vehicle is 504m away from the stop line of the intersection to remind the driver to make the first lane change.
[0103] like Fig.15 After the first lane change is completed, the above calculation formula is recalculated. At this time, the vehicle needs to change lanes once to enter the target lane. The configurable time parameter X=1*15=15, and the prompt distance L=60*0.28*15=252, that is, when the vehicle is 252m away from the stop line of the intersection, the lane change prompt information is immediately sent to remind the driver to make a second lane change.
[0104] Since the target lane is not congested at this time and there are few other vehicles in the target lane, the vehicle has multiple opportunities to change lanes and enter the target lane. This embodiment uses the above method to screen multiple opportunities based on the number of lane changes and the driving speed, and selects a more appropriate opportunity. When the opportunity arrives, a lane change prompt message is immediately sent to help the driver perform a lane change operation at a more appropriate time.
[0105] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.
[0106] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0107] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a lane change prompt device.
[0108] refer to Fig.16 and Fig.21 , the lane change prompting device comprises:
[0109] The acquisition module 801 is configured to acquire driving road information; and is also configured to acquire the target lane road condition and driving information in real time when the vehicle has the lane change demand.
[0110] The determination module 802 is configured to determine whether there is a lane change requirement based on the driving road information.
[0111] The timing judgment module 803 is configured to judge whether the lane change timing has arrived based on the road condition and driving information of the target lane.
[0112] The prompt module 804 is configured to send a lane change prompt message when the lane change opportunity arrives.
[0113] like Fig.17 In some embodiments, the determination module 802 includes:
[0114] The first determination unit 8021 is configured to determine the current lane in which the vehicle is traveling based on the lane image information and lane number information included in the driving road information.
[0115] The second determining unit 8022 is configured to determine a target lane based on the planned driving route included in the driving road information.
[0116] The judgment unit 8023 is configured to compare whether the current lane and the target lane are the same lane, and in response to the current lane and the target lane being different lanes, the vehicle has the lane change demand.
[0117] like Fig.18 In some embodiments, the first determining unit 8021 includes:
[0118] The identification subunit 80211 is configured to identify the line type information of the lane line based on the acquired lane image information.
[0119] The first processing sub-unit 80212 is configured to determine the corresponding current lane based on the different line type information.
[0120] like Fig.19 In some embodiments, the second determining unit 8022 includes:
[0121] The second processing sub-unit 80221 is configured to determine the driving action at the next intersection according to the planned driving route.
[0122] The third processing subunit 80222 is configured to determine the lane type of each lane according to the lane image information.
[0123] The fourth processing sub-unit 80223 is configured to determine a lane type that matches the driving action, and use the lane corresponding to the lane type as the target lane.
[0124] For the convenience of description, the above device is described in terms of functions divided into various modules. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0125] The device of the above embodiment is used to implement the corresponding lane change prompt method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.
[0126] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the lane change prompt method described in any of the above embodiments is implemented.
[0127] Fig. 20A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0128] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0129] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0130] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0131] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0132] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0133] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0134] The electronic device of the above embodiment is used to implement the corresponding lane change prompt method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.
[0135] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the lane change prompt method described in any of the above embodiments.
[0136] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0137] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the lane change prompt method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0138] Based on the same inventive concept, corresponding to any of the electronic devices in the above embodiments, the present application also provides a vehicle, which has the beneficial effects of the method embodiments corresponding to the electronic device, which will not be repeated here.
[0139] A vehicle comprises the electronic device of the above embodiment.
[0140] In some embodiments, the vehicle also includes a head-up display device (AR-HUD) or a display screen for presenting the lane change prompt information in the above implementation.
[0141] It should be noted that the embodiments of the present application can be further described in the following manner:
[0142] An intelligent navigation augmented reality display method that integrates AR-HUD with intelligent driving and vehicle navigation is used to receive intelligent driving data such as lane information recognized by intelligent driving, the distance relationship between vehicles around the vehicle (corresponding to the free distance), and other intelligent driving data, and receive navigation road congestion (corresponding to road conditions), the current number of lanes (corresponding to lane number information), and the intersection information of each road (corresponding to lane type) and other vehicle navigation data. The lane line (corresponding to line type information) recognized by intelligent driving and the number of navigation lanes determine the lane where the vehicle is located, receive navigation route planning and navigation actions for the next intersection (corresponding to driving actions), and automatically plan lane change paths for the driver according to the congestion situation and the situation of vehicles around the vehicle, and display AR fusion guidance on the actual road through AR-HUD to avoid the anxiety of missing the correct turn intersection, and reach the destination safely and quickly. Optionally, AR-HUD includes an AR-HUD controller and an AR-HUD projection display surface. In this embodiment, the AR-HUD controller can be replaced by other controllers such as the central control domain controller, and the AR-HUD projection display surface can be replaced by a physical display screen and other virtual display media.
[0143] The specific plan is as follows:
[0144] 1) The road location of the vehicle comes from the comparison of the types of the four lane lines (corresponding to the first lane line 1, the second lane line 2, the third lane line 3 and the fourth lane line 4) identified by the intelligent driving with the current number of lanes determined by the on-board navigation. After the current lane is determined, whether the vehicle needs to change lanes and the required number of lane changes are calculated based on the navigation route planning, the navigation action of the next intersection and the information data of each lane intersection, and direct AR navigation lane change guidance is provided to the driver according to the lane change timing. Since the number of lane lines that can be accurately identified by the current intelligent driving camera is four adjacent lane lines, the present invention can only provide one-way five-lane intelligent navigation lane change guidance at most. If the single item exceeds 5 lanes, the lane where the vehicle is located cannot be fully determined by calculation.
[0145] 2) Further, such as Figure 5 In a one-way five-lane road, AR-HUD receives lane information recognized by intelligent driving (the four lane lines adjacent to the vehicle), and recognizes the first lane line 1 as a roadbed / double solid line, then it can be determined that the vehicle is in the left lane of the road.
[0146] 3) Further, Figure 7In a one-way five-lane road, AR-HUD receives lane information recognized by intelligent driving (the four lane lines adjacent to the vehicle), recognizes that the third lane line 3 is a roadbed / double solid line, and the first lane line 1, the second lane line 2, and the fourth lane line 4 are dotted lines, then it can be determined that the vehicle is in the left second lane of the road.
[0147] 4) Further, Fig. 9 In a one-way five-lane road, AR-HUD receives lane information recognized by intelligent driving (the four lane lines adjacent to the vehicle), and recognizes that the first lane line 1, the second lane line 2, the third lane line 3 and the fourth lane line 4 are dotted lines, then it can be determined that the vehicle is in the middle lane of the road.
[0148] 5) Further, Figure 8 In a one-way five-lane road, AR-HUD receives lane information recognized by intelligent driving (the four lane lines adjacent to the vehicle), recognizes that the first lane line 1, the second lane line 2, and the third lane line 3 are dotted lines, and the fourth lane line 4 is a roadbed / double solid line, then it can be determined that the vehicle is in the second lane on the right side of the road.
[0149] 6) Further, Figure 6 In a one-way five-lane road, AR-HUD receives lane information (the four lane lines adjacent to the vehicle) identified by intelligent driving, and identifies the second lane line 2 as a roadbed / double solid line, so it can be determined that the vehicle is in the right lane of the road;
[0150] 7) If Fig.10 , the current road is determined to be a non-congested section through the on-board navigation data, and the intelligent driving recognizes that there are basically no vehicles around the vehicle, which can give the driver the greatest degree of freedom. If the driver still does not change lanes before the intersection "X" seconds, it will automatically plan the lane change path for the driver and display AR lane change guidance to prompt the driver to change lanes. The calculation formula for lane change timing is: Lane change distance (m) = current vehicle speed * 0.28 * X, 0.28 is the unit conversion configuration parameter, X is the configurable time parameter, X = the number of lane changes required * 15s.
[0151] 8) If Fig.11 If the vehicle's navigation data determines that the current road is congested, it will immediately plan a lane change route for the driver, identify the surrounding vehicle conditions through intelligent driving, identify the best lane change point and display AR lane change guidance to prompt the driver to change lanes.
[0152] The following is described using a specific embodiment example:
[0153] In a one-way five-lane road, the first lane line 1, the second lane line 2, the third lane line 3 and the fourth lane line 4 are identified as dotted lines, and the vehicle is determined to be in the middle lane of the road. The turning action at the next intersection is a right turn, so the vehicle needs to change lanes twice to reach the right turn lane. The current lane is a congested section. If you want to reach the right turn road, you need to change lanes twice. Through intelligent driving, the vehicle situation around the vehicle is identified, and the situation of the vehicles in front and behind the vehicle in the right two lanes is identified. After identifying the distance between vehicles that can achieve lane change, the AR lane change guide line is immediately displayed to remind the driver to change lanes for the first time. Fig.12 Then, it continues to identify the vehicles in front and behind the vehicle in the right lane. After identifying the distance between vehicles that can change lanes, it immediately displays the AR lane change guide line to prompt the driver to change lanes for the second time. Fig.13 .
[0154] Another embodiment example:
[0155] In a one-way five-lane road, the first lane line 1, the second lane line 2, the third lane line 3 and the fourth lane line 4 are identified as dotted lines, and the vehicle is determined to be in the middle lane of the road. The turning action at the next intersection is a right turn, so the vehicle needs to change lanes twice to reach the right turn lane. The current lane is a non-congested section. Through intelligent driving, it is identified that there is no vehicle in the lane on the right side of the vehicle. Assuming that the current speed is 60km / h, according to the calculation formula: Lane change distance (m) = current speed * 0.28 * 30s, the lane change distance is 504m, that is, the AR lane change guide line is immediately displayed at 504 meters away from the intersection to remind the driver to change lanes for the first time. Fig.14 After the first lane change is completed, according to the calculation formula: Lane change distance (m) = current vehicle speed * 0.28 * 15s, the lane change distance is 252m, that is, the AR lane change guide line is immediately displayed at 252 meters away from the intersection to remind the driver to change lanes for the second time. Fig.15 .
[0156] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.
[0157] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.
[0158] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0159] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.
Claims
1. A lane change prompting method, characterized in that: include: Obtain driving road information; Based on the driving road information, determining whether there is a need to change lanes; When the vehicle has the lane change requirement, the target lane road condition and driving information are acquired in real time; Based on the road condition and driving information of the target lane, determining whether a lane change opportunity has arrived; When the lane change opportunity arrives, sending a lane change prompt message; The driving information includes the free distance in the target lane, the first lane change distance, the driving speed of the vehicle, and the number of lane changes from the current lane to the target lane; wherein the first lane change distance is the distance between the vehicle and the adjacent intersection ahead along the traveling direction; The determining whether a lane change opportunity has been reached based on the target lane condition and driving information includes: When the target lane condition is non-congested, a prompt distance is determined based on the driving speed and the number of lane changes, and when the remaining distance is greater than a first preset distance and the first lane change distance is equal to the prompt distance, the lane change opportunity arrives.
2. The method according to claim 1, characterized in that: The driving road information includes lane image information, lane number information and planned driving route; The determining whether there is a lane change requirement based on the driving road information includes: Determining a current lane in which the vehicle is traveling based on the lane image information and the lane number information; Determining a target lane based on the planned driving route and the lane image information; Comparing whether the current lane and the target lane are the same lane; In response to the current lane and the target lane being different lanes, the vehicle has the lane change demand.
3. The method according to claim 2, characterized in that The determining, based on the lane image information and the lane number information, a current lane in which the vehicle is traveling, includes: Identifying lane line information based on the acquired lane image information; Based on the different line type information, the corresponding current lane is determined.
4. The method according to claim 2, characterized in that: The determining of the target lane based on the planned driving route and the lane image information includes: Determine the driving action at the next intersection according to the planned driving route; determining a lane type of each lane according to the lane image information; A lane type matching the driving action is determined, and a lane corresponding to the lane type is used as the target lane.
5. The method according to claim 1, characterized in that The driving information includes a free distance in the target lane; The determining whether a lane change opportunity has been reached based on the target lane condition and driving information includes: When the target lane is in congested condition and the remaining distance is greater than a first preset distance, the lane change opportunity arrives.
6. A lane change prompting device, characterized in that: include: The acquisition module is configured to acquire driving road information; and is also configured to acquire the target lane road condition and driving information in real time when the vehicle has a lane change requirement; a determination module configured to determine whether there is a lane change requirement based on the driving road information; a timing judgment module, configured to judge whether a lane change timing has been reached based on the road condition and driving information of the target lane; The driving information includes the free distance in the target lane, the first lane change distance, the driving speed of the vehicle, and the number of lane changes from the current lane to the target lane; wherein the first lane change distance is the distance between the vehicle and the adjacent intersection ahead along the traveling direction; when the road condition of the target lane is non-congested, a prompt distance is determined based on the driving speed and the number of lane changes, and when the free distance is greater than a first preset distance and the first lane change distance is equal to the prompt distance, the lane change opportunity is reached; The prompt module is configured to send a lane change prompt message when the lane change opportunity arrives.
7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 5 is implemented.
8. A vehicle comprising the electronic device according to claim 7.
9. The vehicle according to claim 8, characterized in that It also includes a head-up display device or a display screen for presenting the lane change prompt information.
Citation Information
Patent Citations
Lane selection method and terminal
CN108305477A
Navigation lane-changing prompt method and device
CN109141464A
Intersection lane navigation method and device
CN109859513A
Method and device for controlling unmanned vehicle and unmanned vehicle
CN112874503A
Help-seeking and lane-changing auxiliary method and device for congestion scene, electronic equipment and storage medium
CN113734172A
