Auxiliary driving method and device, electronic equipment and computer readable storage medium
By identifying driving-related information in the navigation information and using the prompt components on the vehicle to automatically prompt, the problem of missing navigation information by users during driving is solved, and driving safety and experience is improved.
Patent Information
- Application Number
- CN202311206889.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-18
- Publication Date
- 2025-03-18
AI Technical Summary
During driving, users are unable to continue to pay attention to navigation voice broadcasts, which easily misses navigation information, affecting driving safety.
By obtaining the navigation information displayed by the navigation application, we identify driving-related information in the navigation information, and when specific prompt conditions are met, driving-related information is automatically prompted through the prompt components on the vehicle (such as ambient lights, monitors, audio, vibrators, etc.).
It effectively avoids the risk of users missing navigation information and improves driving safety and experience.
Smart Images

Figure CN119636780A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle driving, and in particular to an assisted driving method, device, electronic device and computer-readable storage medium. Background Art
[0002] With the improvement of people's living standards, driving a vehicle has become a common phenomenon, and supporting devices or systems for assisted driving have emerged in an endless stream. In-car navigation is a frequently used assisted driving tool during driving. In-car navigation can help users know their exact location at any time and plan the route to the destination.
[0003] In-car navigation usually provides navigation prompts through navigation screen display and voice broadcast. When users use in-car navigation while driving, due to the complex driving environment, they cannot always focus on the navigation voice broadcast. When they miss the navigation voice broadcast, they need to divert their eyes from the screen to obtain navigation information, which affects driving safety. Summary of the invention
[0004] The embodiments of the present application provide a driving assistance method, device, electronic device, and computer-readable storage medium, which can improve driving safety.
[0005] In a first aspect, the present application provides an assisted driving method. The method comprises:
[0006] Get the navigation information displayed by the navigation application;
[0007] identifying driving related information in the navigation information;
[0008] If the driving related information meets the prompting condition, the driving related information is prompted through a prompting component on the vehicle.
[0009] In a second aspect, the present application also provides a driving assistance device. The device comprises:
[0010] A navigation information acquisition module is used to obtain navigation information displayed by the navigation application;
[0011] A driving information identification module, used to identify driving related information in the navigation information;
[0012] The driving information prompt module is used to prompt the driving related information through a prompt component on the vehicle if the driving related information meets the prompt condition.
[0013] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:
[0014] Get the navigation information displayed by the navigation application;
[0015] identifying driving related information in the navigation information;
[0016] If the driving related information meets the prompting condition, the driving related information is prompted through a prompting component on the vehicle.
[0017] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0018] Get the navigation information displayed by the navigation application;
[0019] identifying driving related information in the navigation information;
[0020] If the driving related information meets the prompting condition, the driving related information is prompted through a prompting component on the vehicle.
[0021] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0022] Get the navigation information displayed by the navigation application;
[0023] identifying driving related information in the navigation information;
[0024] If the driving related information meets the prompting condition, the driving related information is prompted through a prompting component on the vehicle.
[0025] The above-mentioned assisted driving method, device, electronic device, computer-readable storage medium and computer program product obtain the navigation information displayed by the navigation application, identify the driving-related information in the navigation information, and if the driving-related information meets the prompt conditions, prompt the driving-related information through the prompt component on the vehicle. The driving-related information that meets the prompt conditions can be automatically emphasized and prompted, thereby preventing users from missing the navigation information broadcast by the on-board navigation and improving driving safety. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0027] Figure 1 A diagram showing an application environment of a driving assistance method in an embodiment;
[0028] Figure 2 is a flow chart of an assisted driving method in one embodiment;
[0029] Figure 3 is a flow chart of a driving assistance method in another embodiment;
[0030] Figure 4 is a flow chart of a driving assistance method in another embodiment;
[0031] Figure 5 is a structural block diagram of a driving assistance device in an embodiment;
[0032] Figure 6 The figure is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0033] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0034] The assisted driving method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the vehicle terminal 102 communicates with the server 104 through the network, and the vehicle terminal 102 is connected to the prompt component 106 on the vehicle. The data storage system can store the data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network servers. The vehicle terminal 102 obtains the navigation information displayed by the navigation application, and sends the navigation information to the server 104. The server 104 receives the navigation information sent by the terminal 102, identifies the driving related information in the navigation information, and if the driving related information meets the prompt condition, the prompt component 106 on the vehicle prompts the driving related information. Among them, the server 104 can send the prompt instruction to the vehicle terminal 102, and the prompt instruction is sent to the prompt component 106 through the vehicle terminal 102, so that the driving related information is prompted by the prompt component 106; it can also be that the server 104 is connected to the prompt component 106 in communication, that is, the server 104 can directly send the prompt instruction to the prompt component 106, and the driving related information is prompted by the prompt component 106.
[0035] The assisted driving method provided in the embodiment of the present application can also be applied separately on the vehicle-mounted terminal 102. The vehicle-mounted terminal is communicated with the prompt component on the vehicle to obtain the navigation information displayed by the navigation application, identify the driving-related information in the navigation information, and if the driving-related information meets the prompt condition, send a prompt instruction to the corresponding prompt component to prompt the driving-related information through the prompt component.
[0036] In one embodiment, Figure 2 As shown, a driving assistance method is provided, which is applied to Figure 1 The vehicle-mounted terminal in is used as an example to illustrate, including the following steps 202 to 206.
[0037] Step 202: Obtain navigation information displayed by the navigation application.
[0038] The vehicle terminal (Transmission Control Unit, TCU) is the front-end equipment of the vehicle monitoring and management system, and can also be called the vehicle dispatch monitoring terminal (TCU terminal).
[0039] When the navigation application is in operation, the vehicle terminal can obtain the navigation information displayed by the navigation application. Usually, the navigation application is installed on the vehicle terminal. When the navigation application on the vehicle terminal is in operation, the navigation page is displayed on the screen of the vehicle terminal. The vehicle terminal can obtain the navigation information displayed by the navigation application, for example, by taking a screenshot, taking a photo, or extracting text and images. When the navigation application is in operation, obtaining the navigation information displayed by the navigation application can reduce the power consumption of the vehicle terminal.
[0040] Optionally, the GPS (Global Positioning System) status information on the vehicle can be identified, and whether the navigation application is in operation can be determined based on the GPS status information. The GPS status information includes GPS switch information and call information. For example, when the GPS is in the on state, and the number of GPS calls is higher than the target number of calls, it is determined that the navigation application is in operation.
[0041] Alternatively, the running state of the target navigation application may be monitored, and whether the navigation application is in the running state may be determined by the running state of the target navigation application. The target navigation application is the navigation application installed on the corresponding vehicle terminal. For example, when the target navigation application is monitored to be in the running state, it is determined that the navigation application is in the running state.
[0042] Alternatively, the screen information of the vehicle terminal may be captured at each target time interval to obtain a screenshot of the screen information, and whether the navigation application is in operation may be determined based on the screenshot of the screen information. For example, by identifying the corresponding screen information in the screenshot of the screen information, if the screen information includes navigation-related information, it is determined that the navigation application is in operation.
[0043] Step 204: Identify driving related information in the navigation information.
[0044] The vehicle terminal can identify driving-related information from the navigation information. It is easy to understand that the navigation information can be all the information displayed on the navigation page, including the road conditions, road information, traffic light information and vehicle driving information, etc., where the road conditions, for example, refer to the pedestrians, vehicles and surrounding buildings on the road; road information, for example, refers to the number of lanes on the current road, lane types and diverging and merging intersection information, etc. Lane types include left-turn lanes, right-turn lanes or straight lanes, etc.; vehicle driving information, for example, refers to the vehicle's driving speed and the position in the lane, such as whether the vehicle is driving in the lane or driving on the lane line.
[0045] The driving related information may be understood as navigation information of high importance during the user's driving process, such as turn information, traffic light information, speed limit information, etc. It is understandable that different driving related information may be selected for different driving scenarios.
[0046] Optionally, the turning information may be identified by a direction recognition model, and the direction recognition model may be trained by navigation information corresponding to each navigation application marked with a turning mark.
[0047] Step 206: If the driving-related information meets the prompting condition, the driving-related information is prompted through a prompting component on the vehicle.
[0048] In this embodiment, if the driving-related information meets the prompt condition, the driving-related information is prompted by the prompt component on the vehicle, wherein different driving-related information corresponds to different prompt conditions and corresponding prompt components. The prompt component can be installed on the vehicle or placed on the vehicle. The prompt component may include at least one of an ambient light, a display, a sounder, a vibrator or an alarm. For example, the driving-related information is navigation direction information, and the prompt condition is that the navigation direction changes. If the navigation direction of the vehicle changes, the navigation direction information is prompted by the prompt component on the vehicle. For another example, the driving direction information is displayed by the color or brightness of the ambient light, or the driving direction information is displayed by the display in the form of text or graphics. It can be understood that the prompt of the driving-related information by the prompt component on the vehicle in the embodiment of the present application is implemented before the voice broadcast of the corresponding navigation application.
[0049] The above-mentioned assisted driving method obtains the navigation information displayed by the navigation application, identifies the driving-related information in the navigation information, and if the driving-related information meets the prompt conditions, prompts the driving-related information through the prompt component on the vehicle. The driving-related information that meets the prompt conditions can be automatically emphasized and prompted, thereby preventing the user from missing the navigation information broadcast by the on-board navigation and shifting their attention to the screen to view it, thereby improving the driving experience while improving driving safety.
[0050] In one embodiment, obtaining navigation information displayed by a navigation application includes:
[0051] Capture a navigation page displayed by a navigation application to obtain a navigation page screenshot; and obtain navigation information from the navigation page screenshot.
[0052] In this embodiment, the navigation page displayed by the navigation application can be intercepted to obtain a screenshot of the navigation page, and the navigation information can be identified and obtained from the screenshot of the navigation page. When the navigation application is in operation, the vehicle-mounted terminal intercepts the navigation page displayed by the navigation application at target intervals to obtain a screenshot of the navigation page, and then identifies the navigation information from the screenshot of the navigation page and obtains the identified navigation information. Among them, the navigation information in the screenshot of the navigation page can be identified by a navigation information recognition model, and the navigation information recognition model can be obtained by training based on a neural network model. A possible implementation method of obtaining a navigation information recognition model based on training of a neural network model is to intercept navigation pages displayed by multiple navigation applications to obtain a navigation page data set, wherein the navigation page data set includes multiple navigation information, and the multiple navigation information is classified and labeled, and the neural network model is trained according to the navigation page data set. When the convergence condition is met, the navigation information recognition model is obtained. The convergence condition can be that the number of training times reaches a preset number of training times, or the value of the loss function reaches a target loss value, etc.
[0053] In the above embodiment, by intercepting the navigation page displayed by the navigation application to obtain a navigation page screenshot, and obtaining navigation information from the navigation page screenshot, it is possible to quickly and conveniently obtain the navigation information, thereby improving the efficiency of obtaining the navigation information.
[0054] In one embodiment, the prompt component includes an ambient light; if the driving-related information meets the prompt conditions, the driving-related information is prompted through the prompt component on the vehicle, including: if the driving-related information meets the change in navigation direction, the driving direction of the driving-related information is prompted through the ambient light.
[0055] In this embodiment, if the driving-related information satisfies the change in the navigation direction, the driving-related information is prompted by the ambient light. For example, if the navigation application indicates that the driving direction ahead is a left turn, and the driving-related information changes from straight ahead to a left turn, the driving direction of the left turn is prompted by the ambient light, and the moving direction of the ambient light is controlled to move from the right to the left; if the navigation application indicates that the driving direction ahead is a right turn, and the driving-related information changes from straight ahead to a right turn, the driving direction of the right turn is prompted by the ambient light, and the moving direction of the ambient light is controlled to move from the left to the right, wherein the ambient light can be installed within the field of vision of the driver on the vehicle, such as above the windshield, at the junction of the windshield and the roof.
[0056] In one possible implementation, the vehicle is equipped with ambient lights representing different driving directions. If the driving-related information changes from going straight ahead to turning left, the ambient light corresponding to the left turn is controlled to light up, and the ambient light corresponding to the left turn can be installed on the left side of the vehicle's driving direction; if the driving-related information changes from going straight ahead to turning right, the ambient light corresponding to the right turn is controlled to light up, and the ambient light corresponding to the right turn can be installed on the right side of the vehicle's driving direction; if the driving-related information changes from driving on the main road to driving on the auxiliary road, the ambient light corresponding to the auxiliary road direction is controlled to light up.
[0057] In the above embodiment, if the driving-related information satisfies the change in navigation direction, the driving-related information can be prompted in the driving direction through the ambient light, which can provide active and quick visual prompts to the user and prevent the user from moving his or her eyes to the screen, causing driving safety problems.
[0058] In some embodiments, driving-related information includes traffic lights, and the color of the traffic lights is displayed through atmosphere lights. In actual application scenarios, the navigation page corresponding to the navigation application displays the traffic light conditions ahead of the driving road, as well as the remaining duration of the traffic lights. The driving-related information is the distance from the traffic light intersection ahead, and the prompt condition may be that the distance from the traffic light intersection ahead is the target distance. If the distance between the vehicle and the traffic light intersection ahead is the target distance, the traffic light information of the traffic light intersection ahead and the remaining duration of the traffic light are displayed through the atmosphere lights. For example, the traffic light at the traffic light intersection ahead is currently red, and the remaining duration of the red light is 30 seconds. Then, the corresponding atmosphere light displays red, and the remaining duration of the red light of 30 seconds can be displayed on the display.
[0059] In some embodiments, a method for determining whether the navigation direction has changed includes: intercepting a first navigation page displayed by a navigation application to obtain a screenshot of the first navigation page; at a preset interval, intercepting a second navigation page displayed by the navigation application to obtain a screenshot of the second navigation page; if the navigation direction in the second navigation page screenshot is inconsistent with the navigation direction in the first navigation page screenshot, determining that the navigation direction has changed.
[0060] In this embodiment, the navigation page displayed by the navigation application is intercepted at intervals of a preset duration to obtain a screenshot of the navigation page, and whether the navigation direction has changed is determined based on the screenshot of the navigation page. First, the first navigation page displayed by the navigation application is intercepted to obtain a screenshot of the first navigation page; the second navigation page displayed by the navigation application is intercepted at intervals of a preset duration to obtain a screenshot of the second navigation page, and the corresponding navigation direction in the first navigation page screenshot and the corresponding navigation direction in the second navigation page screenshot are respectively identified. If the navigation direction in the second navigation page screenshot is inconsistent with the navigation direction in the first navigation page screenshot, it is determined that the navigation direction has changed. The navigation direction refers to the direction in which the vehicle is traveling indicated in the navigation application. For example, the navigation direction is represented by the direction of an arrow. If the arrows point in different directions, it is determined that the navigation direction has changed.
[0061] It can be understood that at the first moment, the first navigation page displayed by the navigation application is intercepted to obtain a screenshot of the first navigation page; at the second moment, the second navigation page displayed by the navigation application is intercepted to obtain a screenshot of the second navigation page, wherein the first moment and the second moment are separated by a preset time length, and if the corresponding navigation direction in the screenshot of the second navigation page is inconsistent with the navigation direction in the screenshot of the first navigation page, it is determined that the navigation direction has changed. The preset time length can be set according to the actual application scenario, for example, the preset time length is 0.5 seconds.
[0062] Optionally, if the navigation direction in the second navigation page screenshot is consistent with the navigation direction in the first navigation page screenshot, it is determined that the navigation direction has not changed.
[0063] In the above embodiment, the first navigation page and the second navigation page displayed by the corresponding navigation application before and after the preset time interval are captured to obtain the first navigation page screenshot and the second navigation page screenshot. If the navigation direction in the second navigation page screenshot is inconsistent with the navigation direction in the first navigation page screenshot, it is determined that the navigation direction has changed. Whether the navigation direction has changed can be quickly identified, thereby speeding up the prompting speed of driving-related information.
[0064] In some embodiments, the prompt component includes a display; the above method also includes: sending driving-related information to the display, and providing prompts for the driving-related information through the display.
[0065] A display refers to a display tool that displays content on a screen, such as a HUD (Head Up Display), a CRT (Cathode Ray Tube) display, an LCD (Liquid Crystal Display) display, an LED (light-emitting diode) display, or a 3D display, etc. Among them, HUD is also called a head-up display system. It is driver-centric, blindly operated, and has a multi-function instrument panel that can project driving-related information onto the windshield in front of the driver, so that the driver can see driving-related information without lowering or turning his head, thereby improving driving safety while obtaining driving-related information.
[0066] In one embodiment, the prompt component includes a speaker; the above method also includes: when the vehicle is not performing voice interaction, adjusting the volume curve of the navigation application broadcast sound through the speaker.
[0067] In this embodiment, a speaker is installed or placed on the vehicle, and the prompt component includes the speaker. When the vehicle is not performing voice interaction, the volume curve of the navigation application broadcast sound is adjusted by the speaker to implement enhanced prompts for the volume of the navigation application broadcast sound. When the vehicle-mounted terminal recognizes that the vehicle is not performing voice interaction, the volume curve of the navigation application broadcast sound is adjusted by the speaker, wherein the volume curve can be understood as the trajectory of changes in the sound volume. Optionally, the left channel volume curve and the right channel volume curve of the navigation application broadcast sound can be adjusted by the speaker to implement enhanced prompts for the volume of the navigation application broadcast sound.
[0068] Optionally, for different driving-related information, the volume curve of the sound broadcast by the navigation application adjusted through the audio is different. For example, if the navigation application indicates that the driving direction ahead is a left turn, and the driving-related information changes from straight going to a left turn, the terminal controls the volume curve of the left channel of the audio to change from low to high, and the volume curve of the right channel to change from high to low; if the navigation application indicates that the driving direction ahead is a right turn, and the driving-related information changes from straight going to a right turn, the terminal controls the volume curve of the left channel of the audio to change from high to low, and the volume curve of the right channel to change from low to high.
[0069] In one possible implementation, when the vehicle terminal recognizes that the vehicle is performing voice interaction, it does not adjust the volume curve of the navigation application broadcast sound through the audio system, and at the same time, it does not adjust the volume curve of the voice call sound. When the vehicle terminal recognizes that entertainment audio is emitted, it can adjust the volume curve of the navigation application broadcast sound through the audio system and increase the volume of the navigation application broadcast sound. Among them, entertainment audio includes music, video sound, etc.
[0070] In the above embodiment, by adjusting the volume curve of the navigation application broadcast sound through the audio system when no voice interaction is performed in the vehicle, it is possible to provide auditory emphasis and prompts on driving-related information that meets the prompt conditions, thereby preventing users from missing the navigation broadcast information of the navigation application, thereby improving driving quality and safety.
[0071] In some embodiments, the prompt component includes at least one of a vibrator and an ambient light; if the driving-related information meets a preset condition, the driving-related information is prompted through the prompt component, including: when the prompt component includes a vibrator, if the driving-related information meets the condition that the driving speed exceeds a speed threshold, the vibrator is controlled to prompt the driving-related information; and when the prompt component includes an ambient light, if the driving-related information meets the condition that the driving speed exceeds a speed threshold, the ambient light is controlled to flash in a preset flashing manner to prompt the driving speed.
[0072] In this embodiment, the prompt component includes at least one of a vibrator and an ambient light. When the prompt component only includes a vibrator, if the driving-related information satisfies that the driving speed exceeds the speed threshold, the vibrator is controlled to prompt the driving-related information; when the prompt component only includes an ambient light, if the driving-related information satisfies that the driving speed exceeds the speed threshold, the ambient light is controlled to flash in a preset flashing manner; when the prompt component includes a vibrator and an ambient light, if the driving-related information satisfies that the driving speed exceeds the speed threshold, the vibrator is controlled to prompt the driving-related information, and the ambient light is controlled to flash in a preset flashing manner. Among them, the vibrator can be installed on the steering wheel or the driving seat, and the ambient light can be installed on the windshield in front of the driving seat. The speed threshold includes the maximum speed value allowed for the current road, that is, the speed limit value of the current road. The speed limit value of the current road can be obtained from the navigation information, that is, the navigation application will display the current driving speed of the vehicle and the speed limit value of the current road on the navigation page.
[0073] In the above embodiment, if the driving-related information satisfies that the driving speed exceeds the speed threshold, when the prompt component includes at least one of a vibrator and an ambient light, the vibrator is controlled to prompt the driving speed, and / or the ambient light is controlled to flash according to a preset flashing mode to prompt the driving speed. This can achieve multiple visual and tactile emphasis and prompts for the user, improve the user's driving experience, avoid the user missing the navigation broadcast and then transferring to the screen to obtain navigation information, and improve driving safety.
[0074] In one embodiment, Figure 3 As shown, an assisted driving method is provided, including the following steps 302 to 314.
[0075] Step 302: When the navigation application is in the running state, capture the navigation page displayed by the navigation application to obtain a screenshot of the navigation page.
[0076] Step 304, obtaining navigation information from the navigation page screenshot.
[0077] Step 306, identifying driving related information in the navigation information.
[0078] Step 308, the prompt component includes an ambient light. If the driving-related information satisfies the change in the navigation direction, the driving-related information is prompted in the driving direction through the ambient light.
[0079] Step 310, the prompt component includes a display, sends driving related information to the display, and prompts the driving related information through the display.
[0080] Step 312, the prompt component includes an audio system, and when the vehicle is not performing voice interaction, the volume curve of the navigation application announcement sound is adjusted through the audio system.
[0081] Step 314, the prompt component includes a vibrator. If the driving-related information satisfies that the driving speed exceeds the speed threshold, the vibrator is controlled to prompt the driving-related information, and the ambient light is controlled to flash in a preset flashing mode to prompt the driving speed.
[0082] In the above-mentioned assisted driving method, when the navigation application is in running state, the navigation page displayed by the navigation application is intercepted to obtain a screenshot of the navigation page, navigation information is obtained from the screenshot of the navigation page, driving-related information in the navigation information is identified, and driving-related information is prompted through a prompt component on the vehicle. This can achieve rapid emphasis and prompts on the user's hearing, vision or touch, thereby improving driving quality and driving safety.
[0083] In one example, if Figure 4 As shown, the assisted driving method includes the following steps 402 to 416.
[0084] Step 402: Detect that the navigation application is turned on and running.
[0085] Step 404, intercept the navigation page displayed by the navigation application to obtain a screenshot of the navigation page.
[0086] Step 406, identifying navigation direction information in the navigation page screenshot.
[0087] Step 408, identifying a change in the navigation direction and identifying the status of the vehicle's prompt components.
[0088] Step 410 , identifying that the navigation direction has not changed, after an interval of 500 milliseconds, returning to execute step 404 .
[0089] Step 412: If the prompt component includes an ambient light, the navigation direction is prompted by the ambient light.
[0090] Step 414, the prompt component includes an audio system, and when the vehicle is not performing voice interaction, the volume curve of the navigation application announcement sound is adjusted through the audio system.
[0091] Step 416, the prompt component includes a HUD, and the navigation direction information is sent to the HUD, and the HUD displays the corresponding navigation direction information.
[0092] In the above-mentioned assisted driving method, when it is detected that the navigation application is turned on and running, the navigation page displayed by the navigation application is intercepted to obtain a screenshot of the navigation page, and the navigation direction information in the screenshot of the navigation page is identified. When it is determined that the navigation direction has changed, the prompt component on the vehicle is identified. If the prompt component includes an ambient light, the ambient light is controlled to prompt the navigation direction. If the prompt component includes an audio system, the volume curve of the navigation application broadcast sound is adjusted by volume when the vehicle does not perform voice interaction. If the prompt component includes a HUD, the navigation direction information is sent to the HUD, and the corresponding navigation direction information is displayed through the HUD. This method realizes at least one of the auditory, visual or tactile emphasis and prompts on the changed navigation direction to the user, avoiding the driving safety issue involved in the user shifting their sight to the screen when missing the navigation voice broadcast, thereby improving driving safety and improving user experience.
[0093] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0094] Based on the same inventive concept, the embodiment of the present application also provides an assisted driving device for implementing the assisted driving method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more assisted driving device embodiments provided below can refer to the limitations on the assisted driving method above, and will not be repeated here.
[0095] In one embodiment, Figure 5As shown, a driving assistance device is provided, including: a navigation information acquisition module 502, a driving information recognition module 504 and a driving information prompt module 506, wherein:
[0096] A navigation information acquisition module 502 is used to acquire navigation information displayed by a navigation application;
[0097] A driving information identification module 504, used to identify driving related information in the navigation information;
[0098] The driving information prompting module 506 is used to prompt the driving related information through a prompting component on the vehicle if the driving related information meets the prompting condition.
[0099] In one embodiment, the navigation information acquisition module 502 is further used to capture the navigation page displayed by the navigation application to obtain a navigation page screenshot; and to obtain the navigation information from the navigation page screenshot.
[0100] In one embodiment, the driving information prompting module 506 is further configured to prompt the driving direction of the driving related information through the ambient light if the driving related information satisfies the change in navigation direction.
[0101] In one embodiment, a navigation direction determination module is used to implement a method for determining whether the navigation direction has changed, intercepting a first navigation page displayed by the navigation application to obtain a screenshot of the first navigation page; at a preset time interval, intercepting a second navigation page displayed by the navigation application to obtain a screenshot of the second navigation page; if the navigation direction in the second navigation page screenshot is inconsistent with the navigation direction in the first navigation page screenshot, it is determined that the navigation direction has changed.
[0102] In one embodiment, the above-mentioned device further includes a display prompt module, which is used to send the driving-related information to the display, and to prompt the driving-related information through the display.
[0103] In one embodiment, the above-mentioned device also includes an audio adjustment module, which is used to adjust the volume curve of the navigation application broadcast sound through the audio when the vehicle is not performing voice interaction.
[0104] In one embodiment, the driving information prompt module 506 is also used for, when the prompt component includes a vibrator, if the driving-related information satisfies that the driving speed exceeds a speed threshold, controlling the vibrator to prompt the driving-related information; and when the prompt component includes an ambient light, if the driving-related information satisfies that the driving speed exceeds a speed threshold, controlling the ambient light to flash in a preset flashing manner to prompt the driving speed.
[0105] Each module in the above-mentioned auxiliary driving device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each module above.
[0106] In one embodiment, a computer device is provided. The computer device may be a vehicle-mounted terminal, and its internal structure diagram may be as follows: Figure 6 As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, an assisted driving method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.
[0107] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0108] The embodiment of the present application also provides a computer-readable storage medium, one or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, the processors execute the steps of the assisted driving method.
[0109] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute an assisted driving method.
[0110] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws and regulations and standards.
[0111] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0112] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0113] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A driving assistance method, characterized in that: The method comprises: Get the navigation information displayed by the navigation application; identifying driving related information in the navigation information; If the driving related information meets the prompting condition, the driving related information is prompted through a prompting component on the vehicle.
2. The method according to claim 1, characterized in that The obtaining of navigation information displayed by the navigation application includes: Intercepting the navigation page displayed by the navigation application to obtain a screenshot of the navigation page; The navigation information is obtained from the navigation page screenshot.
3. The method according to claim 1, characterized in that The prompt component includes an ambient light; if the driving related information meets the prompt condition, the driving related information is prompted by the prompt component on the vehicle, including: If the driving-related information satisfies the change in navigation direction, the driving direction of the driving-related information is prompted through the ambient light.
4. The method according to claim 3, characterized in that The method of determining that the navigation direction has changed includes: Intercepting a first navigation page displayed by the navigation application to obtain a screenshot of the first navigation page; At a preset time interval, capturing a second navigation page displayed by the navigation application to obtain a screenshot of the second navigation page; If the navigation direction in the second navigation page screenshot is inconsistent with the navigation direction in the first navigation page screenshot, it is determined that the navigation direction has changed.
5. The method according to claim 1, characterized in that The prompt component includes a display; the method further includes: The driving related information is sent to the display, and the driving related information is prompted through the display.
6. The method according to claim 1, characterized in that The prompt component includes a sound; the method further includes: When the vehicle is not performing voice interaction, the volume curve of the navigation application broadcast sound is adjusted through the audio system.
7. The method according to claim 1, characterized in that The prompt component includes at least one of a vibrator and an ambient light; if the driving related information meets the prompt condition, the driving related information is prompted by the prompt component on the vehicle, including: When the prompt component includes a vibrator, if the driving-related information satisfies that the driving speed exceeds a speed threshold, controlling the vibrator to prompt the driving-related information; and When the prompt component includes an ambient light, if the driving-related information satisfies that the driving speed exceeds a speed threshold, the ambient light is controlled to flash in a preset flashing manner to prompt the driving speed.
8. A driving assistance device, characterized in that: include: A navigation information acquisition module is used to obtain navigation information displayed by the navigation application; A driving information identification module, used to identify driving related information in the navigation information; The driving information prompt module is used to prompt the driving related information through a prompt component on the vehicle if the driving related information meets the prompt condition.
9. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, wherein: When the computer program is executed by the processor, the processor is caused to perform the steps of the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.