Intelligent driving state prompting method, device and medium

Abstract

The application relates to the technical field of intelligent driving, in particular to an intelligent driving state prompting method, device and medium, the method adopts a preset non-invasive sensing mode to acquire the running state of the current intelligent driving system of a vehicle, the preset non-invasive sensing mode comprises at least one of voice recognition, image recognition and Bluetooth broadcast packet recognition; a corresponding prompt signal is generated based on the running state; and the prompt signal is output to prompt the user about the current intelligent driving state of the vehicle. The sensing mode of the scheme does not need to change the original structure and data transmission path of the vehicle, a low-cost, easy-to-deploy and highly compatible intelligent driving state prompting scheme is realized, and the driving safety and user experience are significantly improved.

Description

Technical Field

[0001] This application relates to the field of intelligent driving technology, and in particular to an intelligent driving status prompting method, device and medium. Background Technology

[0002] With the widespread installation of intelligent driving assistance functions in vehicles, drivers need to keep abreast of the intelligent driving status and avoid risks associated with human-machine interaction. Existing pre-installed vehicles rely on instrument icons, voice prompts, and onboard indicator lights to provide status alerts; aftermarket solutions mostly use OBD (On-Board Diagnostics) bus data acquisition, which connects to the vehicle bus through the OBD interface to collect data such as vehicle speed and acceleration to generate alert signals, and is adapted and deployed for different vehicle models' CAN protocols.

[0003] However, pre-installed integration solutions cannot meet the aftermarket needs of existing vehicles or third-party intelligent driving kits, while OBD aftermarket solutions require intrusive connections and have poor compatibility, posing safety hazards and warranty issues. Furthermore, developing solutions for different vehicle models' CAN protocols results in high costs and long deployment cycles. Summary of the Invention

[0004] This application provides a method, device, and medium for intelligent driving status prompting to solve the aforementioned technical problems. This solution combines non-intrusive sensing with prompt signal output, addressing the issues of difficult aftermarket deployment, intrusive connection risks, and complex protocol adaptation in existing technologies.

[0005] In a first aspect, embodiments of this application provide a method for intelligent driving status prompting, the method comprising:

[0006] The current operating status of the vehicle's intelligent driving system is obtained using a preset non-intrusive perception method, which includes at least one of voice recognition, image recognition, and Bluetooth broadcast packet recognition.

[0007] Generate corresponding prompt signals based on the operating status;

[0008] The prompt signal is output to inform the user of the current intelligent driving status of the vehicle.

[0009] In one possible embodiment, obtaining the running status includes:

[0010] Acquire audio signals from inside the vehicle's cabin;

[0011] A preset speech recognition model is used to extract speech features from audio signals and then match them in a preset template library.

[0012] If the matching degree is greater than the preset matching threshold, the current operating status of the intelligent driving system is determined to be either on or off.

[0013] In one possible embodiment, obtaining the running status includes:

[0014] Get the image of the location of the intelligent driving icon;

[0015] The system uses a pre-defined image recognition algorithm to extract the intelligent driving icon from the image and recognize the icon's shape.

[0016] Based on the recognition results, the current operating status of the intelligent driving system is determined to be either on or off.

[0017] In one possible embodiment, obtaining the running status includes:

[0018] Obtain data packets broadcast by the vehicle's Bluetooth system;

[0019] Parse the Bluetooth broadcast packet to obtain the intelligent driving status identifier;

[0020] The current operating status of the intelligent driving system is determined by the intelligent driving status flag, indicating whether it is in the on or off state.

[0021] In one possible embodiment, generating a corresponding prompt signal includes:

[0022] Based on the operating status, a light signal with varying values ​​in at least one of the following dimensions is generated: color, brightness, and flashing frequency.

[0023] In one possible embodiment, it also includes:

[0024] Receive custom configuration commands sent by the user;

[0025] The parameters of the prompt signals corresponding to different running states can be adjusted based on custom configuration commands.

[0026] In one possible embodiment, it also includes:

[0027] Obtain the current light intensity inside the vehicle's cabin;

[0028] Adjust the brightness and color saturation of the changing light signal corresponding to the current operating state based on the light intensity.

[0029] In one possible embodiment, it also includes:

[0030] Receive prompt signal instructions sent by the main module and output prompt signals based on the instructions;

[0031] If no instruction is received from the main module within a preset time period, a prompt signal will be output according to the preset prompt rules.

[0032] Secondly, embodiments of this application provide an intelligent driving status prompting device, including: a memory, a processor, and at least one of an audio acquisition sensor, an image acquisition sensor, and a Bluetooth receiver;

[0033] The intelligent driving status prompting device is fixed in the vehicle cabin using a non-intrusive deployment method, which includes one of magnetic, adhesive, or suspended types.

[0034] The audio acquisition sensor is used to acquire audio signals inside the vehicle cabin;

[0035] The image acquisition sensor is used to acquire images of the location of the intelligent driving icon;

[0036] The Bluetooth receiver is used to receive data packets broadcast by the vehicle's Bluetooth system;

[0037] The memory stores instructions that the computer executes;

[0038] The processor executes computer execution instructions stored in memory, causing the processor to perform the methods described above.

[0039] Thirdly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the methods provided above.

[0040] The intelligent driving status prompting method, device, and medium provided in this application do not connect to the vehicle diagnostic system interface or the vehicle CAN bus via wiring. They rely on external sensing methods such as voice recognition, image recognition, and Bluetooth broadcast packet recognition to collect the intelligent driving operating status. This achieves completely non-intrusive deployment, requiring no wire breaking, no occupation of the vehicle diagnostic system interface, and no electrical or data interaction with the vehicle's onboard bus, avoiding bus conflicts and short-circuit risks, and preventing impact on the original manufacturer's warranty. It eliminates the need to analyze proprietary communication protocols for different vehicle brands, significantly reducing the adaptation and development costs for existing vehicles, third-party intelligent driving kits, and autonomous driving test vehicles, shortening the deployment cycle, and achieving cross-vehicle universality. Multiple sensing methods are selectable and can be integrated; when a single sensing method is affected by environmental interference, multiple sensing paths can be combined to improve recognition reliability. It adapts to different vehicle hardware conditions and is compatible with various existing vehicle scenarios, such as those without external Bluetooth output, without a prominent intelligent driving screen UI, or those requiring intelligent driving status voice broadcasting. The deployment threshold is low, requiring only an external independent device to operate, achieving low-cost and rapid installation, meeting the aftermarket's needs for modifying existing vehicles. Different intelligent driving conditions correspond to different prompt signals, which can clearly distinguish the differences in status and avoid confusion for the driver regarding the system's operating status. A unified information output source aggregates and normalizes the fragmented intelligent driving information scattered across the original vehicle's instrument panel and in-vehicle voice system, eliminating the need for the driver to search for status information in multiple places and reducing distraction. Attached Figure Description

[0041] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0042] Figure 1 An application scenario diagram of the intelligent driving status prompting method provided in this application;

[0043] Figure 2 A flowchart illustrating a method for providing intelligent driving status alerts according to an embodiment of this application;

[0044] Figure 3 A flowchart illustrating a smart driving status prompting method provided in another embodiment of this application;

[0045] Figure 4 A flowchart illustrating a method for providing intelligent driving status alerts according to another embodiment of this application;

[0046] Figure 5 This is a schematic diagram of the structure of an intelligent driving status prompting device provided in an embodiment of this application;

[0047] Figure 6 This is a schematic diagram of the structure of an intelligent driving status prompting device provided in an embodiment of this application.

[0048] The accompanying drawings have illustrated specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to specific embodiments. Detailed Implementation

[0049] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0050] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.

[0051] To clearly understand the technical solution of this application, the solutions of the prior art will be described in detail first.

[0052] Intelligent driving assistance systems are widely installed in mass-produced vehicles. Accurately identifying the operating status of these systems is crucial for preventing human-machine interface errors and ensuring driving safety. Currently, factory-installed vehicles primarily rely on dashboard indicators, voice prompts, and onboard indicator lights to provide drivers with information about intelligent driving operation. Mainstream aftermarket solutions for retrofitting existing vehicles generally use onboard diagnostic system interfaces to connect to the vehicle's bus and read relevant driving data to provide status alerts. This approach requires analyzing and adapting the controller area network (CLAN) communication protocols of various vehicle models. However, the factory-installed integrated alert mechanism only works for new cars and is difficult to adapt to existing vehicles or third-party add-on intelligent driving kits. Retrofitting via onboard diagnostic system interfaces is an intrusive data collection method, which not only has limited vehicle compatibility but may also pose electrical safety risks and potentially void the original manufacturer's warranty. Furthermore, developers need to independently analyze the proprietary communication protocols for different vehicle models, resulting in a large development workload, increased overall retrofit costs, and longer product deployment cycles, making it difficult to efficiently meet the diverse needs of the aftermarket.

[0053] Therefore, when facing technical problems in existing technologies, to avoid the cumbersome process and safety risks of wiring, interface connection, and parsing vehicle protocols, intrusive data collection methods are abandoned. Instead, non-intrusive sensing methods such as voice recognition, image recognition, and Bluetooth broadcast packet recognition are adopted. These methods do not require any electrical or data interaction with the vehicle bus or OBD interface, and can independently collect the vehicle's intelligent driving system operating status, achieving universality across all vehicle models and low-cost rapid deployment. Addressing the issues of the original vehicle's single-mode prompts, fragmented information, and ease of driver neglect, based on obtaining accurate intelligent driving operating status, a signal adaptation and output stage is further deduced. By recognizing different intelligent driving conditions, exclusive prompt signals are generated and multimodal prompt information is independently output, unifying the intelligent driving status prompt entry point and providing drivers with intuitive and efficient feedback on the vehicle's real-time intelligent driving status.

[0054] Figure 1 This is an application scenario diagram illustrating the intelligent driving status prompting method provided in this application, such as... Figure 1 As shown, the scenario diagram corresponding to the intelligent driving status prompting method provided in this application includes: target vehicle 101 and intelligent driving status prompting device 102.

[0055] Optionally, the intelligent driving status prompt device 102 is fixed to the cabin of the target vehicle 101 by magnetic attraction or adhesive.

[0056] Understandably, if the intelligent driving status prompt device 102 uses image recognition for perception, it needs to be fixed in a position where the intelligent driving logo can be collected, such as the center of the upper edge of the steering wheel, the left side of the dashboard near the base of the A-pillar, or other positions naturally covered by the driver's peripheral vision.

[0057] It should be noted that the intelligent driving status prompting device 102 integrates an intelligent driving status prompting unit for status recognition, signal generation, and output. It also integrates sensors for collecting images, voice, Bluetooth signals, and other status information, such as miniature microphones and miniature cameras.

[0058] Specifically, during the driving of the target vehicle 101, the intelligent driving status notification device 102 collects the sounds inside the cabin in real time. If the collected sounds include adaptive cruise control being activated or ACC being engaged, the current intelligent driving status is determined to be activated. If the collected sounds include adaptive cruise control being disengaged or ACC being deactivated, the current intelligent driving status is determined to be deactivated. The intelligent driving status notification device 102 then generates corresponding notification signals based on the operating status, such as blue, slowly flashing lights for the activated status, or lights being off for the deactivated status. Finally, the intelligent driving status notification device 102 outputs a notification signal to inform the driver of the vehicle's current intelligent driving status.

[0059] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0060] Figure 2 This is a flowchart illustrating an embodiment of the intelligent driving status prompting method provided in this application, as shown below. Figure 2 As shown, the executing entity in this embodiment is an intelligent driving status prompting device. This device can be implemented through a computer program, or through a medium storing the relevant computer program, such as a USB flash drive and / or optical disc, or through an electronic device integrating or installing the relevant computer program, such as a state machine. The intelligent driving status prompting method provided in this embodiment includes the following steps:

[0061] S201. The current operating status of the vehicle's intelligent driving system is obtained by using a preset non-intrusive perception method, which includes at least one of voice recognition, image recognition, and Bluetooth broadcast packet recognition.

[0062] Among them, the preset non-intrusive perception method refers to an external perception and monitoring method that does not contact the vehicle's on-board bus, does not occupy the vehicle's OBD interface, does not modify the vehicle by cutting wires, and does not establish an electrical connection or intrusive data interaction with the vehicle's native control system.

[0063] Optionally, the operating status of the vehicle's intelligent driving system can be passively obtained by collecting environmental acoustic information, visual information, or wireless broadcast data through external devices, completely independently of the original vehicle's hardware and software system.

[0064] The operating status of the vehicle intelligent driving system refers to all working conditions of the vehicle intelligent driving assistance system during driving, including but not limited to the intelligent driving system standby state, intelligent driving function activation and operation state, system temporary exit state, driver takeover reminder state, system fault and abnormal state, etc., which can be presented to the outside world through the vehicle screen, vehicle voice, and wireless broadcast.

[0065] Optionally, a built-in audio pickup module continuously and in real time collects ambient sound signals from the vehicle cabin, such as intelligent driving status prompts from the vehicle's infotainment system, cabin noise, human voices, and sounds from in-vehicle devices. The collected raw acoustic signals undergo noise reduction, filtering, and voice-to-speech separation to remove invalid interference sounds such as wind noise, tire noise, and in-vehicle conversations. The purified audio features are then matched against pre-defined intelligent driving status keywords and fixed announcement templates. When an audio signal matching the preset standard voice features (intelligent driving activation, intelligent driving deactivation, driver takeover, system malfunction, etc.) is detected, the current intelligent driving operating status of the vehicle can be determined.

[0066] Optionally, an external vision acquisition unit can be used to capture real-time images of the vehicle's dashboard and central control screen, continuously acquiring visual image information of the in-vehicle interface. The acquired images undergo dynamic region cropping, image brightening, distortion correction, and feature extraction. Using a pre-trained intelligent driving interface image feature template, it identifies features such as intelligent driving-specific icons, status indicators, color changes, and text prompts within the image. By judging differences in features such as icon illumination status, icon color, and interface display content, it distinguishes different operating conditions of the intelligent driving system, such as activation, dormancy, exit, or warning.

[0067] Optionally, the Bluetooth monitoring function is enabled to scan and receive Bluetooth broadcast data packets broadcast by the vehicle's intelligent driving module or in-vehicle infotainment system. The monitored broadcast data packets are parsed and their features extracted to filter out valid broadcast data segments carrying intelligent driving status identifiers. Based on preset intelligent driving status data feature rules, the system operating status fields contained in the broadcast data are matched, and the real-time operating status of the intelligent driving system is identified based on the differences in data content.

[0068] It should be noted that one or more non-intrusive sensing methods can be selected for data collection. When multiple methods are used for data collection, the current state can be determined in multiple dimensions based on pre-configured rules.

[0069] S202. Generate corresponding prompt signals based on the operating status.

[0070] Among them, the prompt signal refers to the standardized, multimodal trigger signal that can drive the operation of peripheral devices, which is matched and generated according to different intelligent driving operation states. It includes types such as light prompt signal and sound and light combined prompt signal. Different signals correspond to unique intelligent driving conditions.

[0071] Optionally, a complete correspondence between intelligent driving status and prompting rules is pre-stored. After obtaining the real-time intelligent driving operation status of the vehicle, the recognition result is compared with the preset status rule library to lock the preset prompting strategy corresponding to the current intelligent driving condition and distinguish different levels of operating condition types such as normal operation status, status switching status, and risk warning status.

[0072] Specifically, based on the matched prompting strategy, customized prompting signals are generated in a differentiated manner. For example, in the stable operating state of the intelligent driving system when it is normally activated, a low-interference, normal steady-state prompting signal is generated. For state change scenarios such as the intelligent driving system being turned on, off, or switching operating conditions, a state-switching-specific prompting signal is generated.

[0073] Optionally, users can set preset parameters to customize signal characteristics, adapting to different light colors, flashing frequencies, and prompt strengths.

[0074] S203, output a prompt signal to inform the user of the current intelligent driving status of the vehicle.

[0075] Specifically, based on different types of prompt signals, the corresponding physical prompt module is activated to provide multimodal output. For example, in a stable intelligent driving operation scenario, the device continuously provides prompts with constant light and a low-rhythm, slow-flashing light. In scenarios involving changes in the intelligent driving status, such as activation, deactivation, or function switching, the device switches the exclusive light frequency and color, and can be accompanied by a slight prompt sound effect to prominently remind the driver to pay attention to changes in the system status.

[0076] It is understandable that the corresponding prompt output is continuously maintained and dynamically updated in real time, and the output form of the prompt signal is switched, terminated or updated in real time according to the changes in the vehicle's intelligent driving operation status, so as to ensure real-time synchronization between the intelligent driving status and the prompt effect.

[0077] Optionally, after each data acquisition step obtains a new state determination, a majority voting mechanism is used to filter out instantaneous noise. For example, if two identical state determinations are received consecutively within a 1-second time window, the state is confirmed and an output change is triggered. If the determination results are inconsistent, the original state is maintained. If no valid state update signal is received for 30 consecutive seconds, such as when the vehicle is turned off or the intelligent driving system is inactive for an extended period, the system automatically resets to the non-intelligent driving state.

[0078] The intelligent driving status prompting method provided in this application does not connect to the vehicle diagnostic system interface or the vehicle's CAN bus. It relies on external sensing methods such as voice recognition, image recognition, and Bluetooth broadcast packet recognition to collect the intelligent driving operating status. This achieves completely non-intrusive deployment, requiring no wire cutting, no occupation of the vehicle diagnostic system interface, and no electrical or data interaction with the vehicle's onboard bus, avoiding bus conflicts and short-circuit risks, and preventing impact on the original manufacturer's warranty. It eliminates the need to analyze proprietary communication protocols for different vehicle brands, significantly reducing the adaptation and development costs for existing vehicles, third-party intelligent driving kits, and autonomous driving test vehicles, shortening the deployment cycle, and achieving cross-vehicle compatibility. Multiple sensing methods are selectable and can be integrated; when a single sensing method is affected by environmental interference, multiple sensing paths can be combined to improve recognition reliability. It adapts to different vehicle hardware conditions, compatible with various existing vehicle scenarios such as those without external Bluetooth output, without a prominent intelligent driving screen UI, and those requiring intelligent driving status voice broadcasts. The deployment threshold is low, requiring only an external independent device to operate, achieving low-cost and rapid installation, meeting the aftermarket's needs for modifying existing vehicles. Different intelligent driving conditions correspond to different prompt signals, which can clearly distinguish the differences in status and avoid confusion for the driver regarding the system's operating status. A unified information output source aggregates and normalizes the fragmented intelligent driving information scattered across the original vehicle's instrument panel and in-vehicle voice system, eliminating the need for the driver to search for status information in multiple places and reducing distraction.

[0079] As an optional implementation, based on the above embodiments, obtaining the operating status includes:

[0080] Acquire audio signals from inside the vehicle's cabin;

[0081] A preset speech recognition model is used to extract speech features from audio signals and then match them in a preset template library.

[0082] If the matching degree is greater than the preset matching threshold, the current operating status of the intelligent driving system is determined to be either on or off.

[0083] Among them, the preset speech recognition model refers to the feature extraction model that has been pre-trained and deployed on the local device, which is used to separate and extract the acoustic features corresponding to the in-vehicle broadcast statements from the mixed audio.

[0084] Among them, the preset template library refers to the set of standard voice features corresponding to multiple intelligent driving status broadcast statements that have been pre-recorded, including at least two types of baseline features: intelligent driving start broadcast template and intelligent driving stop broadcast template.

[0085] Among them, the preset matching threshold refers to the pre-set similarity threshold, which serves as the boundary for distinguishing between valid matches and noisy mismatches.

[0086] Specifically, a sound pickup unit, such as a built-in microphone, continuously collects sound wave vibrations in the cabin environment, for example, at a sampling rate of 16kHz. These air vibrations are converted into continuous audio signals and continuously fed into the processing unit. The original mixed audio signal includes both intelligent driving status prompts from the vehicle's infotainment system and various driving environment noises and human voices, resulting in...

[0087] Furthermore, noise reduction preprocessing is performed on the original audio signal to suppress interference from stable environments such as wind noise and tire noise, and to reduce the impact of irrelevant voice conversations among occupants. A local preset speech recognition model is invoked to select valid speech segments from the processed audio and extract the corresponding speech features. The extracted real-time speech features are then compared one by one with the standard features stored in the preset template library, and the matching degree between the current feature and each template feature is calculated.

[0088] Optionally, the calculated matching score is compared with a pre-set matching threshold. When the matching score between a real-time feature and a template feature exceeds the threshold, a valid intelligent driving broadcast voice is detected. Based on the matched template type, the intelligent driving system is determined to be either on or off. If the matching score does not reach the threshold, the audio segment is considered noise or irrelevant speech, the intelligent driving operation status is not updated, and the next round of audio acquisition and feature matching continues.

[0089] The intelligent driving status prompting method provided in this application passively senses the start-stop status of intelligent driving through cockpit audio. This non-intrusive sensing method eliminates the reliance on vehicle bus protocols inherent in traditional aftermarket solutions, reducing the modification threshold and safety risks. Based on voice feature template matching, it achieves local status recognition without requiring a network connection, adapting to complex in-vehicle environments and enabling low-cost external sensing of the intelligent driving status of existing vehicles, providing reliable status input for external prompting devices.

[0090] As an optional implementation, based on the above embodiments, obtaining the operating status includes:

[0091] Get the image of the location of the intelligent driving icon;

[0092] The system uses a pre-defined image recognition algorithm to extract the intelligent driving icon from the image and recognize the icon's shape.

[0093] Based on the recognition results, the current operating status of the intelligent driving system is determined to be either on or off.

[0094] The image where the intelligent driving icon is located refers to the fixed screen area where the intelligent driving assistance status icon is displayed in the original vehicle, such as the instrument panel or the central control screen. The image includes the intelligent driving icon and background interface information.

[0095] Among them, the preset image recognition algorithm refers to the image analysis strategy pre-configured in the local device, which is used to locate target icons in the image and extract visual features such as graphic outlines, colors, and styles.

[0096] Icon form refers to a set of visual features that can distinguish the working conditions, such as the icon outline style, fill color, lighting status, and line style.

[0097] Specifically, a visual acquisition component, such as a built-in miniature camera, is used to continuously capture real-time images of the vehicle's dashboard or central control screen's smart driving icon display area, pre-aimed at a frame rate of 5-10 fps. The raw images include the screen background, UI elements, and the target smart driving icon.

[0098] Furthermore, the original image undergoes preprocessing to eliminate image quality interference caused by strong light reflections and image jitter, and to adjust image contrast and clarity. A preset image recognition algorithm is used to search for and match the target graphic outline within a defined image area, locating and separating the intelligent driving icon, while removing irrelevant visual elements such as text and other function icons from the screen. Multiple visual features of the icon are extracted, identifying icon morphology information such as whether the icon is lit, graphic color, and outline style, forming the current icon feature data.

[0099] Optionally, the icon morphology features obtained in real time are compared with pre-stored standard icon samples. For example, if an icon is detected as lit or active, the intelligent driving system is determined to be in an on state. If an icon is detected as off or grayed out and inactive, the intelligent driving system is determined to be in a off state. If the target icon cannot be detected in the image, the original state is maintained or the recognition is determined to be invalid, and the next round of image acquisition and recognition is carried out.

[0100] The intelligent driving status prompting method provided in this application embodiment reads the intelligent driving icon information of the original vehicle instrument panel non-contactly through visual perception, breaking away from the limitations of traditional aftermarket solutions that rely on reading data from the vehicle's bus. It is simple to deploy and has low modification risk. Relying on local image feature recognition to obtain the intelligent driving start-stop status, it is compatible with a large number of existing vehicle models and can provide a reliable status input method for external independent prompting devices.

[0101] As an optional implementation, based on the above embodiments, obtaining the operating status includes:

[0102] Obtain data packets broadcast by the vehicle's Bluetooth system;

[0103] Parse the Bluetooth broadcast packet to obtain the intelligent driving status identifier;

[0104] The current operating status of the intelligent driving system is determined by the intelligent driving status flag, indicating whether it is in the on or off state.

[0105] Among them, the data packets broadcast by the vehicle Bluetooth system refer to the broadcast data frames that the vehicle's infotainment system or intelligent driving controller periodically and actively sends to the outside on the wireless channel without the need to establish a Bluetooth pairing connection. The data frames carry basic device information and optional service status data, and are transmitted to the outside via spatial radio waves.

[0106] Among them, the intelligent driving status flag is a predefined data field inside the Bluetooth broadcast packet. Different values ​​represent the two working conditions of the intelligent driving system being on and off, such as 1 for on and 0 for off. It is a feature marker that represents the working status of intelligent driving.

[0107] Specifically, a wireless listening channel is activated, such as a built-in low-power Bluetooth broadcast receiver, to continuously scan for Bluetooth wireless signals in the air within the effective signal coverage area, passively receiving broadcast data packets periodically emitted by the target vehicle's Bluetooth module. The target vehicle's signal is filtered, removing broadcast data from other vehicles, mobile phones, and other irrelevant Bluetooth devices in the vicinity, while continuously capturing valid raw broadcast data packets. The data packet content is then disassembled according to the Bluetooth broadcast data standard format, stripping away irrelevant basic information such as device name and signal strength, locating and extracting the data segments carrying business information within the data packets, and separating out the intelligent driving status identifier bits specifically used to characterize the intelligent driving operating conditions.

[0108] Optionally, the system retrieves the internally stored rules for matching flag values ​​with intelligent driving conditions. The parsed intelligent driving status flag values ​​are compared with the preset rules. If the flag value is the first preset value, the intelligent driving system is determined to be on. If the flag value is the second preset value, the intelligent driving system is determined to be off. If no valid flag is identified in the data packet, the parsing result is discarded, and the system continues to wait for the next round of Bluetooth broadcast data packets.

[0109] The intelligent driving status prompting method provided in this application relies on passively listening to the vehicle's Bluetooth broadcast to collect intelligent driving status data. This process is entirely non-intrusive and requires no interaction with the vehicle, overcoming the complex protocol adaptation challenges of traditional OBD and CAN bus solutions. It can be used independently or integrated with acoustic and visual perception solutions to form multi-mode perception, significantly expanding the applicable scenarios of the entire intelligent driving status prompting device.

[0110] As an optional implementation, based on the above embodiments, generating corresponding prompt signals includes:

[0111] Based on the operating status, a light signal with varying values ​​in at least one of the following dimensions is generated: color, brightness, and flashing frequency.

[0112] Among them, the light signal refers to the visible light prompt information output by the external light-emitting unit, which can distinguish different intelligent driving conditions through multiple adjustable dimensions.

[0113] Optionally, configuration rules corresponding to the intelligent driving operating status and lighting parameters can be pre-stored. Once a certain intelligent driving operating status is obtained, the lighting control strategy matched to that condition is retrieved.

[0114] Specifically, differentiated lighting parameter combinations are configured for the two operating conditions of intelligent driving on and off, adjusting at least one attribute: color, brightness, or flashing frequency. For example, when intelligent driving is continuously on, a constant color, medium brightness, and constant-on, flicker-free light signal is used. When the intelligent driving system switches between on and off states, the light color is changed, or a specified flashing frequency is enabled. The brightness can also be temporarily increased to enhance the warning effect when the system status changes.

[0115] Understandably, the light-emitting unit continuously outputs the corresponding light signal according to the selected parameter combination. When a change in the intelligent driving operation status is detected, the light color, brightness, or flashing frequency is updated in real time, and the light signal display is switched synchronously. If the recognition result is invalid, the light can be turned off or low-power standby light can be maintained to avoid invalid prompts interfering with driving.

[0116] The intelligent driving status prompting method provided in this application embodiment achieves visual prompts of intelligent driving status through multi-dimensional adjustable light signals of color, brightness, and flashing frequency. It constructs an external prompting channel independent of the original vehicle instrument panel and original vehicle voice prompts. The prompting format is intuitive and stable, and is not affected by in-vehicle noise. The solution is easy to implement in hardware and flexible in deployment, and can be placed in the driver's peripheral vision area, effectively making up for the shortcomings of the original vehicle prompting method.

[0117] As an optional implementation, based on the above embodiments, it further includes:

[0118] Receive custom configuration commands sent by the user;

[0119] The parameters of the prompt signals corresponding to different running states can be adjusted based on custom configuration commands.

[0120] Among them, the custom configuration command refers to the parameter adjustment command manually issued by the user according to their own driving habits and vehicle use scenarios. It is used to independently set the prompt light signal attributes corresponding to different intelligent driving operation states. The command can cover adjustable prompt parameters such as light color, light brightness, and flashing frequency.

[0121] The prompt signal parameters refer to the set of characteristic parameters used to define the external light prompt effect, including color parameters, brightness parameters, and flashing frequency parameters.

[0122] Specifically, a user-defined configuration interaction channel is reserved, such as connecting to the user's mobile app via Bluetooth. Users can independently edit and issue configuration commands according to their personal needs while parked or in a safe driving state. When receiving user commands to adjust lighting parameters for different intelligent driving operating states, including custom settings for light color, brightness, and flashing rhythm for intelligent driving on and off states, the system verifies the validity of the received configuration commands, filtering out abnormal or excessive invalid commands.

[0123] Optionally, the voice recognition matching threshold and image recognition sensitivity can be adjusted to adapt to the voice broadcasting habits and dashboard icon styles of different vehicle models.

[0124] Furthermore, the system reads and verifies valid custom configuration commands, overwriting and replacing the system's default prompt signal parameter configurations. For different operating states, such as intelligent driving on and off, the bound light color, brightness, and flashing frequency parameters are updated accordingly. After parameter adjustments, the device automatically saves the updated configuration rules, establishing a new correspondence between intelligent driving operating states and light signal prompt styles. During subsequent vehicle operation, when the corresponding intelligent driving condition is detected, a prompt light signal will be output according to the user-defined new parameters.

[0125] The intelligent driving status prompting method provided in this application avoids the problems of existing intelligent driving status prompting schemes having fixed prompt styles and being unable to adapt to users' personalized needs by adding a user-customizable configuration function. Based on non-intrusive and accurate identification of intelligent driving status and output of differentiated light signals, it achieves flexible adjustment of prompt parameters, preserving the security and stability of standardized device prompts while improving device flexibility and user adaptability, further perfecting a low-cost, modification-free, and highly adaptable aftermarket intelligent driving status prompting system.

[0126] As an optional implementation, based on the above embodiments, it further includes:

[0127] Obtain the current light intensity inside the vehicle's cabin;

[0128] Adjust the brightness and color saturation of the changing light signal corresponding to the current operating state based on the light intensity.

[0129] The cabin illumination intensity refers to the real-time ambient light intensity inside the vehicle cabin, which is composed of natural light and interior lighting, and can reflect the current cabin brightness.

[0130] Specifically, the device is equipped with a photosensitive acquisition unit that continuously collects ambient light information inside the cabin in real time and outputs the corresponding light intensity values. The acquisition work is ongoing, continuously capturing changes in light under different scenarios such as direct sunlight during the day, cloudy days, tunnels, and low light at night, with the acquisition range covering the cabin environment surrounding the device.

[0131] Optionally, multiple preset light thresholds and corresponding lighting adjustment strategies are configured internally. The real-time acquired light intensity is compared with the preset thresholds.

[0132] Optionally, when the cabin lighting is strong, the brightness and color saturation of the light signal are simultaneously increased to ensure that the light colors are clearly distinguishable in bright light environments and are not easily drowned out by ambient light. When the cabin lighting is weak, at night, or in a tunnel scenario, the light brightness is appropriately reduced, and the color saturation is lowered to avoid the light being too glaring and interfering with the driver's vision.

[0133] It should be noted that when the intelligent driving operation state changes, the lighting environment correction result is superimposed on the basic lighting parameters corresponding to the new state, and the output light signal is adapted to the current environment. As the cabin lighting continues to change, the brightness and saturation parameters are dynamically updated in real time to achieve adaptive adjustment of the warning lights.

[0134] The intelligent driving status prompting method provided in this application, while retaining multi-dimensional differentiated light signal prompts, dynamically optimizes the visual prompting effect, further improving the reliability of human-computer interaction in all-weather scenarios. Simultaneously, this function is entirely implemented using the external device's own hardware, maintaining the advantages of a non-intrusive and easily retrofitted system, and enhancing the adaptability of external intelligent driving prompting devices in various driving scenarios.

[0135] As an optional implementation, based on the above embodiments, it further includes:

[0136] Receive prompt signal instructions sent by the main module and output prompt signals based on the instructions;

[0137] If no instruction is received from the main module within a preset time period, a prompt signal will be output according to the preset prompt rules.

[0138] The main module refers to the core processing unit among the multiple intelligent driving status prompting devices currently deployed in the cockpit, which is used for non-intrusive perception, identification of intelligent driving operation status and generation of prompt signal commands. It is used to complete voice, image, Bluetooth multimodal status recognition and command generation, and output effective control commands to the outside.

[0139] It is understandable that when multiple intelligent driving status prompting devices are deployed in the cockpit, they are divided into a main module and a slave module, with the slave module being the execution entity in this embodiment. The main module and the slave module communicate via Bluetooth Low Energy. The main module is responsible for status acquisition and decision-making, while the slave module only receives instructions and outputs light signals, thereby realizing panoramic cockpit prompts.

[0140] The preset duration refers to the maximum interval time for receiving legitimate instructions, which serves as a threshold for determining whether the system is working properly and whether the data link is transmitting data normally.

[0141] Among them, the preset prompt rules refer to the pre-stored abnormal fallback prompt strategy, which is used to output fixed and standardized fallback prompt optical signals in the case of command interruption, signal loss, identification abnormality and other working conditions, so as to realize fault tolerance prompt.

[0142] Specifically, it continuously monitors the prompt signal commands issued by the main module, and under normal operating conditions, it receives control commands updated by the main module based on the intelligent driving operation status in real time. After obtaining a valid command, it parses the parameter information such as light color, brightness, and flashing frequency contained in the command, and synchronously drives the light output unit to match the current intelligent driving condition, outputting the corresponding differentiated light signal in real time.

[0143] Furthermore, the system continuously monitors the command reception interval to determine the update status of the main module's commands in real time. If no new valid command is received for more than a preset time due to environmental interference, momentary recognition anomalies, or data transmission fluctuations, it is determined to be in a signal abnormality or disconnection state, automatically triggering a local fallback alert mechanism. This mechanism invokes pre-defined unified alert rules and outputs a fixed, fault-tolerant alert light signal, such as the light signal output according to the command from the previous cycle. Upon receiving a valid command from the main module again, it automatically exits the fallback mode and resumes dynamic alert output based on the real-time status of the intelligent driving system.

[0144] The intelligent driving status prompting method provided in this application constructs a fault-tolerant prompting system with self-fault monitoring capabilities through a dual mechanism of normal command follow-up output and timeout fallback prompts. While ensuring accurate matching of intelligent driving status and dynamic output of differentiated prompting signals under normal conditions, it avoids the risk of prompt failure caused by environmental interference, recognition fluctuations, and transmission anomalies. Through a multi-device collaborative prompting mechanism, it can still provide stable prompts in complex scenarios, avoiding information loss due to single-point failures, further improving the system's fault tolerance and ensuring driving safety.

[0145] Figure 3 This is a flowchart illustrating another embodiment of the intelligent driving status prompting method provided in this application, as shown below. Figure 3 As shown, the intelligent driving status prompting method provided in this embodiment includes the following steps:

[0146] S301: Receive custom configuration commands sent by the user.

[0147] S302. Adjust the parameters of the prompt signals corresponding to different operating states based on custom configuration instructions.

[0148] S303, Acquire audio signals from inside the vehicle cabin.

[0149] S304. Use a preset speech recognition model to extract speech features from the audio signal and match them in a preset template library.

[0150] S305. If the matching degree is greater than the preset matching threshold, the current operating state of the intelligent driving system is determined to be either on or off.

[0151] S306, Obtain the image of the location of the Smart Driving icon.

[0152] S307: Uses a preset image recognition algorithm to extract the intelligent driving icon from the image and recognize the icon's shape.

[0153] S308. Based on the recognition results, determine whether the current operating status of the intelligent driving system is on or off.

[0154] S309. Obtain the data packet broadcast by the vehicle's Bluetooth system.

[0155] S310: Parse the Bluetooth broadcast packet to obtain the intelligent driving status identifier.

[0156] S311. Determine whether the current operating status of the intelligent driving system is on or off based on the intelligent driving status flag.

[0157] It should be noted that in practical applications, one or more of the following methods can be selected for data collection: S303-S305, S306-S308, and S309-S311.

[0158] S312. Based on the operating status, generate a light signal that varies in at least one dimension, including color, brightness, and flashing frequency.

[0159] S313. Obtain the current light intensity inside the vehicle's cabin.

[0160] S314. Adjust the brightness and color saturation of the changing light signal corresponding to the current operating state according to the light intensity.

[0161] S315 outputs a light signal to alert the user to the vehicle's current intelligent driving status.

[0162] It should be noted that the execution order of S303-S305, S306-S308, and S309-S311 is not important.

[0163] In this embodiment, the implementation method and technical effect of S301-S315 are similar to those of the corresponding solutions in the above embodiments, and will not be repeated here.

[0164] Figure 4 This is a flowchart illustrating a method for providing intelligent driving status alerts according to another embodiment of this application. This embodiment shows multiple intelligent driving status alert devices deployed in the cockpit, such as... Figure 4 As shown, the intelligent driving status prompting method provided in this embodiment includes the following steps:

[0165] S401: Receive the prompt signal instruction sent by the main module, and output the prompt signal based on the instruction.

[0166] S402. If no instruction is received from the main module after a preset time period, a prompt signal is output according to the preset prompt rules.

[0167] In this embodiment, the implementation method and technical effect of S401-S402 are similar to those of the corresponding solutions in the above embodiments, and will not be repeated here.

[0168] Figure 5 This is a schematic diagram of the intelligent driving status prompting device provided in this application, as shown below. Figure 5 As shown, the intelligent driving status prompting device 50 provided in this embodiment includes: an acquisition module 51, a generation module 52, and an output module 53.

[0169] The acquisition module 51 is used to acquire the current operating status of the vehicle's intelligent driving system using a preset non-intrusive perception method, which includes at least one of voice recognition, image recognition, and Bluetooth broadcast packet recognition; the generation module 52 is used to generate a corresponding prompt signal based on the operating status; and the output module 53 is used to output the prompt signal to prompt the user about the current intelligent driving status of the vehicle.

[0170] The intelligent driving status prompting device provided in this embodiment can perform... Figure 2 , Figure 3 as well as Figure 4 The implementation principles and technical effects of the methods shown are similar, and will not be repeated here.

[0171] Optionally, the acquisition module 51, when acquiring the operating status, is specifically used to: acquire the audio signal inside the vehicle cabin; extract speech features from the audio signal using a preset speech recognition model and match them in a preset template library; if the matching degree is greater than a preset matching threshold, determine whether the current operating status of the intelligent driving system is on or off.

[0172] Optionally, the acquisition module 51, when acquiring the operating status, is specifically used to: acquire an image of the location of the intelligent driving icon; extract the intelligent driving icon from the image using a preset image recognition algorithm and identify the icon shape; and determine whether the current operating status of the intelligent driving system is on or off based on the recognition result.

[0173] Optionally, the acquisition module 51, when acquiring the operating status, is specifically used for: acquiring data packets broadcast by the vehicle's Bluetooth system; parsing the Bluetooth broadcast packets to obtain the intelligent driving status identifier; and determining whether the current operating status of the intelligent driving system is on or off based on the intelligent driving status identifier.

[0174] Optionally, when generating the corresponding prompt signal, the generation module 52 is specifically used to: generate a light signal with changes in at least one dimension, including color, brightness, and flashing frequency, based on the operating status.

[0175] Optionally, the intelligent driving status prompting device provided in this embodiment further includes a receiving module and an adjustment module.

[0176] Correspondingly, the receiving module is used to receive custom configuration commands sent by the user; the adjustment module is used to adjust the parameters of the prompt signals corresponding to different operating states based on the custom configuration commands.

[0177] Optionally, the acquisition module 51 is also used to acquire the current light intensity in the vehicle cabin; the adjustment module is also used to adjust the brightness and color saturation of the changing light signal corresponding to the current operating state according to the light intensity.

[0178] Optionally, the receiving module is also used to receive the prompt signal instruction sent by the main module; the output module 53 is also used to output the prompt signal based on the instruction; in response to not receiving the instruction sent by the main module for a preset time period, the prompt signal is output according to the preset prompt rules.

[0179] Figure 6 This is a structural diagram of the intelligent driving status prompting device provided in this application. Figure 6 As shown, the intelligent driving status prompting device 60 provided in this embodiment includes a processor 61 and a memory 62. The processor 61 and the memory 62 are connected via a bus and communicate with each other.

[0180] In the specific implementation process, the processor 61 executes the computer execution instructions stored in the memory 62, causing the processor 61 to perform the above-described method.

[0181] The specific implementation process of processor 61 can be found in the above method embodiments, and its implementation principle and technical effect are similar. It will not be repeated here.

[0182] In the above embodiments, it should be understood that the processor 61 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0183] The memory 62 may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device.

[0184] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0185] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described method.

[0186] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the above-described method.

[0187] The aforementioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0188] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0189] The division of units is merely a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0190] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0191] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0192] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0193] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0194] Finally, it should be noted that other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein, and is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A method for providing intelligent driving status prompts, characterized in that, The method includes: The current operating status of the vehicle's intelligent driving system is obtained using a preset non-intrusive perception method, which includes at least one of voice recognition, image recognition, and Bluetooth broadcast packet recognition. Generate corresponding prompt signals based on the operating status; The prompt signal is output to inform the user of the current intelligent driving status of the vehicle.

2. The method according to claim 1, characterized in that, Get the running status, including: Acquire audio signals from inside the vehicle's cabin; A preset speech recognition model is used to extract speech features from audio signals and then match them in a preset template library. If the matching degree is greater than the preset matching threshold, the current operating status of the intelligent driving system is determined to be either on or off.

3. The method according to claim 1, characterized in that, Get the running status, including: Get the image of the location of the intelligent driving icon; The system uses a pre-defined image recognition algorithm to extract the intelligent driving icon from the image and recognize the icon's shape. Based on the recognition results, the current operating status of the intelligent driving system is determined to be either on or off.

4. The method according to claim 1, characterized in that, Get the running status, including: Obtain data packets broadcast by the vehicle's Bluetooth system; Parse the Bluetooth broadcast packet to obtain the intelligent driving status identifier; The current operating status of the intelligent driving system is determined by the intelligent driving status flag, indicating whether it is in the on or off state.

5. The method according to claim 1, characterized in that, Generate corresponding prompt signals, including: Based on the operating status, a light signal with varying values ​​in at least one of the following dimensions is generated: color, brightness, and flashing frequency.

6. The method according to claim 1, characterized in that, Also includes: Receive custom configuration commands sent by the user; The parameters of the prompt signals corresponding to different running states can be adjusted based on custom configuration commands.

7. The method according to claim 5, characterized in that, Also includes: Obtain the current light intensity inside the vehicle's cabin; Adjust the brightness and color saturation of the changing light signal corresponding to the current operating state based on the light intensity.

8. The method according to claim 1, characterized in that, Also includes: Receive prompt signal instructions sent by the main module and output prompt signals based on the instructions; If no instruction is received from the main module within a preset time period, a prompt signal will be output according to the preset prompt rules.

9. A smart driving status prompting device, characterized in that, include: The memory, the processor, and at least one of the following: an audio acquisition sensor, an image acquisition sensor, and a Bluetooth receiver; The intelligent driving status prompting device is fixed in the vehicle cabin using a non-intrusive deployment method, which includes one of magnetic, adhesive, or suspended types. The audio acquisition sensor is used to acquire audio signals inside the vehicle cabin; The image acquisition sensor is used to acquire images of the location of the intelligent driving icon; The Bluetooth receiver is used to receive data packets broadcast by the vehicle's Bluetooth system; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1-8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-8.

Images