In-vehicle driving safety analysis method, device and equipment, medium and vehicle

By obtaining and analyzing audio data in the automotive DVR, identifying abnormal situations in the car and generating early warning signals, the problem that the existing technology cannot avoid safety risks in the car in advance is solved, and driving safety and intelligence are improved.

CN119028079APending Publication Date: 2024-11-26CHONGQING CHANGAN AUTOMOBILE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411042960.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing automotive DVR cannot meet the increasingly intelligent needs of cars and cannot avoid the safety risks caused by drivers and passengers in the car in advance, such as dangerous driving caused by out-of-control by drivers and passengers, resulting in traffic accidents. occur.

Method used

By obtaining the audio data during the recording process when the vehicle video recording function is turned on, encapsulate it into an audio frame, and determining whether an abnormality occurs in the car based on the audio frame, generating an abnormal signal to identify unsafe scenes and provide early warnings, improving Drive safe.

Benefits of technology

Enrich the functions of car DVR, realize in-car driving safety analysis and early warning, improve driving safety, meet the intelligent needs of cars, and remind drivers and passengers to pay attention to car safety standards through the reporting of abnormal signals, reducing The incidence rate of accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119028079A_ABST
    Figure CN119028079A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of automobile safety detection, and discloses an in-vehicle driving safety analysis method, device and equipment, a medium and a vehicle, and the method comprises the steps: obtaining audio data in a video recording process in a state that a vehicle video recording function is turned on, and packaging the audio data into audio frames; determining whether abnormity occurs in the vehicle according to the audio frame; and when an abnormality occurs in the vehicle, generating an abnormal signal. In the video recording process, whether the interior of the vehicle is abnormal or not is judged according to the audio information, the DVR function of the vehicle can be enriched, in-vehicle driving and riding safety analysis, in-vehicle unsafe scene recognition and early warning are achieved while video recording is conducted, driving and riding safety is improved, and the intelligent requirement of the vehicle is met.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of automobile safety detection, and in particular to an analysis method, device, equipment, medium and vehicle for in-vehicle driving safety. Background Art

[0002] With the rapid development of science and technology, the integration of the automotive industry and information technology is no longer a new thing. Car DVR (Digital Video Recorder), that is, the in-vehicle digital video recorder, is an outstanding product of this integration trend. It is not just a simple recording device, but also integrates a variety of advanced technologies to provide strong support for modern automobile safety and management. The original intention of car DVR is to solve the monitoring problem during the driving process of the car, ensure driving safety, and also provide an effective tool for vehicle management. For example, in the field of public transportation, such as buses, subways, trains, etc., car DVR can provide real-time monitoring data for management departments to ensure driving safety and improve service quality. In addition, in the fields of long-distance passenger transportation, school buses, engineering vehicles, etc., car DVR can also provide safety protection for drivers and passengers, and help management departments to achieve remote monitoring and dispatch.

[0003] When a car is driving, there are many unsafe scenes inside the cabin, such as: road rage of the driver and passengers, which can easily lead to dangerous driving; quarrels between the driver and passengers, which can easily distract the driver from driving; when major safety risks occur, the driver and passengers are likely to scream out of control and fail to make correct judgments. These are one of the main causes of road traffic accidents. At present, DVRs are usually used to record videos while the car is driving, which is equivalent to the "recorder" of the car, but they cannot meet the current higher and higher intelligent needs of cars and cannot achieve the effect of avoiding risks in advance. Summary of the invention

[0004] In view of this, the present invention provides an analysis method, device, equipment, medium and vehicle for in-vehicle driving safety to solve the problem of single function of automobile DVR.

[0005] In a first aspect, the present invention provides a method for analyzing in-vehicle driving safety, which is applied to a vehicle cloud server, and the method includes:

[0006] When the vehicle video recording function is turned on, the audio data during the recording process is obtained and the audio data is encapsulated into audio frames;

[0007] Determine whether an abnormality occurs in the vehicle according to the audio frame;

[0008] When an abnormality occurs in the vehicle, an abnormality signal is generated.

[0009] The method for analyzing in-vehicle driving safety provided by the embodiment of the present invention obtains audio data during the recording process when the vehicle video recording function is turned on, encapsulates the audio data into audio frames to determine whether an abnormality occurs, and generates an abnormal signal if an abnormality occurs. The present invention can enrich the car DVR function by judging whether an abnormality occurs in the car according to audio information during the video recording process, realizes in-vehicle driving safety analysis while recording, identifies unsafe scenes in the car and issues early warnings, improves driving safety, and meets the intelligent needs of the car.

[0010] In an optional implementation, when the vehicle video recording function is turned on, before obtaining audio data during the recording process and encapsulating the audio data into audio frames, it also includes: obtaining the current window state; if the current window state is closed, turning on the vehicle video recording function.

[0011] The present invention can prevent the noisy environment outside the vehicle from affecting the accuracy of the driving safety analysis inside the vehicle by turning on the video recording function when the vehicle windows are closed, thereby ensuring the reliability of the safety analysis results.

[0012] In an optional implementation, audio data is encapsulated into audio frames, including: performing analog-to-digital conversion on audio data in the form of an analog signal to obtain digital audio data in a preset format; quantizing the digital audio data according to a first preset time interval and obtaining the corresponding audio time; and encapsulating the quantized digital audio data into different audio frames according to the audio time, the audio frames including: a frame sequence, a payload and a timestamp, the frame sequence being the audio frame sequence number, the payload being the digital audio data within the first preset time interval, and the timestamp being the audio time.

[0013] The present invention can facilitate the processing of audio data by encapsulating audio data into audio frames, and facilitate subsequent abnormality analysis based on the audio data.

[0014] In an optional implementation, determining whether an abnormality occurs in a vehicle based on an audio frame includes: combining digital audio data in a load in byte order to obtain a plurality of data bits; adding the plurality of data bits to obtain a volume value; comparing the volume value with a preset sound intensity threshold, and if the volume value is greater than the preset sound intensity threshold, determining that an abnormality is triggered; and performing abnormal triggering judgment on loads of different audio frames, and if the continuous abnormal triggering exceeds a preset number of times, determining that an abnormality occurs in the vehicle.

[0015] By comparing audio data with a sound intensity threshold, the present invention can determine when the sound inside the car is louder, thereby accurately determining abnormalities inside the car when the driver or passengers are angry, quarreling, or screaming out of control, and limiting the continuous abnormal triggering time to avoid misjudgment.

[0016] In an optional embodiment, when an abnormality occurs in the vehicle, after an abnormality signal is generated, it also includes: obtaining video data recorded within a second preset time interval before and after the timestamp of the audio data corresponding to the last abnormal trigger; and reporting the abnormal signal to the dashboard for display.

[0017] The present invention can provide video evidence for subsequent abnormal situation processing by acquiring recorded video data after an abnormality occurs, and at the same time report the abnormal signal to the instrument panel, which can remind the driver and passengers to pay attention to vehicle safety regulations and reduce the occurrence rate of accidents.

[0018] In a second aspect, the present invention provides an analysis device for in-vehicle driving safety, the device comprising: a data acquisition module, for acquiring audio data during the recording process when the vehicle video recording function is turned on, and encapsulating the audio data into audio frames; an abnormality judgment module, for determining whether an abnormality occurs in the vehicle based on the audio frames; and a signal generation module, for generating an abnormality signal when an abnormality occurs in the vehicle.

[0019] In a third aspect, the present invention provides a computer device, comprising: a memory and a processor, the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the in-vehicle driving safety analysis method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0020] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the in-vehicle driving safety analysis method of the first aspect or any corresponding embodiment thereof.

[0021] In a fifth aspect, the present invention provides a computer program product, comprising computer instructions for causing a computer to execute the in-vehicle driving safety analysis method of the first aspect or any corresponding embodiment thereof.

[0022] In a sixth aspect, the present invention provides a vehicle, comprising: a digital video recorder for collecting in-vehicle audio data and performing video recording; a controller for executing the in-vehicle driving safety analysis method of the above-mentioned first aspect or any corresponding embodiment thereof; and an instrument panel for displaying abnormal signals.

[0023] Beneficial effects of the present invention:

[0024] (1) The present invention can enrich the functions of the automobile DVR by judging abnormalities in the vehicle according to the audio data of the recording process when the vehicle video recording function is turned on, realize the driving safety analysis in the vehicle while recording, identify unsafe scenes in the vehicle and issue early warning, improve driving safety, and meet the intelligent needs of the automobile;

[0025] (2) The present invention can obtain recorded video when an abnormality occurs in the vehicle and report the abnormal signal to the dashboard, thereby providing video evidence for abnormal situation processing and reminding drivers and passengers to pay attention to vehicle safety regulations, thereby reducing the incidence of accidents. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 is a flow chart of a method for analyzing in-vehicle driving safety according to an embodiment of the present invention;

[0028] Figure 2 is a flow chart of another method for analyzing in-vehicle driving safety according to an embodiment of the present invention;

[0029] Figure 3 is a schematic diagram of a data processing flow of another in-vehicle driving safety analysis method according to an embodiment of the present invention;

[0030] Figure 4 is a schematic diagram of sampling values ​​of another in-vehicle driving safety analysis method according to an embodiment of the present invention;

[0031] Figure 5 is a weight diagram of another in-vehicle driving safety analysis method according to an embodiment of the present invention;

[0032] Figure 6 is a flow chart of another method for analyzing in-vehicle driving safety according to an embodiment of the present invention;

[0033] Figure 7 is a schematic diagram of a judgment flow of another method for analyzing in-vehicle driving safety according to an embodiment of the present invention;

[0034] Figure 8 is a structural block diagram of a device for analyzing in-vehicle driving safety according to an embodiment of the present invention;

[0035] Fig. 9 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0036] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0037] The embodiment of the present invention is applicable to the scenario of analyzing the safety in the car while the car is driving. The embodiment of the present invention provides a method for analyzing the driving safety in the car, which can enrich the car DVR function and realize the effect of early warning by judging whether there is an abnormality in the car according to the audio data when the vehicle video recording function is turned on.

[0038] According to an embodiment of the present invention, an embodiment of an analysis method for in-vehicle driving safety is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0039] In this embodiment, a method for analyzing in-vehicle driving safety is provided, which can be used for automobiles. Figure 1 is a flow chart of a method for analyzing in-vehicle driving safety according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0040] Step S101, when the vehicle video recording function is turned on, obtain audio data during the recording process and encapsulate the audio data into audio frames.

[0041] Specifically, in the embodiment of the present invention, when the car is driving, the built-in DVR in the car can perform the functions of long-term video recording, audio recording, remote monitoring and control of images and voices, wherein the sound is collected through the microphone in the car. The embodiment of the present invention multiplexes the received audio data into two channels, one for the conventional DVR function and one as the audio data of the embodiment of the present invention. Because the audio data collected by the microphone is an analog signal, in order to facilitate its processing and analysis, the embodiment of the present invention encapsulates the audio data in the form of analog signals into audio frames in the form of digital signals through analog-to-digital conversion.

[0042] Step S102, determining whether an abnormality occurs in the vehicle according to the audio frame.

[0043] Specifically, in the embodiment of the present invention, the audio frame contains the sound information in the car. If an abnormal situation occurs in the car, such as when the driver and passengers are road angry or quarreling, a loud sound will be emitted, or when there is a major safety risk, the driver and passengers are prone to screaming out of control, which will cause the sound information in the audio frame to be different from the normal sound information. Therefore, the embodiment of the present invention directly determines whether an abnormality occurs in the car based on the audio frame.

[0044] Step S103, when an abnormality occurs in the vehicle, an abnormality signal is generated.

[0045] Specifically, in an embodiment of the present invention, when it is determined that an abnormality occurs in the vehicle, an abnormal signal is directly generated and sent to the Vehicle end of the communication transparent transmission service of the vehicle hardware abstraction layer (HAL). After receiving the abnormal signal, the Vehicle end records it in the vehicle log.

[0046] The method for analyzing in-vehicle driving safety provided by the embodiment of the present invention obtains audio data during the recording process when the vehicle video recording function is turned on, encapsulates the audio data into audio frames to determine whether an abnormality occurs, and generates an abnormal signal if an abnormality occurs. The present invention can enrich the car DVR function by judging whether an abnormality occurs in the car according to audio information during the video recording process, realizes in-vehicle driving safety analysis while recording, identifies unsafe scenes in the car and issues early warnings, improves driving safety, and meets the intelligent needs of the car.

[0047] In this embodiment, a method for analyzing in-vehicle driving safety is provided, which can be used for automobiles. Figure 2 FIG. 1 is a flow chart of a method for analyzing in-vehicle driving safety according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0048] Step S201, when the vehicle video recording function is turned on, obtain audio data during the recording process and encapsulate the audio data into audio frames.

[0049] Specifically, the above step S201 includes:

[0050] Step S2011, performing analog-to-digital conversion on the audio data in the form of analog signals to obtain digital audio data in a preset format.

[0051] Specifically, in the embodiment of the present invention, the in-car microphone is a mono mic sensor with a built-in DVR, and the collected audio data is an analog signal. For the convenience of processing, Figure 3As shown, the embodiment of the present invention performs analog-to-digital conversion (A / D conversion) on the audio data, including sampling, quantization and PCM (Pulse Code Modulation) encoding, to convert the analog signal into a digital signal that can be used by a computer, wherein the sampling rate set by the encoding is 44.1KHz, the sampling accuracy is 16bit, and hexadecimal digital audio data in PCM format is obtained. The PCM format is a lossless audio format that records all the information of the original sound without any compression, so the original sound quality can be maintained. This is only an example and is not limited to this.

[0052] Step S2012: quantize the digital audio data according to a first preset time interval, and obtain corresponding audio time.

[0053] Specifically, in an embodiment of the present invention, the digital audio data in PCM format after analog-to-digital conversion is still continuous data. The embodiment of the present invention quantizes the digital audio data at a time interval of 1 s and determines the audio time corresponding to each second of data, but is not limited to this.

[0054] Step S2013, encapsulating the quantized digital audio data into different audio frames according to the audio time, wherein the audio frame includes: a frame sequence, a payload and a timestamp, wherein the frame sequence is the audio frame sequence number, the payload is the digital audio data within a first preset time interval, and the timestamp is the audio time.

[0055] Specifically, in the embodiment of the present invention, Figure 3 As shown, the quantized digital audio data per second is saved into an audio frame, and a series of audio frames can be obtained. The audio frames are combined in the form of frame sequence Num (Number), payload payload and timestamp timetamp, but not limited to this, as shown in the following table:

[0056] Frame Order load Timestamp type Uint8 Uint8 Uint8 length 4 bytes 512 bytes 4 bytes (big endian)

[0057] Among them, the frame sequence is stored in 4 bytes, indicating the audio frame sequence number, and the decimal sequence number is converted to hexadecimal, and the corresponding sequence number range is: 0~2147483647; the load is stored in 512 bytes, indicating the hexadecimal digital audio data data per second, stored in little-endian mode; the timestamp is stored in 4 bytes, indicating the audio time corresponding to the digital audio data, and the decimal timestamp is converted to hexadecimal, and the hexadecimal is stored in 4 bytes in big-endian mode. The timestamp indicates the number of seconds from 0:0:00 on January 1, 1970 to the present, so the timestamp 1715766419 = 2024-5-15 17:46:59 seconds, which is only for example and is not limited to this. Take an example of an audio frame:

[0058]

[0059] Step S202, determining whether an abnormality occurs in the vehicle according to the audio frame.

[0060] Specifically, the above step S202 includes:

[0061] Step S2021, combining the digital audio data in the payload according to byte order to obtain multiple data bits.

[0062] Specifically, in an embodiment of the present invention, the hexadecimal digital audio data in the load is combined in the order of low byte + high byte, wherein the single left channel is "00 6F" and the right channel is "6F 00". The specific left and right channels are pre-matched according to the hardware, and 512 data bits are obtained after combination, but this is not limited to this.

[0063] Step S2022, adding multiple data bits to obtain a volume value.

[0064] Specifically, in the embodiment of the present invention, each data bit is converted into a decimal system to obtain 512 decimal data bits Data[0]-Data

[511] . Because the decimal data bit Data is a signed sampling value, Figure 4 As shown, by adding the corresponding values ​​of each data bit, the average amplitude of the digital audio data, that is, the volume value β, can be obtained. The calculation formula is as follows:

[0065] β=Data[0]+Data[1]+…+Data

[511]

[0066] Step S2023, comparing the volume value with a preset sound intensity threshold, if the volume value is greater than the preset sound intensity threshold, it is determined that an abnormality is triggered.

[0067] Specifically, in the embodiment of the present invention, the volume value β, the weight λ and the timestamp are stored in a structure and pushed into the judgment queue, and the weight λ is initially assigned a value of 0. The head element is popped out of the queue, and the volume value β corresponding to the head element is compared with the preset sound intensity threshold α. If the volume value β is greater than the preset sound intensity threshold α, it is determined that an abnormality is triggered, and the corresponding weight λ is assigned to 1, but this is not limited to this.

[0068] Step S2024, abnormal triggering is judged on the loads of different audio frames. If the continuous abnormal triggering exceeds a preset number of times, it is determined that an abnormality occurs in the vehicle.

[0069] Specifically, in the embodiment of the present invention, the loads of different audio frames are judged for abnormal triggering in turn. If the volume value β is greater than the preset sound intensity threshold α, the weight λ is assigned to 1. If not, λ remains at 0. At the same time, the global weight Value is introduced, and the initial value of Value is 0. After each judgment, the global weight Value is continuously updated by adding the weight λ to the global weight Value. When continuous abnormal triggering is detected for more than 3 times (3s), that is, the weight λ is 1 for more than 3s, and the corresponding global weight Value>3, it is determined that an abnormality has occurred in the car, and the global weight Value is cleared at the same time, that is, the initial value of Value is 0, such as Figure 5 As shown in the figure, if the weight λ is continuously 1 within 4 seconds, it is determined that an abnormality has occurred in the car. If there is no continuous triggering of weighting for 3 times, the judgment queue is cleared, the initial value of Value is set to 0, and the subsequent volume value β and the corresponding data are pushed into the judgment queue again, and the abnormal trigger judgment is performed again.

[0070] Step S203: When an abnormality occurs in the vehicle, an abnormality signal is generated. Figure 1 Step S103 of the illustrated embodiment will not be described in detail here.

[0071] Step S204, according to the timestamp of the audio data corresponding to the last abnormal trigger, obtain the video data recorded within a second preset time interval before and after the timestamp; report the abnormal signal to the dashboard for display.

[0072] Specifically, in the embodiment of the present invention, when it is determined that an abnormality occurs in the vehicle, the timestamp of the last authorization is recorded, and the DVR emergency recording is triggered at the same time, and the video within 15 seconds before and after the timestamp is recorded, and the obtained video data is stored to provide a video data basis for subsequent abnormal situation processing. In addition, the embodiment of the present invention calls the API (Application Programming Interface) to send the timestamp to the Vehicle end, and the Vehicle end records the abnormal signal and the timestamp simultaneously in the vehicle log, and reports the abnormal signal to the dashboard, and the dashboard pops up an abnormal signal to remind the driver and passengers.

[0073] The method for analyzing in-vehicle driving safety provided by the embodiment of the present invention obtains audio data during the recording process when the vehicle video recording function is turned on, encapsulates the audio data into audio frames to determine whether an abnormality occurs, and generates an abnormal signal if an abnormality occurs. The present invention can enrich the car DVR function by judging whether an abnormality occurs in the car according to audio information during the video recording process, realizes in-vehicle driving safety analysis while recording, identifies unsafe scenes in the car and issues early warnings, improves driving safety, and meets the intelligent needs of the car.

[0074] In this embodiment, a method for analyzing in-vehicle driving safety is provided, which can be used for automobiles. Figure 5 FIG. 1 is a flow chart of a method for analyzing in-vehicle driving safety according to an embodiment of the present invention. Figure 6 As shown, the process includes the following steps:

[0075] Step S601, obtaining the current window status; if the current window status is closed, turning on the vehicle video recording function.

[0076] Specifically, in the embodiment of the present invention, when the car is driving and the windows are open, it is inevitable that there will be loud noises because the situation outside the car is complicated. In this case, the collected audio information is likely to cause a misjudgment of abnormal situations. Therefore, the embodiment of the present invention will only turn on the vehicle video recording function when the windows are closed, which is equivalent to turning on the in-car monitoring. At the same time, the in-car microphone starts to collect the sounds inside the car. Figure 7 shown.

[0077] Step S602: When the vehicle video recording function is turned on, obtain the audio data during the recording process and encapsulate the audio data into audio frames. Figure 2 Step S201 of the illustrated embodiment will not be described in detail here.

[0078] Step S603: Determine whether there is any abnormality in the vehicle according to the audio frame. Figure 2 Step S202 of the illustrated embodiment will not be described in detail here.

[0079] Step S604: When an abnormality occurs in the vehicle, an abnormality signal is generated. Figure 2 Step S203 of the illustrated embodiment will not be described in detail here.

[0080] The method for analyzing in-vehicle driving safety provided by the embodiment of the present invention obtains audio data during the recording process when the vehicle video recording function is turned on, encapsulates the audio data into audio frames to determine whether an abnormality occurs, and generates an abnormal signal if an abnormality occurs. The present invention can enrich the car DVR function by judging whether an abnormality occurs in the car according to audio information during the video recording process, realizes in-vehicle driving safety analysis while recording, identifies unsafe scenes in the car and issues early warnings, improves driving safety, and meets the intelligent needs of the car.

[0081] In this embodiment, a device for analyzing in-vehicle driving safety is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0082] This embodiment provides an analysis device for in-vehicle driving safety, which is applied to a vehicle cloud server, such as Figure 8 As shown, including:

[0083] The data acquisition module 801 is used to acquire the audio data during the recording process when the vehicle video recording function is turned on, and to encapsulate the audio data into audio frames.

[0084] The abnormality determination module 802 is used to determine whether an abnormality occurs in the vehicle according to the audio frame.

[0085] The signal generating module 803 is used to generate an abnormal signal when an abnormality occurs in the vehicle.

[0086] In some optional implementations, the device further includes: a function activation module, which is used to obtain the current window state; if the current window state is a closed state, the vehicle video recording function is activated.

[0087] In some optional implementations, the data acquisition module 801 includes:

[0088] The analog-to-digital conversion unit is used to perform analog-to-digital conversion on audio data in the form of analog signals to obtain digital audio data in a preset format.

[0089] The data quantization unit is used to quantize the digital audio data according to a first preset time interval and obtain the corresponding audio time.

[0090] The data encapsulation unit is used to encapsulate the quantized digital audio data into different audio frames according to the audio time. The audio frame includes: a frame sequence, a load and a timestamp. The frame sequence is the audio frame sequence number, the load is the digital audio data within a first preset time interval, and the timestamp is the audio time.

[0091] In some optional implementations, the abnormality determination module 802 includes:

[0092] The data combining unit is used to combine the digital audio data in the load according to the byte order to obtain multiple data bits.

[0093] The mean value calculation unit is used to add multiple data bits to obtain a volume value.

[0094] The abnormal trigger judgment unit is used to compare the volume value with a preset sound intensity threshold, and if the volume value is greater than the preset sound intensity threshold, it is determined that an abnormality is triggered.

[0095] The continuous abnormality judgment unit is used to judge the abnormal triggering of the load of different audio frames. If the continuous abnormal triggering exceeds a preset number of times, it is determined that an abnormality occurs in the vehicle.

[0096] In some optional embodiments, the device also includes: an exception handling module, which is used to obtain video data recorded within a second preset time interval before and after the timestamp of the audio data corresponding to the last exception trigger; and report the abnormal signal to the dashboard for display.

[0097] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0098] The in-vehicle driving safety analysis device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0099] The embodiment of the present invention also provides a computer device having the above Figure 8 An analysis device for in-vehicle driving safety is shown.

[0100] See also Fig. 9 , Fig. 9 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Fig. 9 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Fig. 9 A processor 10 is taken as an example.

[0101] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0102] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0103] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0104] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0105] The computer device further comprises a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0106] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0107] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0108] The embodiment of the present invention also provides a vehicle, comprising: a digital video recorder for collecting audio data in the vehicle and performing video recording; a controller for executing Figure 1 , Figure 2 or Figure 6 The analysis method for in-vehicle driving safety shown; the instrument panel is used to display abnormal signals.

[0109] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A method for analyzing in-vehicle driving safety, characterized in that: The method comprises: When the vehicle video recording function is turned on, audio data during the recording process is obtained and the audio data is encapsulated into audio frames; Determine whether an abnormality occurs in the vehicle according to the audio frame; When an abnormality occurs in the vehicle, an abnormality signal is generated.

2. The method according to claim 1, characterized in that: When the vehicle video recording function is turned on, obtaining audio data during the recording process and encapsulating the audio data into audio frames also includes: Get the current window status; If the current window state is closed, the vehicle video recording function is turned on.

3. The method according to claim 1, characterized in that The step of encapsulating the audio data into audio frames comprises: Performing analog-to-digital conversion on the audio data in the form of an analog signal to obtain digital audio data in a preset format; quantizing the digital audio data according to a first preset time interval and obtaining a corresponding audio time; The quantized digital audio data is encapsulated into different audio frames according to the audio time, and the audio frame includes: a frame sequence, a payload and a timestamp, the frame sequence is the audio frame sequence number, the payload is the digital audio data within the first preset time interval, and the timestamp is the audio time.

4. The method according to claim 3, characterized in that The determining whether an abnormality occurs in the vehicle according to the audio frame includes: Combining the digital audio data in the payload in byte order to obtain a plurality of data bits; Adding the multiple data bits to obtain a volume value; Comparing the volume value with a preset sound intensity threshold, and determining that an abnormality is triggered if the volume value is greater than the preset sound intensity threshold; An abnormal trigger is judged for the load of different audio frames. If the continuous abnormal trigger exceeds a preset number of times, it is determined that an abnormality occurs in the vehicle.

5. The method according to claim 4, characterized in that When an abnormality occurs in the vehicle, after an abnormality signal is generated, the method further includes: According to the timestamp of the audio data corresponding to the last abnormal trigger, obtaining the video data recorded within a second preset time interval before and after the timestamp; The abnormal signal is reported to the instrument panel for display.

6. An analysis device for in-vehicle driving safety, characterized in that: The device comprises: A data acquisition module, used to acquire audio data during the video recording process when the vehicle video recording function is turned on, and encapsulate the audio data into audio frames; An abnormality judgment module, used to determine whether an abnormality occurs in the vehicle according to the audio frame; The signal generating module is used to generate an abnormal signal when an abnormality occurs in the vehicle.

7. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the in-vehicle driving safety analysis method according to any one of claims 1 to 5 by executing the computer instructions.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the in-vehicle driving safety analysis method according to any one of claims 1 to 5.

9. A computer program product, characterized in that The method comprises computer instructions for causing a computer to execute the in-vehicle driving safety analysis method according to any one of claims 1 to 5.

10. A vehicle, characterized in that: include: A digital video recorder for collecting in-car audio data and making video recordings; A controller, configured to execute the in-vehicle driving safety analysis method according to any one of claims 1 to 5; Dashboard, used to display abnormal signals.