Vehicle violation alarm method, device and equipment, medium and vehicle

Abstract

The invention relates to a vehicle violation alarm method, device and equipment, a medium and a vehicle, and relates to the technical field of violation monitoring. The method comprises the steps of obtaining an environment video outside a vehicle; based on the environment video, identifying whether the target vehicle in the environment video has a violation behavior; generating violation data when the target vehicle in the environment video is recognized to have violation behaviors; when it is recognized that the target vehicle in the environment video does not have the violation behavior, voice violation alarm information, sent by a user, of the target vehicle is received; performing voice recognition on the voice violation alarm information to obtain violation alarm information of the target vehicle; intercepting a target video corresponding to the violation alarm information in the environment video; generating violation data based on the violation alarm information and the target video; according to the invention, the violation data of other vehicles can be timely and accurately obtained, the vehicle violation alarm is carried out, the efficiency of vehicle violation behavior monitoring is improved, and road monitoring resources are saved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of traffic violation monitoring, and in particular to a vehicle traffic violation alarm method, device, equipment, medium and vehicle. Background Art

[0002] In the related art, the violation behaviors of vehicles on the road (such as crossing the solid line, running a red light, etc.) are usually monitored by taking photos of the vehicles through monitoring equipment installed on the road. However, the violation monitoring capability of this method is limited, and a large amount of road monitoring resources are required. In addition, if the violation of the vehicle occurs in a short time, it is usually impossible to obtain evidence. Therefore, a timely and accurate violation monitoring and alarm method is urgently needed to meet the current violation monitoring requirements. Summary of the invention

[0003] In order to solve the above technical problems, the present disclosure provides a vehicle violation alarm method, device, equipment, medium and vehicle.

[0004] A first aspect of the present disclosure provides a vehicle violation alarm method, the method comprising:

[0005] Acquire the environment video outside the vehicle;

[0006] Based on the environment video, identify whether the target vehicle in the environment video has violated the traffic rules;

[0007] When a target vehicle in an environment video is identified to have violated traffic rules, violation data is generated;

[0008] When it is identified that the target vehicle in the environment video has no violation behavior, receiving the voice violation alarm information of the target vehicle issued by the user;

[0009] Perform voice recognition on the voice violation alarm information to obtain the violation alarm information of the target vehicle;

[0010] Intercept the target video corresponding to the violation alarm information in the environmental video;

[0011] Generate violation data based on violation alarm information and target video;

[0012] Send violation data to the preset alarm recipient for alarm.

[0013] A second aspect of the present disclosure provides a vehicle violation alarm device, the device comprising:

[0014] An acquisition module, used to acquire the environment video outside the vehicle;

[0015] A recognition module is used to identify whether a target vehicle in the environment video has violated traffic regulations based on the environment video;

[0016] A first generating module is used to generate violation data when a target vehicle in an environment video is identified to have a violation behavior;

[0017] A receiving module, for receiving a voice traffic violation alarm message of a target vehicle issued by a user when it is identified that the target vehicle in the environment video has no traffic violation behavior;

[0018] A voice recognition module is used to perform voice recognition on the voice violation alarm information to obtain the violation alarm information of the target vehicle;

[0019] An interception module is used to intercept the target video corresponding to the violation alarm information in the environmental video;

[0020] A second generating module is used to generate violation data based on the violation alarm information and the target video;

[0021] The sending module is used to send violation data to the preset alarm recipient for alarm.

[0022] A third aspect of the present disclosure provides a vehicle-mounted device, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the vehicle violation alarm method of the first aspect can be implemented.

[0023] A fourth aspect of the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the vehicle violation alarm method of the first aspect can be implemented.

[0024] The fifth aspect of the present disclosure provides a vehicle, which includes the vehicle violation alarm device of the second aspect or the vehicle machine equipment of the third aspect or the computer-readable storage medium of the fourth aspect, and can implement the vehicle violation alarm method of the first aspect.

[0025] Compared with the prior art, the technical solution provided by the present invention has the following advantages:

[0026] The present invention obtains an environmental video outside a vehicle; based on the environmental video, identifies whether a target vehicle in the environmental video has a traffic violation; generates traffic violation data when it is identified that the target vehicle in the environmental video has a traffic violation; when it is identified that the target vehicle in the environmental video has no traffic violation, receives voice traffic violation alarm information of the target vehicle issued by a user; performs voice recognition on the voice traffic violation alarm information to obtain the traffic violation alarm information of the target vehicle; intercepts the target video corresponding to the traffic violation alarm information in the environmental video; generates traffic violation data based on the traffic violation alarm information and the target video; and sends the traffic violation data to a preset alarm receiver for alarming. By performing traffic violation identification on the environmental video obtained by the vehicle and the voice alarm information issued by the passengers in the vehicle, the traffic violation data of other vehicles can be obtained in a timely and accurate manner and a vehicle traffic violation alarm can be issued, thereby improving the efficiency of vehicle traffic violation monitoring, helping relevant departments to timely discover and investigate vehicle traffic violations, and supervising traffic violations through vehicles on the road, saving road monitoring resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0028] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0029] Figure 1 is a flow chart of a vehicle violation alarm method provided by an embodiment of the present disclosure;

[0030] Figure 2 is a schematic diagram of a vehicle driving provided by an embodiment of the present disclosure;

[0031] Figure 3 is a flow chart of another vehicle violation alarm method provided by an embodiment of the present disclosure;

[0032] Figure 4 It is a structural schematic diagram of a vehicle violation alarm device provided by an embodiment of the present disclosure;

[0033] Figure 5 It is a structural schematic diagram of a vehicle machine device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0034] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0035] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0036] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0037] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0038] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0039] In the related art, the violation behaviors of vehicles on the road (such as crossing the solid line, running a red light, etc.) are usually monitored by taking photos of the vehicles through monitoring equipment installed on the road. However, the violation monitoring capability of this method is limited, and a large amount of road monitoring resources are required. In addition, if the violation of the vehicle occurs in a short time, it is usually impossible to obtain evidence. Therefore, a timely and accurate violation monitoring and alarm method is urgently needed to meet the current violation monitoring requirements.

[0040] In response to the defects of related technologies in vehicle violation monitoring, the embodiments of the present disclosure provide a vehicle violation alarm method, device, equipment, medium and vehicle, which can timely and accurately obtain the violation data of other vehicles and issue vehicle violation alarms by identifying violation behaviors through environmental videos obtained by the vehicle and voice alarm information issued by passengers in the vehicle, thereby improving the efficiency of vehicle violation monitoring, helping relevant departments to promptly discover and investigate vehicle violations, and supervising violations through vehicles on the road, saving road monitoring resources.

[0041] The vehicle violation alarm method provided by the embodiment of the present disclosure can be executed by a vehicle-mounted device, which can be understood as any device with processing and computing capabilities. The device is usually installed in the control console in the front row of the vehicle and can control various functions of the vehicle to realize interaction between the user and the vehicle.

[0042] In order to better understand the inventive concept of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure are described below in conjunction with exemplary embodiments.

[0043] Figure 1 is a flow chart of a vehicle violation alarm method provided by an embodiment of the present disclosure, such as Figure 1 As shown, the vehicle violation alarm method provided in this embodiment includes the following steps:

[0044] Step 110: Acquire the environment video outside the vehicle.

[0045] In the disclosed embodiment, an image acquisition device is installed around the vehicle, such as a camera, a driving recorder, etc., which can acquire the environment video outside the vehicle. The vehicle equipment can obtain the environment video outside the vehicle from the image acquisition device.

[0046] Step 120: Based on the environment video, identify whether the target vehicle in the environment video has any violation behavior.

[0047] Based on the environment video, identify whether the target vehicle in the environment video has violated the traffic rules.

[0048] In the embodiment of the present disclosure, after obtaining the environment video outside the vehicle, the vehicle machine device can identify whether the target vehicle in the environment video has violated the traffic rules based on the environment video. The violation can be understood as the behavior that violates the traffic regulations, including crossing the solid line, running a red light, etc. The target vehicle can be each vehicle in the environment video.

[0049] Step 130: When it is identified that the target vehicle in the environment video has violated the traffic rules, violation data is generated.

[0050] In the disclosed embodiment, if a target vehicle in the environmental video is identified to have committed a traffic violation, the vehicle-mounted device may generate traffic violation data, which may include the target vehicle's license plate number, traffic violation image, traffic violation time period, traffic violation location, etc.

[0051] In some embodiments, when a target vehicle in an environment video is identified to have a traffic violation, generating traffic violation data may include steps 1301-1303:

[0052] Step 1301: When it is identified that a target vehicle in the environment video has violated a traffic rule, character recognition is performed on the license plate number of the target vehicle in the environment video to obtain the license plate number of the target vehicle.

[0053] In the disclosed embodiment, when it is identified that the target vehicle in the environment video has violated the traffic rules, the vehicle machine device can perform character recognition on the license plate number of the target vehicle in the environment video to obtain the license plate number of the target vehicle. For example, optical character recognition (OCR) technology can be used to perform character recognition on the license plate number of the target vehicle to obtain the license plate number of the target vehicle.

[0054] Step 1302: Obtain the target vehicle's violation behavior image, violation time period, and violation location from the environmental video.

[0055] In the disclosed embodiment, the image acquisition device installed on the vehicle can simultaneously record data such as the acquisition time and acquisition location of each video frame image in the environmental video when acquiring the environmental video outside the vehicle. The vehicle-mounted equipment can obtain the target vehicle's violation behavior image, violation time period and violation location from the environmental video.

[0056] Step 1303: Generate violation data based on the target vehicle's license plate number, violation behavior image, violation time period, and violation location.

[0057] In the disclosed embodiment, after obtaining the target vehicle's license plate number, violation image, violation time period and violation location, the vehicle-mounted device can generate violation data based on the target vehicle's license plate number, violation image, violation time period and violation location, that is, the violation data includes the target vehicle's license plate number, violation image, violation time period, violation location and other data.

[0058] Step 140: When it is identified that the target vehicle in the environment video does not have any traffic violation, receive voice traffic violation alarm information of the target vehicle issued by the user.

[0059] In the disclosed embodiment, if the target vehicle has a traffic violation, but the vehicle-mounted device has not detected the traffic violation of the target vehicle, and the user sees the traffic violation of the target vehicle, the user can send a voice traffic violation alarm message of the target vehicle to the vehicle-mounted device, and the vehicle-mounted device can receive the voice traffic violation alarm message of the target vehicle sent by the user. For example, the voice traffic violation alarm message can be "Report that the right vehicle changed lanes illegally 20 seconds ago."

[0060] Step 150: Perform voice recognition on the voice traffic violation alarm information to obtain the traffic violation alarm information of the target vehicle.

[0061] In the disclosed embodiment, the vehicle machine device can perform voice recognition on the voice violation alarm information to obtain the violation alarm information of the target vehicle, and the violation alarm information may include the license plate number of the target vehicle, the violation behavior, the violation time period, the violation location, and the position of the target vehicle relative to the vehicle. For example, the violation alarm information may be "reporting the illegal lane change of the right vehicle 20 seconds ago", the position of the target vehicle relative to the vehicle is the right side of the vehicle, the violation time period is 20 seconds ago, and the violation behavior is the illegal lane change.

[0062] Step 160: intercept the target video corresponding to the traffic violation alarm information in the environmental video.

[0063] In the disclosed embodiment, the vehicle-mounted device may capture a target video corresponding to the traffic violation alarm information of the target vehicle in the environmental video, where the target video is the traffic violation video of the target vehicle.

[0064] In some embodiments, intercepting the target video corresponding to the traffic violation alarm information in the environment video may include steps 1601-1603:

[0065] Step 1601: Determine the target vehicle and the time period of the violation from the violation alarm information.

[0066] In the disclosed embodiment, the vehicle-mounted device can determine the target vehicle where the violation occurred and the violation time period from the violation alarm information.

[0067] Step 1602: intercept the video of the environmental video during the violation period to obtain an initial video.

[0068] In the disclosed embodiment, the vehicle machine device may capture the video of the environment video during the traffic violation period to obtain an initial video.

[0069] Step 1603: intercept the video containing the target vehicle in the initial video to obtain the target video.

[0070] In the disclosed embodiment, the vehicle-mounted device may intercept the video containing the target vehicle in the initial video to obtain the target video.

[0071] Step 170: Generate traffic violation data based on the traffic violation alarm information and the target video.

[0072] In the disclosed embodiment, the vehicle-mounted device may generate traffic violation data based on the traffic violation alarm information and the target video, that is, the traffic violation data may include the traffic violation alarm information and the target video of the target vehicle.

[0073] Step 180: Send the violation data to the preset alarm recipient for alarm.

[0074] In the disclosed embodiment, after generating the violation data of the target vehicle, the vehicle device can send the violation data to a preset alarm receiver for alarm. The alarm receiver can include the website, mailbox, etc. of the relevant department that handles the violation, which can be set as needed and is not specifically limited here.

[0075] The disclosed embodiment acquires an environmental video outside a vehicle; identifies whether a target vehicle in the environmental video has committed a traffic violation based on the environmental video; generates traffic violation data when it is identified that the target vehicle in the environmental video has committed a traffic violation; receives voice traffic violation alarm information of the target vehicle issued by a user when it is identified that the target vehicle in the environmental video has not committed a traffic violation; performs voice recognition on the voice traffic violation alarm information to obtain the traffic violation alarm information of the target vehicle; captures the target video corresponding to the traffic violation alarm information in the environmental video; generates traffic violation data based on the traffic violation alarm information and the target video; and sends the traffic violation data to a preset alarm receiver for alarm. By performing traffic violation recognition on the environmental video acquired by the vehicle and the voice alarm information issued by the passengers in the vehicle, the traffic violation data of other vehicles can be obtained in a timely and accurate manner and a vehicle traffic violation alarm can be issued, thereby improving the efficiency of vehicle traffic violation monitoring, helping relevant departments to promptly discover and investigate vehicle traffic violations, and supervising traffic violations through vehicles on the road, saving road monitoring resources.

[0076] In some embodiments of the present disclosure, the above-mentioned identification of whether the target vehicle in the environmental video has a traffic violation based on the environmental video can be performed. Figure 2 The flow chart of the vehicle violation alarm method provided is as follows: Figure 2 As shown, the vehicle violation alarm method provided in this embodiment includes the following steps:

[0077] Step 210: Perform vehicle recognition based on the video frame images in the environment video to obtain the target vehicle and the contour position of the target vehicle in the environment video.

[0078] In the disclosed embodiment, the environmental video is composed of a plurality of continuous video frame images. The vehicle-mounted device can perform vehicle recognition based on the video frame images in the environmental video to obtain the target vehicle in the environmental video and the contour position of the target vehicle. Specifically, the vehicle in the video frame image can be recognized by a preset image recognition algorithm. For details, reference can be made to the relevant image recognition technology, which will not be described here. The contour position of the target vehicle is the position of the range occupied by the outer contour of the target vehicle.

[0079] Step 220: Perform lane line recognition based on the video frame images in the environment video to obtain the lane lines and the contour positions of the lane lines in the environment video.

[0080] In the disclosed embodiment, the vehicle-mounted device can perform lane line recognition based on the video frame image in the environment video to obtain the lane line in the environment video and the contour position of the lane line. Specifically, the lane line in the video frame image can be recognized according to a preset lane line detection algorithm. For details, reference can be made to the relevant lane line detection technology, which will not be repeated here. The contour position of the lane line is the position of the range occupied by the outer contour of the lane line.

[0081] Step 230: Determine whether the target vehicle has violated traffic regulations based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line.

[0082] In the disclosed embodiment, the vehicle-mounted device may determine whether the target vehicle has committed a traffic violation based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line.

[0083] In some embodiments, determining whether the target vehicle has violated traffic rules based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line may include steps 2301-2303:

[0084] Step 2301: extract the contour position of the solid lane line in the environment video.

[0085] In the real-time example of the present disclosure, after obtaining the lane lines and the contour positions of the lane lines in the environment video, the vehicle-mounted device can extract the solid lane lines and the contour positions of the solid lane lines in the environment video.

[0086] Step 2302: Determine whether there is any overlap between the contour position of the target vehicle and the contour position of the solid lane line.

[0087] In the real-time example disclosed herein, the vehicle-mounted device can determine whether there is any overlap between the contour position of the target vehicle and the contour position of the solid lane line.

[0088] Step 2303: If the contour position of the target vehicle overlaps with the contour position of the solid lane line, it is determined that the target vehicle has violated the traffic rules by crossing the solid line.

[0089] In the real-time example of the present disclosure, if there is an overlap between the contour position of the target vehicle and the contour position of the solid lane line, the vehicle-mounted device can determine that the target vehicle has violated the traffic rules by crossing the solid line.

[0090] For example, Figure 3 A schematic diagram of a vehicle driving provided by an embodiment of the present disclosure is shown, such as Figure 3 As shown, 300 is a target vehicle in the environment video, and 301 is a solid lane line on the road. If the contour position of the target vehicle 300 in the figure overlaps with the contour position of the solid lane line 301, it can be determined that the target vehicle 300 has violated the traffic rules by crossing the solid line.

[0091] In some other embodiments, determining whether the target vehicle has violated traffic regulations based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line may include steps 2311-2313:

[0092] Step 2311: Obtain the state of the traffic light at the intersection in the environment video, as well as the contour position of the first stop lane line and the contour position of the second stop lane line at the intersection in the driving direction of the target vehicle.

[0093] In the real-time example disclosed in the present invention, the vehicle equipment can obtain the state of the traffic light at the intersection in the environment video from the road traffic database, and obtain the contour position of the first stop lane line and the contour position of the second stop lane line at the intersection in the driving direction of the target vehicle from the lane line and the contour position of the lane line. Among them, the first stop lane line can be understood as the starting line of the intersection in the driving direction of the target vehicle, and the second stop lane line can be understood as the end line of the intersection in the driving direction of the target vehicle.

[0094] Step 2312: for each driving direction, when the traffic light state corresponding to the driving direction of the target vehicle is a red light state, determine whether the contour position of the target vehicle overlaps with the contour position of the first stop lane line and the contour position of the second stop lane line.

[0095] In the real-time example disclosed in the present invention, for each driving direction, the vehicle-mounted device can determine whether the contour position of the target vehicle and the contour position of the first stop lane line and the contour position of the second stop lane line at the intersection in the driving direction of the target vehicle have overlapping parts when the traffic light state corresponding to the driving direction of the target vehicle is a red light state.

[0096] Step 2313: If the contour position of the target vehicle overlaps with the contour position of the first stop lane line and the contour position of the second stop lane line, it is determined that the target vehicle has violated the traffic rules by running a red light in the driving direction.

[0097] In the real-time example disclosed in the present invention, if the contour position of the target vehicle overlaps with the contour position of the first stop lane line and the contour position of the second stop lane line at the intersection in the driving direction of the target vehicle, it means that the target vehicle passed the first stop lane line and the second stop lane line in the driving direction while the traffic light state corresponding to the driving direction of the target vehicle was red. The vehicle-computer equipment can determine that the target vehicle has violated the traffic rules by running a red light in the driving direction.

[0098] For example, Figure 3 As shown, 302 is the driving direction of the target vehicle 300 at the intersection A, 303 is the first stop lane line of the intersection A on the driving direction 302, and 304 is the second stop lane line of the intersection A on the driving direction 302. If the traffic light state corresponding to the driving direction 302 is a red light state at this time, the contour position of the target vehicle 300 in the figure overlaps with the contour position of the first stop lane line 303 and the contour position of the second stop lane line 304, then it can be determined that the target vehicle 300 has violated the traffic rules by running a red light in the driving direction 302.

[0099] Therefore, the positional relationship between the contour position of the target vehicle and the contour position of the lane line can be obtained through the environmental video obtained from the vehicle, and the violation of the target vehicle can be determined based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line.

[0100] In other embodiments of the present disclosure, after the violation data is generated, the vehicle equipment may display the violation data and issue a prompt message on whether to alarm. In response to receiving a confirmed alarm instruction, the violation data is sent to a preset alarm recipient for alarm.

[0101] In the real-time example disclosed herein, after the violation data is generated, the vehicle-mounted device can display the violation data, for example, display the violation video on the vehicle-mounted screen, and can also broadcast the violation data by voice, etc. And the vehicle-mounted device can issue a prompt message whether to alarm based on a preset prompt method. The preset prompt method can include voice prompts, picture prompts, etc., which can be set as needed and are not limited here.

[0102] If the user decides to alarm the violation, the user can perform an alarm confirmation operation on the vehicle device, such as clicking on a confirm alarm button on the vehicle device, or issuing a voice command to the vehicle device to confirm the alarm. The vehicle device can receive the confirm alarm command issued by the user, and in response to receiving the confirm alarm command, send the violation data to the preset alarm recipient for alarm.

[0103] In this way, vehicle violation alarms can be issued in a timely manner, the efficiency of vehicle violation monitoring can be improved, and relevant departments can be helped to promptly discover and investigate vehicle violations.

[0104] Figure 4 1 is a schematic diagram of the structure of a vehicle violation alarm device provided by an embodiment of the present disclosure, and the device can be understood as the above-mentioned vehicle equipment or a part of the functional modules in the above-mentioned vehicle equipment. Figure 4 As shown, the vehicle violation alarm device 400 includes:

[0105] An acquisition module 410 is used to acquire an environment video outside the vehicle;

[0106] The identification module 420 is used to identify whether the target vehicle in the environment video has violated the traffic rules based on the environment video;

[0107] A first generating module 430 is used to generate violation data when a target vehicle in an environment video is identified to have a violation behavior;

[0108] The receiving module 440 is used to receive the voice violation alarm information of the target vehicle issued by the user when it is identified that the target vehicle in the environment video has no violation behavior;

[0109] The speech recognition module 450 is used to perform speech recognition on the speech violation alarm information to obtain the violation alarm information of the target vehicle;

[0110] An interception module 460 is used to intercept a target video corresponding to the violation alarm information in the environment video;

[0111] A second generating module 470, for generating violation data based on the violation alarm information and the target video;

[0112] The sending module 480 is used to send the violation data to a preset alarm recipient for alarm.

[0113] Optionally, the identification module 420 includes:

[0114] The vehicle recognition submodule is used to perform vehicle recognition based on the video frame image in the environment video, and obtain the target vehicle and the contour position of the target vehicle in the environment video;

[0115] The lane line recognition submodule is used to recognize lane lines based on the video frame images in the environment video, and obtain the lane lines and the contour positions of the lane lines in the environment video;

[0116] The first determination submodule is used to determine whether the target vehicle has violated traffic regulations based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line.

[0117] Optionally, the first determining submodule includes:

[0118] An extraction unit, used for extracting the contour position of the solid lane line in the environment video;

[0119] The first judgment unit is used to judge whether there is an overlap between the contour position of the target vehicle and the contour position of the solid lane line;

[0120] The first determination unit is used to determine that the target vehicle has violated the traffic rules by crossing the solid lane line if there is an overlap between the contour position of the target vehicle and the contour position of the solid lane line.

[0121] Optionally, the first determining submodule includes:

[0122] An acquisition unit, used to acquire the state of the traffic light at the intersection in the environment video, and the contour position of the first stop lane line and the contour position of the second stop lane line at the intersection in the driving direction of the target vehicle;

[0123] A second judgment unit is used to judge, for each driving direction, whether there is an overlap between the contour position of the target vehicle and the contour position of the first stop lane line and the contour position of the second stop lane line when the traffic light state corresponding to the driving direction of the target vehicle is a red light state;

[0124] The second determination unit is used to determine that the target vehicle has violated the traffic rules by running a red light in the driving direction if the contour position of the target vehicle overlaps with the contour position of the first stop lane line and the contour position of the second stop lane line.

[0125] Optionally, the first generating module 430 includes:

[0126] The character recognition submodule is used to perform character recognition on the license plate number of the target vehicle in the environment video when it is identified that the target vehicle in the environment video has violated the traffic rules, so as to obtain the license plate number of the target vehicle;

[0127] The acquisition submodule is used to obtain the target vehicle's violation behavior image, violation time period and violation location from the environmental video;

[0128] The generation submodule is used to generate violation data based on the license plate number of the target vehicle, the violation behavior image, the violation time period and the violation location.

[0129] Optionally, the above-mentioned interception module 460 includes:

[0130] The second determination submodule is used to determine the target vehicle and the violation time period where the violation occurred from the violation alarm information;

[0131] The first interception submodule is used to intercept the video of the environment video during the violation period to obtain the initial video;

[0132] The second interception submodule is used to intercept the video containing the target vehicle in the initial video to obtain the target video.

[0133] Optionally, the sending module 480 includes:

[0134] The display submodule is used to display the violation data and issue a prompt message whether to alarm;

[0135] The sending submodule is used to send the violation data to the preset alarm receiver in response to receiving the confirmed alarm instruction for alarm. The violation data includes at least one of the violation behavior image, violation time period and violation location of the target vehicle.

[0136] The vehicle violation alarm device provided in the embodiments of the present disclosure can implement the method of any of the above embodiments, and its execution method and beneficial effects are similar, which will not be repeated here.

[0137] The disclosed embodiments also provide a vehicle-mounted device, which includes a processor and a memory, wherein a computer program is stored in the memory. When the computer program is executed by the processor, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0138] Figure 5 is a structural diagram of a vehicle machine device provided by an embodiment of the present disclosure, such as Figure 5 As shown, the vehicle-mounted device 500 may include a processor 510 and a memory 520, wherein a computer program 521 is stored in the memory 520. When the computer program 521 is executed by the processor 510, the method provided by any of the above-mentioned embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0139] Of course, to simplify, Figure 5 Only some of the components related to the present invention in the vehicle machine device 500 are shown, and components such as a bus, an input / output interface, an input device, and an output device are omitted. In addition, according to specific application conditions, the vehicle machine device 500 may also include any other appropriate components.

[0140] An embodiment of the present disclosure provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the method of any of the above embodiments can be implemented. The execution method and beneficial effects are similar and will not be repeated here.

[0141] The above-mentioned computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0142] The computer program may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer device, partially on the user's device, as a separate software package, partially on the user's computer device and partially on a remote computer device, or entirely on a remote computer device or server.

[0143] An embodiment of the present disclosure provides a vehicle, which includes the above-mentioned vehicle violation alarm device or the above-mentioned vehicle equipment or the above-mentioned computer-readable storage medium, and can implement the method of any of the above-mentioned embodiments. Its execution method and beneficial effects are similar and will not be repeated here.

[0144] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0145] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0146] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A vehicle violation alarm method, characterized in that: include: Acquire the environment video outside the vehicle; Based on the environmental video, identifying whether the target vehicle in the environmental video has violated traffic regulations; When it is identified that the target vehicle in the environment video has violated the traffic rules, generating violation data; When it is identified that the target vehicle in the environment video does not have any traffic violation behavior, receiving voice traffic violation alarm information of the target vehicle issued by the user; Performing voice recognition on the voice traffic violation alarm information to obtain the traffic violation alarm information of the target vehicle; Intercepting a target video corresponding to the traffic violation alarm information in the environmental video; Generate traffic violation data based on the traffic violation alarm information and the target video; The violation data is sent to a preset alarm recipient for alarm.

2. The method according to claim 1, characterized in that The step of identifying, based on the environment video, whether the target vehicle in the environment video has violated traffic regulations comprises: Performing vehicle recognition based on the video frame images in the environmental video to obtain a target vehicle in the environmental video and a contour position of the target vehicle; Performing lane line recognition based on the video frame image in the environment video to obtain the lane line in the environment video and the contour position of the lane line; Based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line, it is determined whether the target vehicle has violated traffic regulations.

3. The method according to claim 2, characterized in that The determining whether the target vehicle has a traffic violation based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line includes: Extracting the contour position of the solid lane line in the environment video; Determine whether there is an overlap between the contour position of the target vehicle and the contour position of the solid lane line; If the contour position of the target vehicle overlaps with the contour position of the solid lane line, it is determined that the target vehicle has violated the traffic rules by crossing the solid line.

4. The method according to claim 2, characterized in that: The determining whether the target vehicle has a traffic violation based on the positional relationship between the contour position of the target vehicle and the contour position of the lane line includes: Acquire the state of the traffic light at the intersection in the environment video, and the contour position of the first stop lane line and the contour position of the second stop lane line at the intersection in the driving direction of the target vehicle; For each driving direction, when the traffic light state corresponding to the driving direction of the target vehicle is a red light state, determining whether the contour position of the target vehicle overlaps with the contour position of the first stop lane line and the contour position of the second stop lane line; If the contour position of the target vehicle overlaps with the contour position of the first stop lane line and the contour position of the second stop lane line, it is determined that the target vehicle has violated the traffic rules by running a red light in the driving direction.

5. The method according to claim 1, characterized in that When the target vehicle in the environment video is identified to have violated traffic rules, generating violation data includes: When it is identified that the target vehicle in the environment video has violated traffic regulations, character recognition is performed on the license plate number of the target vehicle in the environment video to obtain the license plate number of the target vehicle; Acquire the traffic violation behavior image, traffic violation time period and traffic violation location of the target vehicle from the environmental video; Based on the license plate number, violation behavior image, violation time period and violation location of the target vehicle, violation data is generated.

6. The method according to claim 1, characterized in that The intercepting of the target video corresponding to the violation alarm information in the environmental video includes: Determine the target vehicle and the time period of the violation from the violation alarm information; Intercepting the video of the environment video during the traffic violation period to obtain an initial video; The video containing the target vehicle in the initial video is intercepted to obtain the target video.

7. The method according to claim 1, characterized in that The step of sending the traffic violation data to a preset alarm receiver for alarming includes: Display the violation data and issue a prompt message whether to call the police; In response to receiving a confirmed alarm instruction, the violation data is sent to a preset alarm recipient for alarm.

8. A vehicle violation alarm device, characterized in that: include: An acquisition module, used to acquire the environment video outside the vehicle; An identification module, used for identifying whether a target vehicle in the environmental video has violated traffic regulations based on the environmental video; A first generating module, for generating violation data when a target vehicle in the environment video is identified to have a violation behavior; A receiving module, for receiving a voice violation alarm message of the target vehicle sent by a user when it is identified that the target vehicle in the environment video has no violation behavior; A voice recognition module, used for performing voice recognition on the voice violation alarm information to obtain the violation alarm information of the target vehicle; An interception module, used for intercepting a target video corresponding to the traffic violation alarm information in the environmental video; A second generating module, used for generating traffic violation data based on the traffic violation alarm information and the target video; The sending module is used to send the violation data to a preset alarm receiver for alarm.

9. A vehicle machine device, characterized in that: include: A memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the vehicle violation alarm method as described in any one of claims 1-7 is implemented.

10. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the vehicle violation alarm method according to any one of claims 1 to 7 is implemented.

11. A vehicle, characterized in that: It includes the vehicle violation alarm device as described in claim 8 or the vehicle equipment as described in claim 9 or the computer readable storage medium as described in claim 10.

Images