Rule violation reminding method and related device

Abstract

The invention is applicable to the technical field of intelligent carriers, and provides a rule violation reminding method and a related device, which are used for reminding a carrier driver suspected of violating rules to go to a carrier parking site for processing as soon as possible and are beneficial to creating a civilized and compliant parking environment. The method mainly comprises the steps that when it is determined that a carrier is in a parking state and no carrying person exists in the carrier, the current environment condition of the carrier is monitored, and environment condition information is obtained; judging whether the carrier is suspected to violate a preset rule or not according to the environmental condition information; and if it is determined that the carrier is suspected to violate the preset rule, sending reminding information to a preset communication object.

Description

Technical Field

[0001] The present application belongs to the field of intelligent technology, and in particular, relates to a rule violation reminder method and related devices. Background Art

[0002] As people's living standards continue to improve, more and more people buy cars as a means of daily travel. In places with a large number of cars (such as large cities, important markets, shopping malls, etc.), parking spaces may be in short supply at a certain time. In order to alleviate the parking problem, in addition to expanding regular parking lots, it is also necessary to make full use of existing low-traffic roads, squares and open spaces as temporary parking areas, so as to appropriately alleviate the large number of parking demands in a certain area during a certain period of time.

[0003] In order to meet the large parking demand in a certain area during a certain period of time, many places adopt a time-sharing strategy to add some emergency measures for temporary parking areas: allowing temporary parking on both sides of the road with little traffic during a certain period of time (for example, between 10:00 pm and 06:00 am the next day); and allowing temporary parking in squares without entertainment activities during the day (9:00 to 18:00).

[0004] These temporary parking areas usually need to be equipped with parking fee notice boards, which will indicate the time period allowed for parking, fee standards, number of parking spaces, etc. However, the parking fee notice boards in temporary parking areas in different places have different requirements for parking, and some places even have damaged parking fee notice boards that make the information unclear. This undoubtedly confuses car drivers who are not familiar with the place when parking there, and may even cause car drivers to park randomly in a certain area (such as roads, squares, etc.) without misunderstanding or knowing it. When specific personnel find that the car has been parked illegally in violation of the rules and require it to be moved, they often cannot find the driver (for example, no phone number for moving the car is left, the driver is not the person who left the phone number, etc.), which may easily cause traffic congestion or traffic accidents, and is not conducive to creating a civilized and compliant parking environment. Summary of the invention

[0005] The purpose of this application is to provide a rule violation reminder method and related devices, which are used to promptly remind vehicle drivers suspected of violating the rules to come to the vehicle parking site as soon as possible for processing, thereby creating a civilized and compliant parking environment.

[0006] In a first aspect, the present application provides a rule violation reminder method, comprising:

[0007] When it is determined that the vehicle is in a parked state and there is no person in the vehicle, monitoring the current environment of the vehicle to obtain environmental condition information;

[0008] Determining whether the vehicle is suspected of violating a preset rule according to the environmental condition information;

[0009] If it is determined that the vehicle is suspected of violating the preset rules, a reminder message is sent to the preset communication object.

[0010] In a second aspect, the present application provides a rule violation reminder device, comprising:

[0011] A monitoring unit, configured to monitor the current environment of the vehicle and obtain environmental status information when it is determined that the vehicle is in a parked state and there is no person on board the vehicle;

[0012] A judgment unit, used to judge whether the vehicle is suspected of violating a preset rule according to the environmental condition information;

[0013] The reminder unit is used to send a reminder message to a preset communication object if it is determined that the vehicle is suspected of violating the preset rules.

[0014] In a third aspect, the present application provides a computer device, including:

[0015] Processor, memory, bus, input and output interface, wireless network interface, camera module, recording module;

[0016] The processor is connected to the memory, the input / output interface, the wireless network interface, the camera module, and the recording module via the bus;

[0017] The memory stores a program;

[0018] When the processor executes the program stored in the memory, it executes the rule violation reminder method described in any one of the first aspects.

[0019] In a fourth aspect, the present application provides a computer storage medium, wherein instructions are stored in the computer storage medium, and when the instructions are executed on a computer, the computer executes the rule violation reminder method as described in any one of the aforementioned first aspects.

[0020] In a fifth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the rule violation reminder method as described in any one of the first aspects above.

[0021] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0022] When the present embodiment determines that the vehicle is in a parked state and there are no passengers in the vehicle, the vehicle's current environment is still monitored to obtain environment information; then the vehicle is judged based on the environment information whether it is suspected of violating a preset rule, and the preset rule is used to make a decision on the vehicle's current environment. If it is determined that the vehicle is suspected of violating a preset rule, a reminder message is sent to a preset communication object, and the preset communication object is the driver of the current vehicle. It can be seen that the present implementation of the rule violation reminder method can timely remind the driver of the vehicle suspected of violating the rules to come to the vehicle parking site as soon as possible for processing, which is conducive to creating a civilized and compliant parking environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 A flowchart of an embodiment of the rule violation reminder method of this application;

[0024] Figure 2 A flowchart of another embodiment of the rule violation reminder method of the present application;

[0025] Figure 3 A flowchart of another embodiment of the rule violation reminder method of the present application;

[0026] Figure 4 A flowchart of another embodiment of the rule violation reminder method of the present application;

[0027] Figure 5 A flowchart of another embodiment of the rule violation reminder method of the present application;

[0028] Figure 6 A flowchart of another embodiment of the rule violation reminder method of the present application;

[0029] Figure 7 A flowchart of another embodiment of the rule violation reminder method of the present application;

[0030] Figure 8 This is a schematic diagram of the structure of an embodiment of the rule violation reminder device of the present application;

[0031] Fig. 9 This is a schematic diagram of the structure of another embodiment of the rule violation reminder device of the present application;

[0032] Fig.10 A schematic diagram of the structure of an embodiment of a computer device of the present application;

[0033] Fig.11 This is a connection diagram of an embodiment of the rule violation reminder system of the present application. DETAILED DESCRIPTION

[0034] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0035] It should be noted that the vehicle in this embodiment mainly refers to: cars, vans, trucks and other land transportation vehicles. In some special cases, this embodiment can also be applied to special vehicles such as ships and private aircraft. The vehicle in the following embodiment is mainly described by taking cars as an example, and similar situations can be applied to other types of vehicles.

[0036] See also Fig.11 The rule violation reminder method of this embodiment is mainly operated in the rule violation reminder system, which mainly includes: a rule violation reminder device 1101, a display terminal 1102, a user mobile terminal 1103, a user-side application (Application, APP) 1104, and a cloud server 1105. Among them, the display terminal 1102 can be installed according to actual needs. When the display terminal 1102 exists, the number of the rule violation reminder device 1101, the display terminal 1102, the user mobile terminal 1103, the user-side application (Application, APP) 1104, and the cloud server 1105 is at least one, and the appropriate number can also be selected according to actual needs. The number of each component of the rule violation reminder system is not limited here. The rule violation reminder device 1101 can be connected to the display terminal 1102 via a wired connection or a wireless connection; the rule violation reminder device 1101 can be connected to the user mobile terminal 1103 and the cloud server 1105 via a wireless connection; and the user-side application 1104 is installed and run on the user mobile terminal 1103; when the user mobile terminal 1103 is far away from the rule violation reminder device 1101, the user mobile terminal 1103 can achieve communication connection with the rule violation reminder device 1101 through the cloud server 1105 under the guidance of the user-side application 1104; or the user mobile terminal 1103 can be set by the user-side application 1104 to only communicate with the rule violation reminder device 1101 through the cloud server 1105. The above-mentioned wired connection methods mainly refer to: Universal Serial Bus (USB), RJ45 (Registered Jack 45), etc.; the above-mentioned wireless connection methods mainly refer to: Bluetooth communication, WiFi communication, cellular network (Cellular network), 2G\3G\4G\5G communication, etc.

[0037] Specifically, the rule violation reminder device 1101 of this embodiment mainly includes: a central processing unit, a storage module, a neural network chip, a camera module, a recording module, a video output module, a sound output module, a radio frequency communication module, a satellite positioning module, a power module, a key module, etc. Among them, the central processing unit is respectively connected to the storage module, the neural network chip, the camera module, the recording module, the video output module, the sound output module, the radio frequency communication module, the satellite positioning module, and the key module, for example, through a printed circuit board (PCB). The above-mentioned components are connected by a computer readable medium and a computer readable medium. The central processing unit is mainly used for comprehensively scheduling the various component modules connected thereto to implement the rule violation reminder method mentioned in this embodiment; the power module provides appropriate working voltages to the central processing unit, storage module, neural network chip, camera module, recording module, video output module, sound output module, radio frequency communication module, satellite positioning module, and key module respectively. The power module can be in a self-contained battery power supply mode, or in a power supply interface mode of a transfer vehicle, or can support both self-contained battery power supply and power supply interface mode of a transfer vehicle. The power source of the power module is not limited here; the memory stores a program for implementing the relevant method steps of this embodiment, and the memory can also be used to store a preset neural network model, a video image taken by the camera module, an audio recorded by the recording module, a video conversion program of the video output module, an audio conversion program of the sound output module, a transceiver program of the radio frequency communication module, and a management program of the power module. and other related resources; the neural network chip can be used to quickly load and run the neural network model stored in the memory, and identify and analyze the video, image, audio and other data stored in the memory, and store the related identification and analysis results in the memory; the camera module has at least one camera, preferably a camera array that can achieve 360-degree surround view, or a pan-tilt camera that can rotate 360 ​​degrees and look around. The camera module is mainly used to take pictures of the environment in which the vehicle is located to obtain video or images; the recording module has at least one microphone, preferably a microphone array that can achieve spatial sound source positioning, and the recording module is mainly used to record the environment in which the vehicle is located to obtain audio; the video output module can have its own display screen, or it can have a video output interface to output video to an external display terminal 1102, and the video output module is mainly used to output visual reminder information; the sound output module can have its own speaker, or it can have an audio output interface to output audio to an external speaker, and the sound output module is mainly used to output audio reminder information;The radio frequency communication module is mainly used to realize wireless communication connection with the outside world, for example, it can directly establish a communication connection with the user mobile terminal 1103, or it can establish a communication connection with the user mobile terminal 1103 through the cloud server 1105, so as to keep in touch with the holder of the user mobile terminal 1103 in time. For example, the radio frequency communication module supports external communication through the Internet of Things card, virtual card, etc.; the satellite positioning module can be a positioning module that supports one or more satellite positioning technologies in the Global Positioning System (GPS), Beidou Navigation Satellite System (BDS), and GLONASS. The satellite positioning module is used to obtain and determine the current position of the rule violation reminder device. When the rule violation reminder device is installed in a vehicle, the current position of the rule violation reminder device is the current position of the vehicle; the button module is usually a physical button, or it can be a virtual button located at the display terminal. The button module is mainly used to set parameters such as the power on and off, monitoring mode switching, and reminder form of the rule violation reminder device 1101. ;

[0038] In addition, the display terminal 1102 of this embodiment is usually the central control display screen of the vehicle, and can also be another independently set display screen, which is not limited here. The cloud server 1105 of this embodiment is usually used as a communication transfer station between the user mobile terminal 1103 and the rule violation reminder device 1101. At the same time, the cloud server can also have a database for backing up the data of the user mobile terminal 1103 and the rule violation reminder device 1101. The database can also be used to store map data, store preset compliant parking areas marked on the map data, store the satellite positioning track of each rule violation reminder device 1101, etc. For example, the cloud server can be a cloud server service provided by Baidu Cloud, Alibaba Cloud, Tencent Cloud and other companies.

[0039] Based on the above understanding, in order to promptly remind the driver of the vehicle suspected of violating the rules to come to the vehicle parking site as soon as possible to deal with the vehicle, this embodiment is a post-event (that is, the rule violation reminder device 1101 believes that the fact of suspected violation of the rules has occurred) remedial reminder technical solution, which requires the current driver information of the vehicle to be entered into the rule violation reminder device 1101 in advance, that is, each current driver of the vehicle must enter at least one instant communication method before being allowed to drive the vehicle (for example, fingerprint, pupil, face and other biometric recognition methods can be used for forced authentication before driving is allowed), so that when the rule violation reminder device 1101 finds suspected violation of the rules, it can promptly remind the driver through the instant communication method, and the instant communication method can be telephone, WeChat, text message, etc.

[0040] See also Figure 1 , an embodiment of the rule violation reminder method of the present application includes:

[0041] 101. When it is determined that the vehicle is in a parked state and there is no person on board the vehicle, the current environmental condition of the vehicle is monitored to obtain environmental condition information.

[0042] It should be noted that the situation targeted by this embodiment is that the driver of the vehicle and the violation of rules reminder system of this embodiment did not find that the vehicle was in an illegal parking area in the early stage, the vehicle had been turned off and was in a parking state, and there was no person on board inside the vehicle. The vehicle can be determined to be in a parking state by obtaining the current position change parameters for a certain period of time through the satellite positioning module. When the vehicle has not moved for a certain period of time (for example, 10 minutes, 30 minutes, etc.), it can be determined to be in a parking state. In order to reduce misjudgment, it can be further combined with the relevant vehicle status data in the vehicle (when the violation of rules reminder system of this embodiment is authorized to access the control system of the vehicle) for judgment, for example: the vehicle status data is whether the power system is in operation (for example, the engine is in operation, the motor is in standby state, etc.). If there are no people on board inside the vehicle, the camera module of the violation of rules reminder device can be used to shoot the video image inside the vehicle, and the neural network model running in the neural network chip can be used to recognize and analyze the video image to determine whether there are people in the vehicle, that is, the neural network model of this embodiment should have the ability to recognize people. At this time, the rule violation reminder device of this embodiment is in operation and continuously monitors the current environmental conditions of the vehicle to obtain environmental condition information. The environmental condition information here includes but is not limited to: video, image, audio, temperature, humidity, etc. around the vehicle. The type of environmental condition information obtained depends on the type of sensor connected to the rule violation reminder device. For example, video and image can be obtained through the camera module, audio can be obtained through the recording module, temperature can be obtained through the temperature sensor, humidity can be obtained through the humidity sensor, etc. The environmental condition information is not limited here.

[0043] 102. Determine whether the vehicle is suspected of violating the preset rules based on the environmental status information. If it is determined that the vehicle is suspected of violating the preset rules, execute step 103; if it is determined that the vehicle is not suspected of violating the preset rules, ignore it.

[0044] It should be noted that the rule violation reminder device stores preset rules, which usually record one or more data features such as videos, images, and audio that reflect that the vehicle is suspected of violating the rules. These data features are usually identified by a neural network model and can draw a conclusion that the video, image, or audio is "violating the rules" or "not violating the rules." For example, the video data features obtained by the rule violation reminder device in step 101 include: the issuance of a specific format document for the vehicle, etc.; for example, the image data features include: an image of a specific format document pasted on the vehicle body glass, etc.; for example, the audio data features include: a specific occupational warning audio in a specific frequency band, etc.; through the above rules, it can be determined that the vehicle may be suspected of "violating the rules"; otherwise, it is determined that the vehicle is not suspected of violating the preset rules.

[0045] The neural network model of this embodiment is trained to realize binary classification recognition of videos, images, and audios as "violating the rules" or "not violating the rules", for example, the neural network model is one or more of VGG (visual geometry group), residual networks (ResNets), etc. The trained neural network model can be stored in the memory of the rule violation reminder device of the above embodiment so that it can be called by the neural network chip of the rule violation reminder device to realize rapid recognition of the video, image, and audio of the video captured by the rule violation reminder device, and obtain a recognition result belonging to one of the two categories of "violating the rules" or "not violating the rules". The training of the above-mentioned neural network model can be carried out by legally authorizing the collection of public videos, public images, public audios, etc. in public places (such as taxis, buses, public ferries, passenger planes, etc.) as training samples. If necessary, different training samples can be manually labeled as "violating the rules" or "not violating the rules" (for example, if a specific occupational item appears in the video, it is considered that the vehicle is suspected of "violating the rules", otherwise it does not violate the rules; if a document object in a specific format appears in the image, it is considered that the vehicle is suspected of "violating the rules", otherwise it does not violate the rules; if a specific occupational warning audio voiceprint feature appears in the audio in a specific frequency band, it is considered that the vehicle is suspected of "violating the rules", otherwise it does not violate the rules, etc.). In this embodiment, the descriptions of the video, image, audio, etc. obtained by the above-mentioned rule violation reminder device can be used as input features of the neural network model to facilitate the training of the neural network model and obtain the trained A neural network model that can realize binary classification recognition of videos, images, and audio as "violating the rules" or "not violating the rules". In practical applications, the specific occupational items to be identified in the training samples used to train the neural network model in this embodiment may include: specific occupational wear features (such as specific occupational signs, specific occupational hats, specific occupational clothing, etc.), specific occupational transportation features (such as motorcycles for specific occupations, cars for specific occupations, trailers for specific occupations, etc.), specific occupational supplies (shoulder-mounted video recorders, shoulder-mounted walkie-talkies, etc.); the behaviors or states to be identified in the training samples used to train the neural network model in this embodiment may include: the behavior of issuing documents in a specific format, the behavior of posting documents in a specific format, the state of a document in a specific format being posted on a vehicle, etc.; the audio voiceprint features to be identified in the training samples used to train the neural network model in this embodiment may include: different occupational warning audio voiceprints in multiple specific frequency bands.

[0046] 103. Send a reminder message to a preset communication object.

[0047] The preset communication object in this step refers to: the communication method of the driver who parked the vehicle at the current position. When step 102 determines that the vehicle is suspected of violating the preset rules, it is necessary to send a reminder message to the driver who parked the vehicle at this position in time so that he can go to the scene to deal with the vehicle in time. Since this embodiment requires that each current driver of the vehicle must enter at least one instant communication method before being allowed to drive the vehicle, the method of this embodiment can find and remind the driver of the vehicle through the preset communication object.

[0048] It can be seen that the violation reminder method implemented in this implementation can directly contact the vehicle driver suspected of violating the preset rules, reducing the following situations in reality where the driver cannot be contacted: the registered person of the vehicle is not the current driver of the vehicle (the vehicle is rented, the vehicle is lent to others, etc.), or the vehicle is registered for the company (the vehicle is used by company personnel), or the vehicle does not have a relocation phone number or the relocation phone number is not the current driver, etc. Implementing the above violation reminder method can timely remind the vehicle driver suspected of violating the rules to come to the vehicle parking site as soon as possible for processing, which is conducive to creating a civilized and compliant parking environment.

[0049] based on Figure 1 According to the understanding of the embodiment, in order to make the neural network model not only have the ability to identify videos, images, and audios as "violating the rules" or "not violating the rules", but also have the ability to identify whether the environmental voiceprint belongs to the preset target voiceprint in a specific usage scenario, the audio training samples used to train the neural network model can be marked with the audio voiceprint features that need to be identified. For example, the identified audio voiceprint features may include: different occupational warning audio voiceprints in multiple specific frequency bands. After training, a neural network model with the ability to identify the preset target voiceprint is obtained. Please refer to Figure 2 Another embodiment of the rule violation reminder method of the present application includes:

[0050] 201. When the environmental status information includes the current environmental sound, determine whether the environmental soundprint of the current environmental sound is consistent with the preset target voiceprint. If the environmental soundprint of the current environmental sound is inconsistent with the preset target voiceprint, execute step 202; if the environmental soundprint of the current environmental sound is consistent with the preset target voiceprint, execute step 203 or step 204.

[0051] The situation targeted by this embodiment is still: the driver of the vehicle and the violation reminder system of this embodiment have not found that the vehicle is in an illegal parking area (including an area where the vehicle needs to be moved during a certain period of time) in the early stage, and the vehicle has been turned off and is in a parked state and there are no passengers in the vehicle. The process of determining that the vehicle is in a parked state and there are no passengers in the vehicle is the same as the above Figure 1The embodiments are similar, and the repeated parts are not repeated here. Specifically, the rule violation reminder device of this embodiment is in operation, and continuously monitors the current environment of the vehicle to obtain environment status information. When the environment status information includes the current environment sound, this step recognizes and analyzes the audio of the current environment sound through the neural network model. Assuming that the above-mentioned preset target voiceprint is set as a specific occupation warning audio voiceprint of a specific frequency band, the neural network model of this embodiment can identify and determine whether the environment soundprint of the current environment sound is consistent with the specific occupation warning audio voiceprint of the specific frequency band. If the environment soundprint of the current environment sound is inconsistent with the specific occupation warning audio voiceprint of the specific frequency band, it proves that the vehicle should not be suspected of violating the rules at present; if the environment soundprint of the current environment sound is consistent with the specific occupation warning audio voiceprint of the specific frequency band, it proves that the vehicle may be suspected of violating the rules at present. Even if the vehicle is not suspected of violating relevant traffic rules, the driver may need to cooperate in moving the position or cooperating with other matters. It can be seen that this embodiment can make a reminder response after judging the preset target voiceprint within a certain range around the vehicle (the sound source distance can be estimated through the microphone array, and the sound source sensitivity distance for executing this step can be set).

[0052] It should be noted that in the real environment, for some areas without clear and specific parking rules, due to special reasons (such as fire, exercises, etc.), the driver of the vehicle needs to cooperate in moving the vehicle, or in areas with clear parking rules, due to special reasons (such as fire, exercises, etc.), the driver of the vehicle needs to cooperate in moving the vehicle, etc., specific personnel usually play specific occupational warning audio voiceprints in specific frequency bands for general notification or announcement, and ask everyone to cooperate in moving the vehicle on the spot. However, in reality, there are often some vehicles that cannot contact the corresponding drivers in time or for a long time (and most drivers are willing to cooperate The specific personnel may increase their workload or need to initiate a towing procedure, resulting in low processing efficiency, long cycle, and high cost. It may also cause misunderstandings and conflicts between specific personnel and the driver, which may affect the handling of relevant special situations, especially when there are emergency situations such as fire. Therefore, the rule violation reminder method of this embodiment can actively remind the driver, and the driver of this embodiment is also the person who parks the vehicle at the current location. It is more likely that the correct person can be notified in a timely and accurate manner, which is beneficial to the maintenance of public interests.

[0053] In addition, the present embodiment may also set the preset target voiceprint as other types of specific frequency bands of specific occupational warning audio voiceprint recognition, such as medical ambulance siren voiceprint, fire truck siren voiceprint, etc. Different voiceprints are used as preset target voiceprints for recognition, and corresponding settings can be set to remind the vehicle driver to make corresponding decisions in time, such as: actively moving the vehicle to give way, agreeing to the temporary requisition of the vehicle, etc.

[0054] 202. Ignore.

[0055] When step 201 determines that the environmental soundprint of the current ambient sound is inconsistent with the preset target soundprint, or step 203 determines that the duration of the environmental soundprint is less than the preset duration, it means that the current environment of the vehicle is not identified as abnormal, and monitoring can continue, ignoring the execution of reminder measures.

[0056] 203. Determine whether the duration of the environmental soundprint is equal to or exceeds the preset duration. If the duration of the environmental soundprint is equal to or exceeds the preset duration, execute step 204; if the duration of the environmental soundprint is less than the preset duration, execute step 202.

[0057] When step 201 determines that the ambient soundprint of the current ambient sound is consistent with the preset target soundprint, this step can further determine whether the duration of the ambient soundprint is equal to or exceeds the preset duration, so as to reduce misjudgment. If the duration of the ambient soundprint is less than the preset duration, it indicates that the ambient soundprint may be triggered by mistake, or the vehicle carrying the ambient soundprint is just passing by the vehicle, etc., and it can be considered that no abnormality is found in the current environment where the vehicle is located; if the duration of the ambient soundprint is equal to or exceeds the preset duration, it indicates that the existence of the ambient soundprint is most likely not accidental, and the environment where the vehicle is located is most likely the scene that needs to be handled, that is, it is considered that the vehicle is suspected of violating the rules and it is necessary to remind the driver of the vehicle.

[0058] 204. Send a reminder message to a preset communication object.

[0059] This step is performed in the same way as above. Figure 1 Step 103 in the embodiment is similar, and the repeated parts are not repeated here.

[0060] It can be understood that since the on-site situation faced by the present embodiment of the vehicle parking is likely that relevant specific personnel are on-site handling the vehicle suspected of violating the rules, if the vehicle driver who has installed the rule violation reminder device of the present embodiment can quickly arrive at the scene, the vehicle can be quickly removed to ensure the smooth flow and safety of the area, and the vehicle driver may be exempted from receiving fines in specific formats or be beneficial to safeguarding the public interest. For this reason, this step can set the reminder information as an instant reminder method such as an instant virtual phone call.

[0061] visible, Figure 2In an embodiment, when the relevant specific personnel may be far away from the vehicle, the relevant specific personnel will actively give a broadcast-style warning reminder, usually requiring the vehicle driver to cooperate in moving the vehicle. The situation on the scene has not yet reached the point where the vehicle has to be forcibly towed away due to the vehicle driver's refusal to cooperate. The situation on the scene of the vehicle parking is in a "progressive state" of punishment for a specific person. For this reason, the reminder strategy of this embodiment can be considered as a first-level warning state, and the driver is required to be reminded in time and arrive at the scene to cooperate in the processing.

[0062] Based on the above Figure 2 According to the understanding of the embodiments, the neural network model can also be trained to have the ability to recognize whether there are objects used by specific occupations in the current environment video under specific usage scenarios, and the items used by specific occupations to be identified in the training samples used to train the neural network model can be marked. For example, the items used by specific occupations to be identified in the training samples may include: specific occupational wear features (such as specific occupational logos, specific occupational hats, specific occupational clothing, etc.), specific occupational transportation features (such as motorcycles for specific occupations, cars for specific occupations, trailers for specific occupations, etc.), specific occupational supplies (shoulder-mounted video recorders, shoulder-mounted walkie-talkies, etc.), and after training, a neural network model with the ability to recognize objects with specific occupational characteristics is obtained.

[0063] See also Figure 3 Another embodiment of the rule violation reminder method of the present application includes:

[0064] 301. When the environmental status information includes the current environmental video, determine whether the specific occupational user object is identified in the current environmental video. If the specific occupational user object is not identified in the current environmental video, execute step 302; if the specific occupational user object is identified in the current environmental video, execute step 303.

[0065] The situation targeted by this embodiment is still: the driver of the vehicle and the violation reminder system of this embodiment have not found that the vehicle is in an illegal parking area (including an area where the vehicle needs to be moved during a certain period of time) in the early stage, and the vehicle has been turned off and is in a parked state and there are no passengers in the vehicle. The process of determining that the vehicle is in a parked state and there are no passengers in the vehicle is the same as the above Figure 1The embodiments are similar, and the repeated parts are not repeated here. Specifically, the rule violation reminder device of this embodiment is in operation, and continuously monitors the current environmental conditions of the vehicle to obtain environmental condition information. When the environmental condition information includes the current environmental video, this step uses a neural network model to identify and analyze the video of the current environmental video. Assuming that the current environmental video identifies the presence of a specific occupational user, it proves that a specific person has come or is already around the vehicle to manage or persuade the vehicle to leave, and may even have issued a specific format document to the vehicle where the rule violation device is located. At this time, the vehicle driver is also required to go to the scene in time to deal with it; if the current environmental video does not identify the presence of a specific occupational user, it proves that the vehicle should not be suspected of violating the regulations at present.

[0066] 302. Ignore.

[0067] When step 301 determines that no specific occupational user is identified in the current environmental video, or step 303 determines that the vehicle is in the preset compliant parking area, it proves that the vehicle is not currently suspected of violating the regulations and can continue to be monitored, ignoring the reminder measures.

[0068] 303. Determine whether the vehicle is in a preset compliant parking area. If the vehicle is in the preset compliant parking area, execute step 302; if the vehicle is not in the preset compliant parking area, execute step 304.

[0069] It should be noted that in reality there are many places with clearly defined compliant parking areas for vehicles, such as parking spaces in compliant parking lots, personal parking spaces for families, private residential areas, etc. These areas can be identified as preset compliant parking areas. These preset compliant parking areas can be pre-marked on the map and stored in the database of the cloud server, or they can be set by the user according to their needs and stored in association with the user's personal account.

[0070] When step 301 determines that there are specific occupational users identified in the current environment video, this step needs to further determine whether the vehicle is in the preset compliant parking area. If the vehicle is in the preset compliant parking area, it proves that even if there are specific occupational users around the vehicle (for example, the vehicle driver himself is a specific person, a specific person is passing by after get off work, etc.), it is highly likely that they will not violate the rules, and there is no need to issue a reminder; if the vehicle is not in the preset compliant parking area, it is difficult to determine whether the non-preset compliant parking area on the map is suspected of violating the rules. In this case, it is more appropriate for the vehicle driver to go to the scene in time to deal with it.

[0071] 304. Send a reminder message to a preset communication object.

[0072] This step is performed in the same way as above. Figure 1Step 103 in the embodiment is similar, and the repeated parts are not repeated here.

[0073] It is understandable that the reminder information sent to the preset communication object in this step can be in the form of reminder text messages, WeChat public account reminder information, mobile phone application notification bar reminder, etc.

[0074] visible, Figure 3 The embodiment is a situation where the relevant specific personnel are already around the vehicle. The relevant specific personnel may have been in the "completed state" or "in progress state" of the vehicle parking situation. For this reason, the reminder strategy of this embodiment can be considered as a secondary warning state, which requires the driver to be reminded in time and arrive at the scene to cooperate in the processing.

[0075] In another embodiment, the neural network model can also be trained to have the ability to detect whether there is a specific format document object in the current environment video (or current environment image) in a specific usage scenario, and the specific format document object to be identified in the training sample used to train the neural network model can be marked. For example, taking the vehicle as an example, the specific format document object to be identified in the training sample of the neural network is a positive sample, and the positive sample may include: a specific format document attached to the front windshield of the car, a specific format document clamped on the front wiper of the car, a specific format document attached to the driver's side door, etc. After training, a neural network model with the ability to identify specific format document objects is obtained. It should be noted that the neural network model of this embodiment also needs to identify and distinguish small cards, flyers, etc. Usually, publicity personnel will place small cards for commercial advertisements or flyers for product promotions in vehicle positions similar to specific format documents, so the training samples of the neural network also need to train and identify small cards, flyers, etc. as negative samples, so that after training, a neural network model with the ability to exclude non-specific format document objects (such as small cards, flyers, etc.) but can identify specific format document objects is obtained. Please refer to Figure 4 Another embodiment of the rule violation reminder method of the present application includes:

[0076] 401. When the environmental status information includes the current environmental video and the presence of a document object in a specific format is identified from the current environmental video, it is determined that the vehicle is suspected of violating a preset rule.

[0077] The situation targeted by this embodiment is still: the driver of the vehicle and the violation reminder system of this embodiment have not found that the vehicle is in an illegal parking area (including an area where the vehicle needs to be moved during a certain period of time) in the early stage, and the vehicle has been turned off and is in a parked state and there are no passengers in the vehicle. The process of determining that the vehicle is in a parked state and there are no passengers in the vehicle is the same as the above Figure 1The embodiments are similar and the repeated parts are not repeated here. Specifically, when the environmental status information includes the current environmental video and / or the current environmental image, and the neural network model recognizes the existence of a document object in a specific format from the current environmental video and / or the current environmental image, it is usually excluded that it is a small card or a leaflet, and it can be directly concluded that the vehicle is suspected of violating the preset rules.

[0078] 402. Send a reminder message to a preset communication object.

[0079] This step is performed in the same way as above. Figure 3 Step 304 in the embodiment is similar, and the repeated parts are not repeated here.

[0080] visible, Figure 4 The embodiment is that the relevant specific personnel are already in the "completed state" of punishing the vehicle parking situation on site. Therefore, the reminder strategy of this embodiment can be considered as a three-level warning state, and the driver is also required to be reminded in time and arrive at the scene to cooperate in the processing.

[0081] Based on any of the above embodiments, please refer to Figure 5 Another embodiment of the rule violation reminder method of the present application includes:

[0082] 501. Respond to a remote media viewing request of a preset communication object.

[0083] After the user mobile terminal 1103 of this embodiment is installed with the corresponding user-side application 1104, it can log in to an authorized account and connect to the cloud server 1105 to access the rule violation reminder device 1101, and send a remote media viewing request to the rule violation reminder device 1101. The remote media viewing request can require the rule violation reminder device located on the vehicle to provide real-time feedback on media resources such as the video captured by its camera module and the audio recorded by the recording module. In this step, the reminder device 1101 can respond to the remote media viewing request of the preset communication object. The preset communication object here refers to the authorized account (WeChat ID, mobile phone number, etc.) logged in on the user-side application 1104 of the user mobile terminal 1103, or an account that the authorized account allows to share permissions. This step will only respond to relevant requests of the authorized preset communication object to avoid leakage of relevant media data and ensure data security.

[0084] It is understandable that this embodiment can also respond to other information viewing requests of the preset communication object, such as viewing requests for temperature, humidity and other information. The principle is similar to the above-mentioned process of responding to the remote media viewing request of the preset communication object, and will not be repeated here.

[0085] 502. Transmit one or more media resources of the current ambient sound and the current ambient video of the vehicle's environment to a preset communication object based on the remote media viewing request.

[0086] After deciding to respond to the remote media viewing request of the authorized preset communication object in step 501, the rule violation reminder device 1101 in this step can transmit one or more media resources of the current environment sound and current environment video of the vehicle environment to the preset communication object according to the remote media viewing request. Specifically, the rule violation reminder device 1101 usually needs to encrypt and upload the relevant media resources to the cloud server 1105 for storage or temporary storage, and then forwarded by the cloud server 1105 to the user mobile terminal 1103 where the preset communication object is located; if the cloud server 1105 has made a real-time backup of the media resources of the rule violation reminder device 1101, then the cloud server 1105 can directly forward it to the user mobile terminal 1103 where the preset communication object is located, so that the driver of the vehicle can view the current environment sound and current environment video of the vehicle environment through the user mobile terminal 1103, so that he can make a quick decision on the vehicle scene and improve the user experience.

[0087] In another embodiment, in the above embodiment Figure 1 , Figure 2 , Figure 3 , Figure 4 When a reminder message is sent to a preset communication object, the preset communication object can be reminded to log in to an authorized account to remotely view the current media resources at the location of the vehicle, which is convenient and fast, allowing it to quickly make a decision on the on-site situation of the vehicle.

[0088] In another embodiment, since the database of the cloud server 1105 can update, store and manage the satellite positioning tracks, reminder information, etc. of several rule violation reminder devices 1101 in real time, the cloud server 1105 can calculate the distance between each rule violation reminder device on the map, that is, the distance between each vehicle equipped with a rule violation reminder device, and can also know in real time whether there are other rule violation reminder devices within a certain distance around a certain rule violation reminder device. Based on the above understanding, after the rule violation reminder device of the vehicle in this embodiment opens the permission to share the location with other rule violation reminder devices, the cloud server 1105 can provide it with a shared rule violation reminder service with a diameter of P meters centered on it, where P is a positive integer greater than 0. The so-called shared rule violation reminder service means that the cloud server 1105 periodically or in real time monitors whether there is a vehicle with the same rule violation reminder device B installed in an area with a set length of P meters as the diameter, centered on the rule violation reminder device A that has activated the service; if there is no vehicle with the rule violation reminder device B installed in the area with a length of P meters as the diameter, the monitoring continues; if there is a vehicle with the rule violation reminder device B installed in the area with a length of P meters as the diameter, the reminder information uploaded by the rule violation reminder device to the cloud server is shared with the rule violation reminder device A, and the rule violation reminder is shared in real time with the communication object preset by the rule violation reminder device A. The reminder information of the rule violation reminder device B is used to expand the monitoring service scope of the rule violation reminder device A in its environment (that is, the vehicle driver of the rule violation reminder device A can also receive the reminder information of the rule violation reminder device B), and the reminder information data sharing between multiple rule violation reminder devices is realized (for example, the rule violation reminder device A and the rule violation reminder device B mentioned above, and there can be more in actual applications). Multiple rule violation reminder devices can remind all parties of suspected violations within a certain range, thereby expanding the warning scope of a single rule violation reminder device, so that the vehicle driver has more sufficient time to make decisions.

[0089] Based on the understanding of the above embodiments, the rule violation reminder device 1101 of this embodiment can not only provide post-remedial reminders, but also provide necessary vehicle parking rules guidance when there are passengers on the vehicle. For example, taking the vehicle as a car as an example, the rules preset in this embodiment mainly refer to: the implemented road traffic rules, the parking rules of each parking lot, the user-defined personalized parking rules, or other unforeseen rules. Because the existing road traffic rules are relatively complex, there are some local traffic rules in some local areas (for example, the odd and even numbers at the end of the license plate in the place are restricted on alternate days, and the restrictions on working days and non-working days, etc.), and different parking lots have different parking rules (for example, some parking lots are limited to parking for personnel of a certain unit, a certain community, etc., and a certain shopping mall parking lot requires shopping to park, etc.), and some sections of roads have regulations for temporary parking during certain periods of time.

[0090] See also Figure 6 Another embodiment of the rule violation reminder method of the present application includes:

[0091] 601. When the vehicle is in driving state and there is at least a driver in the vehicle, a location information reminder service is provided through a preset satellite positioning algorithm.

[0092] When the vehicle is in driving state and there is at least a driver in the vehicle, since the hardware foundation of the rule violation reminder device 1101 of this embodiment can realize satellite positioning and map navigation capabilities, this step can realize the provision of location information reminder services through a preset satellite positioning algorithm. For example, when the driver wants to know whether there is a preset compliant parking area around the current position, this step can be based on the current position, calculate the number of preset compliant parking areas within a certain distance (this distance can be set by the user) on the map data, and report it to the driver through audio broadcast or display terminal display for the driver to choose.

[0093] 602. When the vehicle changes from the driving state to the running-only state, determine whether the current position is a preset compliant parking area. If the current position is not a preset compliant parking area, execute step 603; if the current position is a preset compliant parking area, execute step 604.

[0094] When the vehicle changes from the driving state to the running state only, it means that the vehicle is in a stopped state. Usually, this situation usually occurs when the driver of the vehicle is about to stop or wait for the traffic light at the traffic intersection. This step can be combined with the satellite positioning module to determine the current position of the vehicle, and further determine whether the current position of the vehicle is a preset compliant parking area. This step can set the traffic intersection as a time-limited compliant parking area. The time-limited compliant parking area can be considered as a type of preset compliant parking area. When the time-limited compliant parking area is limited in duration (i.e., limited to waiting for traffic lights and cannot be parked for a long time), the duration of the time-limited compliant parking area can be set according to actual conditions. For example, the timing usually starts with the vehicle speed being 0 and does not exceed 120 seconds. When the vehicle speed exceeds 0, the timing ends and the timing duration is cleared, so as to solve the problem of distinguishing and identifying limited-time parking at traffic intersections from parking in preset compliant parking areas such as parking lots in the usual sense. The time-limited compliant parking area is considered to be a non-preset compliant parking area if it exceeds the limited duration. Based on the above understanding, if this step determines that the current location is not a preset compliant parking area, it means that the vehicle has stayed too long in a location where it should not be parked, and is suspected of violating the rules; if the current location is a preset compliant parking area, it means that the vehicle can continue to be parked at the current location.

[0095] 603. Issue a voice reminder and display the nearest one or more preset compliant parking areas on a map.

[0096] When step 602 determines that the current location of the vehicle is not a preset compliant parking area, it means that the vehicle has stayed too long at a location where it should not be parked, and is suspected of violating the rules. In this step, the rule violation reminder device 1101 should immediately issue a voice reminder on the spot, for example, the voice reminder is "The current location is not suitable for long-term stay, please drive the vehicle away". Further, this step can also automatically find one or more (the specific number can be pre-set by the user) compliant parking areas on the map data based on the current location for the driver to choose, and display the nearest one or more preset compliant parking areas on the map through the display terminal. When a preset compliant parking area is selected, the driver is guided to it through map navigation, so as to actively provide compliant parking instructions for potential rule-violating drivers, so that they can go to the preset compliant parking area and reduce illegal parking of vehicles.

[0097] 604. Ignore.

[0098] When step 602 determines that the current location is a preset compliant parking area, it means that the vehicle can continue to park at the current location without executing the relevant reminder strategy.

[0099] It can be seen that the rule violation reminder device of this embodiment can provide vehicle parking-related reminder services to the vehicle driver when the vehicle is in driving state and there is at least a driver in the vehicle, or when the vehicle changes from driving state to running state only.

[0100] See also Figure 7 Another embodiment of the rule violation reminder method of the present application includes:

[0101] 701. When the vehicle is in a running-only state or a parking state, and there is at least one passenger in the vehicle, a video recording module is used to obtain photos of road signs or parking notices around the vehicle.

[0102] In this embodiment, when the vehicle is in the running-only state or the vehicle is in the parking state, and there is at least one passenger in the vehicle, it indicates that the vehicle is in a non-driving state and there is a communicable person in the vehicle, and at this time it is impossible to determine whether the current location is a preset compliant parking area based on the map data (for example, due to signal problems, it cannot be connected to the network, or it is beyond the network service area, etc.). In this case, the rule violation reminder device of this embodiment can also provide services related to parking information. For example, at this time, the image module can be used to obtain photos of road signs or parking notices around the vehicle (assuming that the rule violation reminder device can actively search around and take pictures), because when the vehicle is in a non-driving state, it is very likely to be temporarily parked on the roadside or in a parking lot.

[0103] 702. Perform text recognition on photos of road signs or parking notices.

[0104] It is understandable that the neural network model in this embodiment can also be trained to recognize the text in road sign pictures or parking notice photos, and the text to be recognized in the training samples used to train the neural network model can be marked. For example, the text to be recognized and marked in the training samples include: current common standard Chinese characters, traditional Chinese characters, Japanese, English, etc. After training, a neural network model with text recognition ability is obtained. In this step, the neural network model with text recognition ability can be used to directly perform text recognition on the surrounding road sign photos or parking notice photos obtained in step 701.

[0105] 703. Determine whether the vehicle is allowed to park at its current position. If the vehicle is not allowed to park at its current position, execute step 704; if the vehicle is allowed to park at its current position, execute step 705 or step 707.

[0106] This step mainly judges whether parking is allowed at the current position of the vehicle based on the result of the text recognition in step 702. Assuming that the road sign is a parking fee notice board, the text recognition result of the parking fee notice board is: temporary parking is allowed on both sides of the road with little traffic during a certain time period (for example, between 10:00 p.m. and 6:00 a.m. the next day). Then, this step can judge whether parking is allowed at the current position of the vehicle based on the current local time of the rule violation reminder device and the time period allowed by the parking fee notice board. If parking is not allowed at the current position of the vehicle, the passenger in the vehicle should be reminded on the spot; if parking is allowed at the current position of the vehicle, but it is conditional parking, then the passenger in the vehicle also needs to be reminded on the spot; if parking is allowed at the current position of the vehicle and no conditional parking is found, it can be ignored.

[0107] 704. Issue a voice reminder and display the nearest one or more preset compliant parking areas on a map.

[0108] When it is determined in step 703 that the current location of the vehicle does not allow parking, the person in the vehicle should be reminded on the spot, usually by voice reminder, such as "Parking is not allowed at the current location, please leave in time". In the case where the current location can be obtained using a satellite positioning module, this step can further display the nearest one or more preset compliant parking areas on a map for the person in the vehicle through a display terminal for reference and selection.

[0109] 705. If temporary parking is allowed only for a limited time, a limited time reminder is issued.

[0110] When step 703 determines that parking is allowed at the current position of the vehicle, but it is conditional parking, for example, the vehicle is only allowed to temporarily park for a limited time (temporary parking is allowed on both sides of the road with little traffic during a certain time period (for example, between 10:00 pm and 06:00 am the next day), and temporary parking is also allowed in squares with no entertainment activities during the day (9:00 to 18:00), etc.), a limited time reminder is issued to the occupants of the vehicle, usually a voice reminder, and it can also be combined with a pop-up reminder on the display terminal.

[0111] 706. Count down the limited time and issue a second reminder within a certain time range before the limited time.

[0112] After the rule violation reminder device issues a limited-time reminder in step 705, if it is found that the vehicle has not moved (which can be calculated through the speed sensor, satellite positioning module, etc.), it proves that the vehicle has not left the state of violating relevant regulations in the video. This step can count down the limited time and issue a second reminder within a certain time range from the limited time (for example, 30 minutes, 10 minutes before the deadline, etc.), so that the passengers in the vehicle are aware of the impending suspected violation of the rules, and can then make relevant decisions quickly.

[0113] 707. Ignore.

[0114] When step 703 determines that the current position of the vehicle allows parking and there is no time limit, monitoring can continue and reminder measures can be ignored.

[0115] 708. Determine whether the parking rules for the current location have been updated in the database. If the parking rules for the current location have been updated in the database, execute step 707; if the parking rules for the current location have not been updated in the database, execute step 710.

[0116] After recovery and networking, this step can further determine whether the parking rules for the current location (referring to the current location when the road sign or parking notice photo is taken in step 701) have been updated in the database of the cloud server. If the parking rules for the current location have been updated in the database, it means that the database execution refers to the latest map data; if the database has not updated the parking rules for the current location, it means that the data execution refers to a relatively backward version of map data and needs to be updated.

[0117] 709. The parking rules for the current location in the database are updated and made effective, and the invalid historical parking rules for the current location are retained.

[0118] When step 708 determines that the database has not updated the parking rules for the current location, it means that the data execution reference is a relatively backward version of map data, which is not suitable for vehicle drivers to refer to this part of the map data. The data of this section of road or parking lot needs to be updated to avoid confusion in parking guidance for users. Of course, when this step updates the parking rules for the current location in the database, the invalid historical parking rules for the current location should be retained so as to study the causes and consequences of the changes in the local rules, which is conducive to providing data reference for the research and revision of local parking policies or rules.

[0119] 710. Ignore.

[0120] When step 708 determines that the parking rules for the current location have been updated in the database, monitoring can be continued and reminder measures can be ignored.

[0121] The above describes the embodiment of the rule violation reminder method of the present application. The following describes the embodiment of the rule violation reminder device of the present application. Figure 8 , an embodiment of the rule violation reminder device of the present application includes:

[0122] The monitoring unit 801 is used to monitor the current environment of the vehicle and obtain the environment information when it is determined that the vehicle is in a parked state and there is no person in the vehicle;

[0123] A judging unit 802, configured to judge whether the vehicle is suspected of violating a preset rule according to the environmental condition information;

[0124] The reminder unit 803 is used to send a reminder message to a preset communication object if it is determined that the vehicle is suspected of violating the preset rules.

[0125] The operation performed by the rule violation reminder device of this embodiment is similar to the above Figure 1 The operations performed in the embodiments are similar, and the repeated parts will not be repeated here.

[0126] See also Fig. 9 Another embodiment of the rule violation reminder device of the present application includes:

[0127] The monitoring unit 901 is used to monitor the current environment of the vehicle and obtain the environment information when it is determined that the vehicle is in a parked state and there is no person in the vehicle;

[0128] A judging unit 902, configured to judge whether the vehicle is suspected of violating a preset rule according to the environmental condition information;

[0129] The reminder unit 903 is used to send a reminder message to a preset communication object if it is determined that the vehicle is suspected of violating the preset rules.

[0130] Optionally, when the judging unit 902 judges whether the vehicle is suspected of violating a preset rule according to the environmental condition information, it is specifically used to:

[0131] When the environmental condition information includes current environmental sound, determining whether the environmental soundprint of the current environmental sound is consistent with a preset target voiceprint;

[0132] The trigger unit 904 is configured to trigger the step of sending a reminder message to a preset communication object if it is determined that the environmental voiceprint is consistent with the target voiceprint.

[0133] Optionally, the device further comprises:

[0134] The judging unit 902 is further configured to judge whether the duration of the environmental soundprint is equal to or exceeds a preset duration;

[0135] The trigger unit 904 is further configured to trigger the step of sending a reminder message to a preset communication object if it is determined that the duration of contact with the environmental voiceprint is equal to or exceeds the preset duration;

[0136] The ignoring unit 905 is configured to ignore the environment voiceprint if the duration of the interaction with the environment voiceprint is less than the preset duration.

[0137] Optionally, when the judging unit 902 judges whether the vehicle is suspected of violating a preset rule according to the environmental condition information, it is specifically used to:

[0138] When the environmental status information includes a current environmental video, determining whether a specific occupational user is identified in the current environmental video;

[0139] The trigger unit 904 is further configured to trigger the step of sending a reminder message to a preset communication object if it is determined that an object using a specific occupation is identified in the current environment video.

[0140] Optionally, the device further comprises:

[0141] The judging unit 902 is further used to judge whether the vehicle is in a preset compliance parking area;

[0142] The trigger unit 904 is further configured to trigger the step of sending a reminder message to a preset communication target if it cannot be determined that the vehicle is in the preset compliant parking area;

[0143] The ignoring unit 905 is configured to ignore the vehicle if it is determined that the vehicle is in the compliant parking area.

[0144] Optionally, when the judging unit 902 judges whether the vehicle is suspected of violating a preset rule according to the environmental condition information, it is specifically used to:

[0145] When the environmental status information includes the current environmental video, and a document in a specific format is identified from the current environmental video, determining that the vehicle is suspected of violating a preset rule;

[0146] The trigger unit 904 is further used to trigger the step of sending a reminder message to a preset communication object.

[0147] Optionally, the device further comprises:

[0148] A response unit 906, configured to respond to a remote media viewing request of the preset communication object;

[0149] The transmission unit 907 is used to transmit one or more media resources of the current ambient sound and the current ambient video of the environment in which the vehicle is located to the preset communication object according to the remote media viewing request.

[0150] The operation performed by the rule violation reminder device of this embodiment is similar to the above Figures 1 to 7 The operations performed in any embodiment are similar, and the repeated parts will not be repeated here.

[0151] The computer device in the embodiment of the present application is described below. Fig.10 , an embodiment of the computer device in the embodiment of the present application includes:

[0152] The computer device 1000 may include one or more processors (central processing units, CPU) 1001 and a memory 1002, in which one or more application programs or data are stored. Among them, the memory 1002 is a volatile storage or a persistent storage. The program stored in the memory 1002 may include one or more modules, and each module may include a series of instruction operations in the computer device. Furthermore, the processor 1001 can be configured to communicate with the memory 1002 and execute a series of instruction operations in the memory 1002 on the computer device 1000. The computer device 1000 may also include: one or more wireless network interfaces 1003, one or more input and output interfaces 1004, one or more video recording modules 1005, one or more audio recording modules 1006, and / or, one or more operating systems, such as Harmony OS, Windows Server, Mac OS, Unix, Linux, FreeBSD, etc. The processor 1001 can execute the aforementioned Figures 1 to 7 The operations performed in any of the illustrated embodiments will not be described in detail here.

[0153] In several embodiments provided in the embodiments of the present application, those skilled in the art should understand that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the unit is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0154] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, read-only memory), random access memory (RAM, random access memory), disk or optical disk and other media that can store program code.

[0155] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions or improvements made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A rule violation reminder method, characterized in that: include: When it is determined that the vehicle is in a parked state and there is no person in the vehicle, monitoring the current environment of the vehicle to obtain environmental condition information; Determining whether the vehicle is suspected of violating a preset rule according to the environmental condition information; If it is determined that the vehicle is suspected of violating the preset rules, a reminder message is sent to the preset communication object.

2. The rule violation reminder method according to claim 1, characterized in that: Judging whether the vehicle is suspected of violating a preset rule according to the environmental condition information includes: When the environmental condition information includes current environmental sound, determining whether the environmental soundprint of the current environmental sound is consistent with a preset target voiceprint; If it is determined that the environmental voiceprint is consistent with the target voiceprint, the step of sending a reminder message to a preset communication object is triggered.

3. The rule violation reminder method according to claim 2, characterized in that: After determining that the environmental voiceprint is consistent with the target voiceprint, before triggering the step of sending a reminder message to a preset communication object, the method further includes: Determine whether the duration of the environmental voiceprint is equal to or exceeds a preset duration; If it is determined that the duration of contact with the environmental voiceprint is equal to or exceeds the preset duration, triggering the step of sending a reminder message to the preset communication object; If the duration of contact with the environmental voiceprint is less than the preset duration, it is ignored.

4. The rule violation reminder method according to claim 1, characterized in that: Judging whether the vehicle is suspected of violating a preset rule according to the environmental condition information includes: When the environmental status information includes a current environmental video, determining whether a specific occupational user is identified in the current environmental video; If it is determined that an object used for a specific occupation is identified in the current environment video, a step of sending a reminder message to a preset communication object is triggered.

5. The rule violation reminder method according to claim 4, characterized in that: After determining that a specific occupational user exists in the current environment video, before triggering the step of sending a reminder message to a preset communication object, the method further includes: Determining whether the vehicle is in a preset compliant parking area; If it cannot be determined that the vehicle is in the preset compliant parking area, triggering the step of sending a reminder message to a preset communication object; If it is determined that the vehicle is in the legal parking area, it is ignored.

6. The rule violation reminder method according to claim 1, characterized in that: Judging whether the vehicle is suspected of violating a preset rule according to the environmental condition information includes: When the environmental status information includes the current environmental video, and a document object in a specific format is identified from the current environmental video, determining that the vehicle is suspected of violating a preset rule; Trigger the execution of the step of sending a reminder message to the preset communication object.

7. The rule violation reminder method according to claim 1, characterized in that: The method further comprises: Responding to a remote media viewing request of the preset communication object; One or more media resources including current ambient sound and current ambient video of the environment in which the vehicle is located are transmitted to the preset communication object according to the remote media viewing request.

8. A rule violation reminder device, characterized in that: include: A monitoring unit, configured to monitor the current environment of the vehicle and obtain environmental status information when it is determined that the vehicle is in a parked state and there is no person on board the vehicle; A judgment unit, used to judge whether the vehicle is suspected of violating a preset rule according to the environmental condition information; The reminder unit is used to send a reminder message to a preset communication object if it is determined that the vehicle is suspected of violating the preset rules.

9. A computer device, characterized in that: include: Processor, memory, bus, input and output interface, wireless network interface, camera module, recording module; The processor is connected to the memory, the input / output interface, the wireless network interface, the camera module, and the recording module via the bus; The memory stores a program; When the processor executes the program stored in the memory, it executes the rule violation reminder method described in any one of claims 1 to 7.

10. A computer storage medium, characterized in that: The computer storage medium stores instructions, and when the instructions are executed by a computer device, the computer device executes the rule violation reminder method as described in any one of claims 1 to 7.

Images