Remote automobile real-time audio monitoring device and monitoring method thereof

Abstract

The invention relates to the technical field of vehicles, in particular to a remote vehicle real-time audio monitoring device and a monitoring method thereof.The device comprises a vehicle end processing assembly and a mobile terminal, the vehicle end processing assembly comprises an acquisition module, a processing module and a communication module, and the acquisition module is used for acquiring audio information of a current vehicle; the processing module is used for identifying the audio information to obtain an identification result, and generating reminding information according to the audio information when judging that the vehicle is in an abnormal state according to the identification result; and the communication module is used for sending the reminding information to a mobile terminal so as to carry out alarm reminding through the mobile terminal. Therefore, the problem that when the automobile is scratched or maliciously damaged in the parking process, clues can only be found through videos, and real-time monitoring cannot be conducted when the automobile is damaged is solved, and the safety of the automobile is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a remote automobile real-time audio monitoring device and a monitoring method thereof. Background Art

[0002] With the development of artificial intelligence, cars are becoming more and more intelligent. Some car manufacturers have realized the remote video function of the car. The surrounding information of the vehicle can be viewed in real time through the forward camera, rear camera, left camera, right camera and in-car camera. When the car encounters scratches or malicious damage during parking, the vehicle automatically saves the video. Users can see that the vehicle has been damaged by watching the video, but at this time they can only find clues through the video, and cannot monitor in real time when the vehicle is damaged. Summary of the invention

[0003] The present application provides a remote real-time audio monitoring device for a car and a monitoring method thereof, so as to solve the problem that when a car is scratched or vandalized during parking, clues can only be found through video, but real-time monitoring is not possible when the vehicle is damaged.

[0004] The first aspect of the present application provides a remote real-time audio monitoring device for a car, comprising: a vehicle-side processing component and a mobile terminal, the vehicle-side processing component comprising a collection module, a processing module and a communication module, wherein the collection module is used to collect audio information of the current vehicle; the processing module is used to identify and process the audio information to obtain an identification result, and when it is determined that the vehicle is in an abnormal state based on the identification result, generate a reminder message based on the audio information; the communication module is used to send the reminder message to the mobile terminal so as to issue an alarm reminder through the mobile terminal.

[0005] Optionally, the vehicle-side processing component further includes: a receiving module for receiving voice information input by the vehicle owner through the mobile terminal; and a first reminder module for playing the voice information.

[0006] Optionally, the processing module is also used to: when it is determined according to the recognition result that the current vehicle has collided or scratched, generate maintenance information according to the audio information, and send the maintenance information to a remote server through the communication module so that maintenance personnel can perform remote fault diagnosis and maintenance guidance.

[0007] Optionally, the vehicle-side processing component also includes: a second reminder module, used to generate alarm information according to the reminder information, and to issue an alarm reminder according to the alarm information.

[0008] Optionally, the second reminder module includes: an optical reminder unit, used to control the vehicle to make an optical alarm based on the alarm reminder; and / or, an acoustic reminder unit, used to control the vehicle to make an acoustic alarm based on the alarm reminder.

[0009] Optionally, the vehicle-side processing component also includes: a positioning module, which is used to send positioning information and alarm information to the local emergency department when the current vehicle collides or scratches.

[0010] The second aspect of the present application provides a remote car real-time audio monitoring method, which adopts the above-mentioned remote car real-time audio monitoring device, and includes the following steps: collecting audio information of the current vehicle; identifying and processing the audio information to obtain an identification result, and when it is determined that the vehicle is in an abnormal state according to the identification result, generating a reminder message according to the audio information; sending the reminder message to a mobile terminal to issue an alarm reminder through the mobile terminal.

[0011] Optionally, when it is determined that the vehicle is in an abnormal state according to the recognition result, it includes: receiving voice information input by the vehicle owner through the mobile terminal, and playing the voice information.

[0012] Optionally, when it is determined according to the recognition result that the vehicle is in an abnormal state, it includes: when it is determined according to the recognition result that the current vehicle has a collision or scratch, generating maintenance information based on the audio information, and sending the maintenance information to a remote server through a communication module, so that maintenance personnel can perform remote fault diagnosis and maintenance guidance.

[0013] Optionally, when it is determined that the vehicle is in an abnormal state according to the recognition result, it includes: generating alarm information according to the reminder information, and issuing an alarm reminder according to the alarm information.

[0014] In the above implementation, the audio information of the current vehicle is collected by the acquisition module, and the audio information is identified and processed by the processing module to obtain the identification result. When the vehicle is determined to be in an abnormal state according to the identification result, a reminder message is generated according to the audio information, and the reminder message is sent to the mobile terminal by the communication module, so as to issue an alarm reminder through the mobile terminal. In this way, the problem that when the car encounters scratches or malicious damage during parking, the clues can only be found through the video, and the real-time monitoring when the vehicle is damaged cannot be performed, thus ensuring the safety of the vehicle.

[0015] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0017] Figure 1 This is an example diagram of a remote real-time audio monitoring device for a car according to an embodiment of the present application;

[0018] Figure 2 This is an example diagram of a remote real-time audio monitoring device for a car according to an embodiment of the present application;

[0019] Figure 3 A schematic diagram of a remote automobile real-time audio monitoring method according to an embodiment of the present application;

[0020] Figure 4 The present invention is a flowchart of a remote automobile real-time audio monitoring method provided according to an embodiment of the present application. Description of the drawings:

[0022] 10-remote car real-time audio monitoring device; 100-vehicle end processing component; 200-mobile end; 101-acquisition module; 102-processing module; 103-communication module. DETAILED DESCRIPTION

[0023] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0024] The following describes the remote real-time audio monitoring device and monitoring method of the embodiment of the present application with reference to the accompanying drawings. In view of the problem mentioned in the above background technology that when a car encounters scratches or malicious damage during parking, clues can only be found through video, and it is impossible to monitor in real time when the vehicle is damaged, the present application provides a remote real-time audio monitoring device for a car, in which the audio information of the current vehicle is collected by the acquisition module, and the audio information is identified and processed by the processing module to obtain the identification result, and when it is determined that the vehicle is in an abnormal state according to the identification result, a reminder message is generated according to the audio information, and the reminder message is sent to the mobile terminal by the communication module, so as to issue an alarm reminder through the mobile terminal. In this way, the problem that when a car encounters scratches or malicious damage during parking, clues can only be found through video, and it is impossible to monitor in real time when the vehicle is damaged is solved, and the safety of the vehicle is guaranteed.

[0025] Specifically, Figure 1 A schematic diagram of a remote automobile real-time audio monitoring device provided in an embodiment of the present application.

[0026] like Figure 1 As shown, the remote automobile real-time audio monitoring device 10 includes: a vehicle-side processing component 100 and a mobile terminal 200, the vehicle-side processing component includes a collection module 101, a processing module 102 and a communication module 103, wherein the collection module 101 is used to collect audio information of the current vehicle; the processing module 102 is used to identify and process the audio information to obtain an identification result, and when it is determined that the vehicle is in an abnormal state based on the identification result, a reminder message is generated based on the audio information; the communication module 103 is used to send the reminder message to the mobile terminal 200, so as to issue an alarm reminder through the mobile terminal 200.

[0027] Optionally, in some embodiments, the vehicle-side processing component 100 further includes: a receiving module for receiving voice information input by the vehicle owner through a mobile terminal; and a first reminder module for playing the voice information.

[0028] The acquisition module 101 includes an external camera and an external sound acquisition device, which are used to acquire audio information of the current vehicle. The external sound acquisition device is also used to play voice information.

[0029] Specific as Figure 2 and Figure 3 As shown, when a vehicle is colliding or scratching, or a vandal is destroying the vehicle, a camera and a sound collection device (such as a speaker) collect the vehicle's audio information in real time, save the audio information, and send a text message reminder to the vehicle owner.

[0030] The car owner opens the mobile phone APP, turns on the remote car real-time audio and video module, and inputs voice information into the mobile phone. The voice information is transmitted to the car's central controller unit through wireless communication. The central controller unit processes the sound and then plays it out through the sound collection device, thereby deterring the vandal.

[0031] When the vandal speaks to the owner of the car, the sound collection device outside the car records the vandal's voice.

[0032] Optionally, in some embodiments, the processing module 102 is also used to: when it is determined based on the recognition result that the current vehicle has collided or scratched, generate maintenance information based on the audio information, and send the maintenance information to a remote server through the communication module 103, so that maintenance personnel can perform remote fault diagnosis and maintenance guidance.

[0033] For example, the cameras and sound collection devices on the vehicle collect audio information in real time. Suppose other vehicles collide or scratch the current vehicle. The vehicle's cameras (such as side cameras and surround-view cameras) record video clips before and after the collision, the damaged parts of the vehicle and the surrounding environment, and the sound of the vehicle collision.

[0034] Furthermore, the vehicle's system uses an AI algorithm to analyze audio information and generate maintenance information, and the vehicle's communication module 103 sends the generated maintenance information to a remote server.

[0035] Furthermore, after the remote server receives the maintenance information, the maintenance expert can view the audio information and perform remote fault diagnosis, or send detailed maintenance instructions or suggestions to the car owner or on-site maintenance personnel through the remote service platform, including the parts that need to be replaced, how to use the maintenance tools, and precautions, etc.

[0036] Optionally, in some embodiments, the vehicle-side processing component 100 further includes: a second reminder module, configured to generate alarm information according to the reminder information, and to issue an alarm reminder according to the alarm information.

[0037] Optionally, in some embodiments, the second reminder module includes: an optical reminder unit, used to control the vehicle to make an optical alarm based on the alarm reminder; and / or, an acoustic reminder unit, used to control the vehicle to make an acoustic alarm based on the alarm reminder.

[0038] Specifically, when the current vehicle collides or is scratched, the central controller unit will immediately activate the second reminder module, and send out a strong visual signal by quickly flashing the LED warning lights on the front, rear and sides of the vehicle to issue an optical alarm, or the central controller unit will control the acoustic reminder unit to send out a high-decibel alarm to remind people around in the form of sound.

[0039] Optionally, in some embodiments, the vehicle-side processing component 100 further includes: a positioning module, which is used to send positioning information and alarm information to the local emergency department when the current vehicle collides or scratches.

[0040] For example, when the vehicle is in a collision or scratch, the positioning module uses satellite signals to determine the precise location of the vehicle (including longitude and latitude information). The precise location information of the vehicle (including longitude and latitude, timestamp, etc.) and alarm information, including the severity of the collision and the current status of the vehicle, are sent to the emergency department, so that the local emergency department can process the location information and alarm information after receiving it.

[0041] According to the remote real-time audio monitoring device for automobiles proposed in the embodiment of the present application, the audio information of the current vehicle is collected by the collection module, and the audio information is identified and processed by the processing module to obtain the identification result. When the vehicle is determined to be in an abnormal state according to the identification result, a reminder message is generated according to the audio information, and the reminder message is sent to the mobile terminal by the communication module, so as to issue an alarm reminder through the mobile terminal. In this way, the problem that when a car encounters scratches or malicious damage during parking, clues can only be found through video, and real-time monitoring cannot be performed when the vehicle is damaged is solved, thereby ensuring the safety of the vehicle.

[0042] Next, the remote automobile real-time audio monitoring method proposed in accordance with the embodiment of the present application is described with reference to the accompanying drawings.

[0043] Figure 4 It is a flowchart of a remote automobile real-time audio monitoring method according to an embodiment of the present application.

[0044] like Figure 4 As shown, the remote automobile real-time audio monitoring method adopts the above-mentioned remote automobile real-time audio monitoring device, and includes the following steps:

[0045] In step S401, audio information of the current vehicle is collected.

[0046] In step S402, the audio information is identified and processed to obtain an identification result, and when it is determined that the vehicle is in an abnormal state according to the identification result, a reminder message is generated according to the audio information.

[0047] In step S403, a reminder message is sent to the mobile terminal so as to issue an alarm reminder through the mobile terminal.

[0048] Optionally, in some embodiments, when determining that the vehicle is in an abnormal state according to the recognition result, it includes: receiving voice information input by the vehicle owner through the mobile terminal, and playing the voice information.

[0049] Optionally, in some embodiments, when it is determined according to the recognition results that the vehicle is in an abnormal state, it includes: when it is determined according to the recognition results that the current vehicle has a collision or scratch, maintenance information is generated based on the audio information, and the maintenance information is sent to a remote server through a communication module, so that maintenance personnel can perform remote fault diagnosis and maintenance guidance.

[0050] Optionally, in some embodiments, when it is determined that the vehicle is in an abnormal state according to the recognition result, it includes: generating alarm information according to the reminder information, and issuing an alarm reminder according to the alarm information.

[0051] It should be noted that the above explanation of the embodiment of the remote automobile real-time audio monitoring device is also applicable to the remote automobile real-time audio monitoring method of this embodiment, which will not be repeated here.

[0052] According to the remote real-time audio monitoring method for a car proposed in the embodiment of the present application, the audio information of the current vehicle is collected, the audio information is identified and processed to obtain an identification result, and when it is determined that the vehicle is in an abnormal state according to the identification result, a reminder message is generated according to the audio information, and the reminder message is sent to the mobile terminal to issue an alarm reminder through the mobile terminal. In this way, the problem that when a car encounters scratches or malicious damage during parking, clues can only be found through video, and real-time monitoring is not possible when the vehicle is damaged is not possible, thus ensuring the safety of the vehicle.

[0053] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0054] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0055] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0056] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be specifically implemented in any computer program product for use by an instruction execution system, apparatus or device (such as a computer-based system, a system including a processor or other system that can fetch instructions from an instruction execution system, apparatus or device and execute instructions), or used in combination with these instruction execution systems, apparatuses or devices.

[0057] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0058] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer program product, which, when executed, includes one or a combination of the steps of the method embodiment.

Claims

1. A remote real-time audio monitoring device for a car, characterized in that: include: The vehicle-side processing component and the mobile terminal, the vehicle-side processing component includes a collection module, a processing module and a communication module, wherein: The acquisition module is used to collect audio information of the current vehicle; The processing module is used to perform recognition processing on the audio information to obtain a recognition result, and when it is determined according to the recognition result that the vehicle is in an abnormal state, generate a reminder message according to the audio information; The communication module is used to send the reminder information to the mobile terminal so as to issue an alarm reminder through the mobile terminal.

2. The device according to claim 1, characterized in that The vehicle-side processing component further includes: A receiving module, used for receiving voice information input by the vehicle owner through the mobile terminal; The first reminder module is used to play the voice information.

3. The device according to claim 1, characterized in that The processing module is further used for: When it is determined according to the recognition result that the current vehicle has a collision or a scratch, maintenance information is generated according to the audio information, and the maintenance information is sent to a remote server through the communication module so that maintenance personnel can perform remote fault diagnosis and maintenance guidance.

4. The device according to claim 1, characterized in that The vehicle-side processing component further includes: The second reminder module is used to generate alarm information according to the reminder information, and to make an alarm reminder according to the alarm information.

5. The device according to claim 4, characterized in that The second reminder module includes: An optical reminder unit, used to control the vehicle to perform an optical alarm based on the alarm reminder; And / or, an acoustic reminder unit, used to control the vehicle to perform an acoustic alarm based on the alarm reminder.

6. The device according to claim 3, characterized in that The vehicle-side processing component further includes: The positioning module is used to send positioning information and alarm information to the local emergency department when the current vehicle collides or is scratched.

7. A remote real-time audio monitoring method for a car, characterized in that: The remote real-time audio monitoring device for a car according to any one of claims 1 to 6 comprises the following steps: Collect audio information of the current vehicle; Performing recognition processing on the audio information to obtain a recognition result, and when determining that the vehicle is in an abnormal state according to the recognition result, generating a reminder message according to the audio information; The reminder information is sent to the mobile terminal so as to issue an alarm reminder through the mobile terminal.

8. The method according to claim 7, characterized in that When it is determined according to the recognition result that the vehicle is in an abnormal state, the method includes: Receive the voice information input by the car owner through the mobile terminal, and play the voice information.

9. The method according to claim 7, characterized in that: When it is determined according to the recognition result that the vehicle is in an abnormal state, the method includes: When it is determined according to the recognition result that the current vehicle has a collision or a scratch, maintenance information is generated according to the audio information, and the maintenance information is sent to a remote server through a communication module so that maintenance personnel can perform remote fault diagnosis and maintenance guidance.

10. The method according to claim 7, characterized in that When it is determined according to the recognition result that the vehicle is in an abnormal state, the method includes: Generate alarm information according to the reminder information, and issue an alarm reminder according to the alarm information.

Images