Vehicle alarm cancelling method and device and computer equipment

Abstract

The invention discloses a vehicle alarm cancelling method and device and computer equipment, and belongs to the vehicle-mounted field. The method comprises the steps that in the automatic driving process of a vehicle, the steering wheel holding condition in the vehicle is obtained; based on the steering wheel holding condition, alarm information is broadcasted, and the alarm information is used for indicating a driving main body of the vehicle to apply external force control to the steering wheel in the automatic driving process; and in response to a received voice feedback signal for the alarm information, cancelling the broadcast of the alarm information, the voice feedback signal meeting a broadcast cancelling requirement of the alarm information. The discomfort caused by active steering wheel torsion of a driving main body is reduced, and the risk caused by active steering wheel torsion is reduced.

Description

Technical Field

[0001] The present application relates to the vehicle field, and in particular to a method, device and computer equipment for canceling a vehicle alarm. Background Art

[0002] With the rapid development of intelligent driving assistance functions, the application rate of corresponding driving assistance functions is also growing rapidly. After the intelligent driving function of the vehicle is turned on, the driver is required to pay attention to the vehicle status, surrounding vehicle conditions and driving road conditions at all times, and is not allowed to take the steering wheel away so that he can take over the vehicle at any time in an emergency to ensure driving safety.

[0003] In the related art, after the vehicle issues an alarm message of hands-off steering, the torque value corresponding to the steering wheel is used to determine whether the driver has responded to the alarm message, so as to cancel the broadcast of the alarm message.

[0004] However, during the intelligent driving process, one of the inhibition conditions of intelligent driving is that the twisting of the steering wheel exceeds a certain torque value. The intelligent driving system determines that the steering wheel is operated by the driver and cancels the alarm message. On the one hand, the driver is not good at controlling the force of twisting the steering wheel, which may increase the turning angle of the steering wheel, causing the vehicle to turn and cause danger. Summary of the invention

[0005] The present application provides a method, device and computer equipment for canceling vehicle alarms, which can reduce the discomfort and cumbersome operation caused by the driver frequently and actively twisting the steering wheel, and reduce the human-computer interaction efficiency between the driver and the vehicle to a certain extent. The technical solution is as follows:

[0006] According to one aspect of the present application, a method for canceling a vehicle alarm is provided, which is applied to a viewing device for a road recording video, and the method comprises:

[0007] During the automatic driving of the vehicle, obtaining a steering wheel holding condition in the vehicle, wherein the steering wheel holding condition is used to indicate a controlled condition of the steering wheel in the vehicle;

[0008] Based on the steering wheel holding condition, an alarm message is broadcasted, wherein the alarm message is used to instruct the driving subject of the vehicle to apply external force control to the steering wheel during the automatic driving process;

[0009] In response to receiving a voice feedback signal for the alarm information, canceling the broadcasting of the alarm information, wherein the voice feedback signal meets a requirement for canceling the broadcasting of the alarm information.

[0010] According to one aspect of the present application, a device for canceling a vehicle alarm is provided, which is applied to a device for viewing a road recording video, and the device includes:

[0011] An acquisition module, used to acquire a steering wheel holding condition in the vehicle during the automatic driving process of the vehicle, wherein the steering wheel holding condition is used to indicate a controlled condition of the steering wheel in the vehicle;

[0012] A playback module, configured to broadcast an alarm message based on the gripping condition of the steering wheel, wherein the alarm message is used to instruct the driving subject of the vehicle to apply external force control to the steering wheel during the automatic driving process;

[0013] The playing module is further configured to cancel broadcasting of the alarm information in response to receiving a voice feedback signal for the alarm information, wherein the voice feedback signal meets a requirement for canceling broadcasting of the alarm information.

[0014] According to one aspect of the present application, a computer device is provided. The computer device includes a processor and a memory. The memory stores a computer program. The processor loads and executes the computer program to implement the above method for canceling a vehicle alarm.

[0015] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is loaded and executed by a processor to implement the above vehicle alarm cancellation method.

[0016] According to another aspect of the present application, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the above-mentioned method for canceling a vehicle alarm.

[0017] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0018] In the process of automatic driving assisted by the intelligent driving system, when the driving subject does not hold the steering wheel for a long time, an alarm message is broadcast in the vehicle to prompt the driving subject to apply external force control to the steering wheel. After the vehicle broadcasts the alarm message, it needs to cancel the broadcast of the alarm message through the feedback of the driving subject. In the embodiment of the present application, a voice feedback mechanism is introduced. After the cancellation broadcast requirement of the alarm message is detected in the vehicle, the alarm message is stopped, such as: the voice feedback signal "OK" is detected in the vehicle, and the alarm message is directly canceled. On the one hand, the discomfort and cumbersome operation caused by the frequent and active twisting of the steering wheel by the driving subject are reduced, and the human-computer interaction efficiency between the driving subject and the vehicle is reduced to a certain extent; on the other hand, the feedback method of using voice interaction to feedback to the vehicle instead of twisting the steering wheel reduces the risk of the driving subject accidentally over-twisting the steering wheel to a certain extent, and improves driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 is a schematic diagram of a method for canceling a vehicle alarm provided by an exemplary embodiment of the present application;

[0021] Figure 2 is a flowchart of a method for canceling a vehicle alarm provided by an exemplary embodiment of the present application;

[0022] Figure 3 is a flowchart of a method for canceling a vehicle alarm provided by another exemplary embodiment of the present application;

[0023] Figure 4 is a flowchart of a method for canceling a vehicle alarm provided by yet another exemplary embodiment of the present application;

[0024] Figure 5 is a flowchart of a method for canceling a vehicle alarm provided by another exemplary embodiment of the present application;

[0025] Figure 6 It is a flowchart of a device for canceling a vehicle alarm provided by an exemplary embodiment of the present application;

[0026] Figure 7 is a flowchart of a device for canceling a vehicle alarm provided by another exemplary embodiment of the present application;

[0027] Figure 8 It is a structural block diagram corresponding to a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0029] First, the terms and related technologies involved in this application are introduced.

[0030] Vehicle: It is the front-end equipment of the vehicle monitoring and management system, called the vehicle dispatch monitoring terminal. It integrates multiple functions such as positioning, communication, vehicle driving records, image acquisition, etc., and has business dispatch functions and data processing capabilities. In the embodiment of the present application, the vehicle is equipped with an intelligent driving system, which is a system that integrates information control technology, environmental perception capabilities, multi-level assisted driving and other functions. Schematically, during the driving process of the vehicle, the driver does not need to autonomously control the vehicle, and the vehicle can perform driving, steering and other functions normally.

[0031] Steering wheel holding condition: refers to the condition in which the driver holds the steering wheel in the vehicle. The steering wheel holding condition includes holding state and not holding state. Holding state means that the steering wheel in the vehicle is controlled by the driver. In this case, the driver actively controls the steering wheel to control the steering and other functions of the vehicle. Not holding state means that the steering wheel in the vehicle is not controlled by the driver. In this case, the vehicle is controlled by the intelligent driving system to implement the automatic driving function.

[0032] Secondly, Figure 1 A block diagram of a computer system provided by an exemplary embodiment is shown. Based on the block diagram, the execution process of the method for canceling a vehicle alarm provided by an embodiment of the present application is introduced. The computer system 100 includes a vehicle 101. The following process is introduced by taking the execution subject as the vehicle 101 as an example.

[0033] The vehicle 101 includes an intelligent driving system. After the intelligent driving system in the vehicle 101 is turned on, the vehicle is in the process of automatic driving, and the steering wheel holding condition in the vehicle 101 is obtained to determine the control condition of the steering wheel in the vehicle.

[0034] If the steering wheel 102 in the vehicle is in a controlled state, that is, the steering wheel 102 is not held, it means that the driver's hands are not in contact with the steering wheel 102 of the vehicle 101. At this time, the intelligent driving system in the vehicle 101 needs to issue a hands-off alarm to the vehicle. Specifically, a warning message is broadcast in the vehicle 101, and the warning message indicates that the driver needs to apply external force to the steering wheel 102 during the automatic driving process.

[0035] When the driver receives the alarm information, he / she makes feedback based on the alarm information.

[0036] In the embodiment of the present application, the driving subject makes voice feedback based on the alarm information and generates a voice feedback signal. After receiving the voice feedback, the vehicle 101 cancels the broadcast of the alarm information.

[0037] Indicatively, if the vehicle 101 does not detect the driver's hand applying external force to the steering wheel 102 within five minutes, the vehicle 101 displays the text "Please operate the steering wheel with your hands!" on the dashboard and plays the corresponding alarm information of "Please operate the steering wheel with your hands". After hearing or seeing the alarm information, the driver says "I am here" or "I know", and the vehicle recognizes the voice content, and the voice content meets the cancellation requirement, and cancels the warning information.

[0038] like Figure 2 As shown, Figure 2 The flowchart of the execution of the method for canceling a vehicle alarm provided by an exemplary embodiment of the present application is shown. The method is described by taking the vehicle as the execution subject.

[0039] Step 201, during the automatic driving process of the vehicle, obtain the steering wheel holding condition in the vehicle.

[0040] In an embodiment of the present application, the autonomous driving function status of the vehicle is obtained, and the autonomous driving function status is used to indicate whether the vehicle supports the autonomous driving function.

[0041] In response to an indication that the vehicle has the automatic driving function, during the driving of the vehicle, it is detected whether the automatic driving function of the vehicle is turned on.

[0042] In response to the vehicle turning on the automatic driving function, the steering wheel holding condition in the vehicle is obtained.

[0043] Among them, the steering wheel holding condition refers to the control condition of the steering wheel in the vehicle.

[0044] Optionally, in an autonomous driving scenario, the steering wheel is controlled by passive external force and automatic internal force.

[0045] External force controlled means that the steering wheel turns when subjected to external force, and internal force automatic controlled means that the steering wheel turns automatically with the assistance of the intelligent driving system without being subjected to external force.

[0046] In an optional embodiment, a torque sensor is provided at the steering wheel in the vehicle, and the torque sensor determines a corresponding torque value when the steering wheel rotates.

[0047] Optionally, a real-time torque value corresponding to the steering wheel is obtained through a torque sensor; and the steering wheel grip condition corresponding to the vehicle is determined based on the real-time torque value.

[0048] When the real-time torque value does not reach the preset torque value threshold within the preset time, the steering wheel holding condition is determined to be not held. At this time, the intelligent driving system assists the vehicle in automatic driving, and the driving subject does not apply external force control to the steering wheel alone.

[0049] When the real-time torque value reaches the preset torque value threshold within the preset time, it is determined that the steering wheel holding condition is maintained, which means that the torque value generated by the rotation of the steering wheel in the vehicle is generated by the driver applying external force to the steering wheel.

[0050] Step 202, broadcasting an alarm message based on the steering wheel holding condition.

[0051] Optionally, in response to the steering wheel being held in an unheld state, the vehicle broadcasts an alarm message.

[0052] The warning message refers to the driver applying external force control to the steering wheel during the automatic driving process.

[0053] In schematic form, when the torque sensor fails to detect a torque value within a specified time, the vehicle is completely assisted in driving by the intelligent driving system, which has a certain impact on the driving safety of the driver. At this time, the vehicle needs to broadcast an alarm message to remind the driver that the driver has not held the steering wheel for a long time and needs to apply external force to the steering wheel separately so that the vehicle knows that the driver's focus is still on the driving process.

[0054] The alarm information may be implemented as any one or more of the following information.

[0055] The warning information is implemented as text warning information, which is displayed on a display screen that supports image display function in the vehicle. For example, the dashboard screen, the in-vehicle intelligent terminal screen, etc. In an optional embodiment, when the vehicle glass of the vehicle is a visual glass, the text warning information is displayed on the vehicle glass. In order not to affect the normal driving of the driving subject, the text warning information is displayed on the vehicle glass on the front left and / or front right, and the display transparency of the text content in the text prompt information is low.

[0056] The alarm information is implemented as voice alarm information, which is sent and played by the intelligent driving system in the vehicle to the voice playback component.

[0057] The warning information is implemented as image warning information, and the image warning information is displayed on a display screen with a visual image display function in the vehicle. The image warning information includes at least one of an icon warning, a video warning, etc. The display carrier can refer to the display carrier of the above-mentioned text warning information.

[0058] The alarm information is implemented as a breathing light flashing alarm information. A breathing light assembly is provided on the inner peripheral side of the vehicle. The breathing light assembly is a device that controls the gradual change of light brightness through the intelligent driving system.

[0059] The alarm information is implemented by sending an alarm information to an associated device. The associated device is implemented as a device that establishes a communication connection with the vehicle or a device corresponding to an account stored in the vehicle. Optionally, a communication connection is established between the vehicle and the smart terminal used by the driving subject. When the steering wheel is held in an unheld state, the vehicle device sends a warning message to the smart terminal; or, the vehicle sends a warning message to an in-vehicle application installed in the smart terminal, and the in-vehicle application pushes the alarm message. In another optional embodiment, multiple accounts are stored in the vehicle. When the steering wheel is held in an unheld state, the vehicle device automatically sends a message to the smart terminal corresponding to the account so that the recipient can remind the driving subject through remote communication methods.

[0060] In an embodiment of the present application, the above-mentioned alarm information can support custom operations. In response to receiving a custom operation on the alarm information, the warning content corresponding to the alarm information is edited and created.

[0061] Indicatively, the relevant personnel edit the text content displayed in the text alert message, such as: Please concentrate on driving; or the relevant personnel record or download audio and video from the cloud as the alert message, etc., and the content of the customized operation alert message is not limited in this application. Among them, the relevant personnel can be developers, driving subjects, or other users, and this application does not limit this.

[0062] Step 203: in response to receiving a voice feedback signal for the alarm information, canceling the broadcast of the alarm information.

[0063] Among them, the voice feedback signal meets the requirement of canceling the broadcast of the alarm information.

[0064] Optionally, a sound collection component is provided in the vehicle, and the sound collection component is used to collect sound information in the vehicle.

[0065] In the embodiment of the present application, when the steering wheel is not held, the sound collection component is enabled to collect sound information in the vehicle.

[0066] The sound information includes in-car sound information and out-car sound information. The out-car sound information in the sound information is filtered out by the sound analysis model, and then the remaining in-car sound information is sound enhanced so as to analyze the sound content in the sound information later.

[0067] The sound content in the sound information after the sound enhancement processing is identified.

[0068] Determine whether there is a preset sound content in the sound content, and decide whether to cancel the alarm information according to the determination result.

[0069] Optionally, in response to the presence of preset sound content in the sound content, the alarm information is canceled; in response to the absence of preset sound content in the sound content, the alarm information continues to be broadcasted.

[0070] Indicatively, the preset sound content is "yes", and the vehicle analyzes whether "yes" exists in the collected sound information. If so, the alarm information is canceled.

[0071] In another optional embodiment, preset sound information of the driving subject and preset sound features corresponding to the preset sound information are pre-stored in the vehicle, and the preset sound features include at least one of timbre, pitch, etc.

[0072] The real-time sound feature corresponding to the sound information is determined, and in response to the real-time sound feature matching the preset sound feature, the broadcast of the alarm information is cancelled.

[0073] In the implementation of this application, during the automatic driving process assisted by the intelligent driving system, when the driving subject does not hold the steering wheel for a long time, an alarm message is broadcast in the vehicle to prompt the driving subject to apply external force control to the steering wheel. After the vehicle broadcasts the alarm message, it is necessary to cancel the broadcast of the alarm message through the feedback of the driving subject. In the embodiment of this application, a voice feedback mechanism is introduced. After the cancellation broadcast requirement of the alarm message is detected in the vehicle, the alarm message is stopped, such as: the voice feedback signal "OK" is detected in the vehicle, and the alarm message is directly canceled. On the one hand, the discomfort and cumbersome operation caused by the frequent and active twisting of the steering wheel by the driving subject are reduced, and the human-computer interaction efficiency between the driving subject and the vehicle is reduced to a certain extent; on the other hand, the feedback method of using sound interaction to feedback to the vehicle instead of twisting the steering wheel reduces the risk of the driving subject accidentally twisting the steering wheel too much to a certain extent, and improves driving safety.

[0074] like Figure 3 As shown, Figure 3 The following is a flowchart of the execution flow of a method for canceling a vehicle alarm provided by another exemplary embodiment of the present application. The method is described by taking the vehicle as the execution subject. The following mainly describes in detail the method for canceling the broadcast alarm information.

[0075] Step 300, in response to the presence of preset sound content in the sound content, cancel the broadcast of the alarm information.

[0076] Optionally, for the relevant contents of the alarm information, please refer to the above step 202, which will not be repeated here.

[0077] Optionally, methods for canceling the broadcast of the alarm information include but are not limited to any one of the following methods.

[0078] The first method is through voice feedback and image feedback.

[0079] Optionally, an image acquisition component is provided in the vehicle, and the image acquisition component is used to capture the main driving position in the vehicle to generate an image of the driving subject.

[0080] In an embodiment of the present application, an image analysis model is used to identify the image of the driving subject and determine the image content.

[0081] In response to the image content meeting the preset image requirement and the sound content containing the preset sound content, the broadcasting of the alarm information is cancelled.

[0082] Among them, the preset image requirement is used to indicate that the driver's hands need to be placed on the steering wheel.

[0083] Indicatively, when the driver places his hands on the steering wheel and says "I'm here", the warning message is canceled.

[0084] The second method is through voice feedback and pressure feedback.

[0085] Optionally, a pressure sensor is provided inside the vehicle, and the pressure sensor can be set at a position within a preset distance from the driver to ensure that the driver can touch the pressure sensor, so as to facilitate the subsequent cancellation of the alarm information through the pressure sensor.

[0086] In the embodiment of the present application, the pressure sensor is arranged at any position on the steering wheel.

[0087] The corresponding pressure value is detected by the pressure sensor; in response to the pressure value meeting the preset pressure value requirement and the presence of preset sound content in the sound content, the alarm information is canceled.

[0088] The preset pressure value requirement is used to indicate that the pressure value applied by the driving subject on the pressure sensor reaches or exceeds the preset pressure value.

[0089] In another optional embodiment, the corresponding number of pressure jumps is detected by a pressure sensor; in response to the number of pressure jumps meeting a preset number requirement and the presence of preset sound content in the sound content, the broadcast warning message is canceled.

[0090] The third method is through voice feedback and fingerprint feedback.

[0091] Optionally, a fingerprint sensor is provided inside the vehicle, and the fingerprint sensor can be set at a position within a preset distance from the driver to ensure that the driver can touch the fingerprint sensor, so as to facilitate the subsequent cancellation of the alarm information through the fingerprint sensor.

[0092] Optionally, preset fingerprint information of the driver is pre-stored in the vehicle.

[0093] After the alarm information is broadcast, the fingerprint sensor is enabled to collect real-time fingerprint information;

[0094] In response to the real-time fingerprint information matching the preset fingerprint information and the presence of preset sound content in the sound content, the alarm information is canceled.

[0095] The fourth method is through voice feedback and operation feedback.

[0096] Optionally, the vehicle includes a display screen corresponding to the vehicle intelligent terminal. The driver can view image information on the display screen and perform interactive behaviors on the display screen.

[0097] After the alarm message is broadcast, the gesture collection page is called out on the display screen.

[0098] The operation gesture corresponding to the driving subject is collected through the gesture collection page, and in response to the operation gesture being consistent with the preset gesture and the preset sound content being present in the sound content, the alarm information is canceled.

[0099] Indicatively, after the alarm message sounds, a gesture collection page is called out on the display screen of the vehicle terminal, and the driver draws a circular pattern on the page, which meets the preset gesture requirements. After "I am here" appears in the collected sound content, the alarm message is canceled.

[0100] The applicant needs to emphasize that the above four cancellation methods all combine the content of voice feedback, and any one of the four cancellation methods can be used as a condition for the cancellation method, or any two or more of the four cancellation methods can be combined as a condition for the cancellation method. This application does not limit this.

[0101] In the implementation of this application, during the automatic driving process assisted by the intelligent driving system, when the driving subject does not hold the steering wheel for a long time, an alarm message is broadcast in the vehicle to prompt the driving subject to apply external force control to the steering wheel. After the vehicle broadcasts the alarm message, it is necessary to cancel the broadcast of the alarm message through the feedback of the driving subject. In the embodiment of this application, a voice feedback mechanism is introduced. After the cancellation broadcast requirement of the alarm message is detected in the vehicle, the alarm message is stopped, such as: the voice feedback signal "OK" is detected in the vehicle, and the alarm message is directly canceled. On the one hand, the discomfort and cumbersome operation caused by the frequent and active twisting of the steering wheel by the driving subject are reduced, and the human-computer interaction efficiency between the driving subject and the vehicle is reduced to a certain extent; on the other hand, the feedback method of using sound interaction to feedback to the vehicle instead of twisting the steering wheel reduces the risk of the driving subject accidentally twisting the steering wheel too much to a certain extent, and improves driving safety.

[0102] In the embodiment of the present application, a variety of alarm cancellation methods are provided for the driver, which provides a simpler and more efficient method under the premise of reducing the complexity of the driver's operation (here refers to turning the steering wheel and reaching a specified turning angle). It can not only improve the cancellation efficiency of the alarm information broadcast, but also draw the driver's attention back to the driver, avoiding dangerous situations during driving.

[0103] like Figure 4 As shown, Figure 4 The flowchart of the execution flow of the method for canceling a vehicle alarm provided by another exemplary embodiment of the present application is shown. The method is described by taking the vehicle as the execution subject. The following mainly describes the content of determining the steering wheel holding condition.

[0104] Step 400, obtaining the steering wheel holding condition in the vehicle.

[0105] Optionally, a torque sensor is provided at the steering wheel in the vehicle.

[0106] Among them, the content of determining the steering wheel holding condition only through the real-time torque value collected by the torque sensor, please refer to the above step 201, which will not be repeated here.

[0107] The real-time torque value of the steering wheel is obtained through the torque sensor.

[0108] Get the real-time steering angle corresponding to the vehicle wheels, which is used to indicate the angle at which the wheels rotate as the steering wheel turns.

[0109] By comparing the real-time torque value and the real-time steering angle, it is determined whether the rotation is caused by the driver's control or automatically generated with the assistance of the intelligent assistance system. In other words, the steering wheel holding condition is determined based on the real-time torque value and the real-time steering angle.

[0110] Optionally, based on the real-time torque value, a preset steering angle corresponding to the wheel is determined. In response to the difference between the preset steering angle and the real-time steering angle meeting the preset difference requirement, the steering wheel holding condition is determined to be a holding state, and the non-holding state is used to indicate that the steering wheel in the vehicle is controlled by the driving subject. In response to the difference not meeting the preset difference requirement, the steering wheel holding condition is determined to be a non-holding state, and the holding state is used to indicate that the steering wheel in the vehicle is not controlled by the driving subject.

[0111] In the implementation of this application, during the automatic driving process assisted by the intelligent driving system, when the driving subject does not hold the steering wheel for a long time, an alarm message is broadcast in the vehicle to prompt the driving subject to apply external force control to the steering wheel. After the vehicle broadcasts the alarm message, it is necessary to cancel the broadcast of the alarm message through the feedback of the driving subject. In the embodiment of this application, a voice feedback mechanism is introduced. After the cancellation broadcast requirement of the alarm message is detected in the vehicle, the alarm message is stopped, such as: the voice feedback signal "OK" is detected in the vehicle, and the alarm message is directly canceled. On the one hand, the discomfort and cumbersome operation caused by the frequent and active twisting of the steering wheel by the driving subject are reduced, and the human-computer interaction efficiency between the driving subject and the vehicle is reduced to a certain extent; on the other hand, the feedback method of using sound interaction to feedback to the vehicle instead of twisting the steering wheel reduces the risk of the driving subject accidentally twisting the steering wheel too much to a certain extent, and improves driving safety.

[0112] In the embodiment of the present application, in one case, when the driver turns the steering wheel, he prefers to turn the steering wheel a little more. In order to identify this situation, by comparing the turning angles corresponding to the wheels and the turning angles corresponding to the steering wheel to see whether they meet the preset difference requirements, it is determined whether the steering is performed under the control of the driver. To a certain extent, the accuracy of identifying the steering wheel holding situation is improved.

[0113] like Figure 5 As shown, Figure 5 A schematic diagram of a module for executing a method for canceling a vehicle alarm provided by another exemplary embodiment of the present application is shown. The module 500 includes a steering wheel torque sensor 501, an electric power steering system 502, an intelligent driving assistance system 503, a timer 504, an intelligent driving host controller 505, a speech recognition system 506, and a driving subject 507.

[0114] The steering wheel torque sensor 501 is used to collect the real-time torque value corresponding to the steering wheel rotation.

[0115] When the steering wheel torque sensor 501 collects the real-time torque value, the timer 504 is triggered.

[0116] The steering wheel torque sensor 501 and the timer 504 send the data generated by themselves to the electric power steering system 502 .

[0117] Optionally, after receiving data from the steering wheel torque sensor 501 and the timer 505 , the electric power steering system 502 determines the steering wheel holding condition in the vehicle.

[0118] When the timer 504 reaches a preset time and the real-time torque value does not reach a preset torque value, the electric power steering system 502 determines that the steering wheel is held as a non-held state and generates a hands-off alarm signal.

[0119] When the timer 504 reaches the preset time length and the real-time torque value is greater than the preset torque value, the timer 504 is reset.

[0120] Optionally, the electric power steering system 502 sends a hands-off warning signal to the intelligent driving host controller 505 .

[0121] Based on the hands-off warning signal, the intelligent driving host controller 505 displays a text warning signal on the instrument panel and plays an alarm audio.

[0122] At this time, the intelligent driving host controller enables the voice recognition system 506 to collect the sound information of the driving subject 507, determines whether the preset sound content appears in the sound information, and sends the judgment result to the intelligent driving host controller 505.

[0123] In response to the presence of preset voice content (such as: I am here) in the voice information, the voice recognition system 506 sends the judgment result (preset voice content exists) to the intelligent driving host controller 505, and the intelligent driving host controller 505 cancels the broadcast of the alarm signal.

[0124] In the implementation of this application, during the automatic driving process assisted by the intelligent driving system, when the driving subject does not hold the steering wheel for a long time, an alarm message is broadcast in the vehicle to prompt the driving subject to apply external force control to the steering wheel. After the vehicle broadcasts the alarm message, it is necessary to cancel the broadcast of the alarm message through the feedback of the driving subject. In the embodiment of this application, a voice feedback mechanism is introduced. After the cancellation broadcast requirement of the alarm message is detected in the vehicle, the alarm message is stopped, such as: the voice feedback signal "OK" is detected in the vehicle, and the alarm message is directly canceled. On the one hand, the discomfort and cumbersome operation caused by the frequent and active twisting of the steering wheel by the driving subject are reduced, and the human-computer interaction efficiency between the driving subject and the vehicle is reduced to a certain extent; on the other hand, the feedback method of using sound interaction to feedback to the vehicle instead of twisting the steering wheel reduces the risk of the driving subject accidentally twisting the steering wheel too much to a certain extent, and improves driving safety.

[0125] Figure 6 The structure block diagram of a device for canceling a vehicle alarm provided by an exemplary embodiment of the present application is shown, and the device includes:

[0126] An acquisition module 600 is used to acquire a steering wheel holding condition in the vehicle during the automatic driving process of the vehicle, wherein the steering wheel holding condition is used to indicate a controlled condition of the steering wheel in the vehicle;

[0127] A playback module 601 is used to broadcast an alarm message based on the steering wheel holding condition, wherein the alarm message is used to instruct the driving subject of the vehicle to apply external force control to the steering wheel during the automatic driving process;

[0128] The playing module 601 is further configured to cancel broadcasting of the alarm information in response to receiving a voice feedback signal for the alarm information, wherein the voice feedback signal meets a requirement for canceling broadcasting of the alarm information.

[0129] In an optional embodiment, if Figure 7 As shown, the device further includes a collection module 602;

[0130] A collection module 602 is used to collect sound information in the vehicle through a sound collection component;

[0131] A determination module 603, configured to determine the sound content of the sound information;

[0132] The playing module 601 is further configured to cancel the broadcasting of the alarm information in response to the presence of preset sound content in the sound content.

[0133] In an optional embodiment, if Figure 7 As shown, the device further includes an identification module 604;

[0134] The recognition module 604 is used to obtain and recognize the image of the driving subject through the image acquisition component;

[0135] The playing module 601 is further configured to cancel the broadcasting of the alarm information in response to the image content in the driving subject image meeting the preset image requirement and the sound content containing the preset sound content.

[0136] In an optional embodiment, if Figure 7 As shown, a pressure sensor is provided on the steering wheel in the vehicle;

[0137] The acquisition module 600 is further used to acquire the pressure value corresponding to the pressure sensor;

[0138] The playing module 601 is further configured to cancel the broadcasting of the alarm information in response to the pressure value meeting the preset pressure value requirement and the sound content containing the preset sound content.

[0139] In an optional embodiment, if Figure 7 As shown, a fingerprint sensor is provided on the steering wheel in the vehicle;

[0140] The acquisition module 600 is further used to acquire real-time fingerprint information through the fingerprint sensor;

[0141] The playing module 601 is further configured to cancel the broadcasting of the alarm information in response to the real-time fingerprint information matching the preset fingerprint information and the presence of preset sound content in the sound content.

[0142] In an optional embodiment, if Figure 7 As shown, the acquisition module 600 is also used to acquire the real-time torque value corresponding to the steering wheel of the vehicle through a torque sensor;

[0143] The acquisition module 600 is further used to acquire the steering angle corresponding to the vehicle wheel;

[0144] The determination module 603 is further configured to determine the steering wheel holding condition corresponding to the vehicle based on the real-time torque value and the real-time steering angle.

[0145] In an optional embodiment, if Figure 7 As shown, the determination module 603 is further used to determine the preset steering angle corresponding to the wheel based on the real-time torque value;

[0146] The determination module 603 is further configured to determine that the steering wheel holding state is a holding state in response to the difference between the preset steering angle and the real-time steering angle meeting a preset difference requirement, and the non-holding state is used to indicate that the steering wheel in the vehicle is controlled by the driving subject;

[0147] The determination module 603 is further configured to determine, in response to the difference not meeting the preset difference requirement, that the steering wheel holding state is an unheld state, wherein the held state is configured to indicate that the steering wheel in the vehicle is not controlled by the driving subject.

[0148] In an optional embodiment, the alarm information includes at least one of voice alarm information, text alarm information, image alarm information, and breathing light flashing alarm information.

[0149] In an embodiment of the present application, during the automatic driving process assisted by the intelligent driving system, when the driving subject does not hold the steering wheel for a long time, an alarm message is broadcast in the vehicle to prompt the driving subject to apply external force control to the steering wheel. After the vehicle broadcasts the alarm message, it is necessary to cancel the broadcast of the alarm message through the feedback of the driving subject. In an embodiment of the present application, a voice feedback mechanism is introduced. After the cancellation broadcast requirement that meets the cancellation alarm message is detected in the vehicle, the alarm message is stopped, such as: the voice feedback signal "OK" is detected in the vehicle, and the alarm message is directly canceled. On the one hand, the discomfort and cumbersome operation caused by the frequent and active twisting of the steering wheel by the driving subject are reduced, and the human-computer interaction efficiency between the driving subject and the vehicle is reduced to a certain extent; on the other hand, the feedback method of using sound interaction to feedback to the vehicle instead of twisting the steering wheel reduces the risk of the driving subject accidentally twisting the steering wheel too much to a certain extent, and improves driving safety.

[0150] Figure 8 The block diagram of the structure of a computer device 800 provided by an exemplary embodiment of the present application is shown. The computer device 800 may be a portable mobile terminal, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The computer device 800 may also be referred to as a user device, a portable terminal, a laptop terminal, a desktop terminal or other names. Optionally, the computer device 800 may also be implemented as a movable device, such as a movable intelligent terminal such as a vehicle-mounted terminal.

[0151] Typically, the computer device 800 includes a processor 801 and a memory 802 .

[0152] The processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 801 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 801 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0153] The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store at least one instruction, which is used to be executed by the processor 801 to implement the model training method or behavior coding method provided in the method embodiment of the present application.

[0154] In some embodiments, the computer device 800 may further optionally include: a peripheral device interface 803 and at least one peripheral device. The processor 801, the memory 802 and the peripheral device interface 803 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 803 via a bus, a signal line or a circuit board. For example, the peripheral device may include: at least one of a radio frequency circuit 804, a display screen 805, a camera assembly 806, an audio circuit 807, a positioning assembly 815 and a power supply 808.

[0155] The peripheral device interface 803 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 801 and the memory 802. In some embodiments, the processor 801, the memory 802, and the peripheral device interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 801, the memory 802, and the peripheral device interface 803 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0156] The radio frequency circuit 804 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 804 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency circuit 804 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 804 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 804 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0157] The display screen 805 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 805 is a touch display screen, the display screen 805 also has the ability to collect touch signals on the surface or above the surface of the display screen 805. The touch signal can be input to the processor 801 as a control signal for processing. At this time, the display screen 805 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 805 can be one, set on the front panel of the computer device 800; in other embodiments, the display screen 805 can be at least two, respectively set on different surfaces of the computer device 800 or in a folding design; in other embodiments, the display screen 805 can be a flexible display screen, set on the curved surface or folding surface of the computer device 800. Even, the display screen 805 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 805 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0158] The camera assembly 806 is used to capture images or videos. Optionally, the camera assembly 806 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 806 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0159] The audio circuit 807 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 801 for processing, or input them into the radio frequency circuit 804 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the computer device 800. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 801 or the radio frequency circuit 804 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 807 may also include a headphone jack.

[0160] The positioning component 815 is used to locate the current geographical location of the computing device 800 to implement navigation or LBS (Location Based Service). The positioning component 815 can be a positioning component based on the US GPS (Global Positioning System) or China's Beidou system.

[0161] The power supply 808 is used to power various components in the computer device 800. The power supply 808 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 808 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged through a wired line, and a wireless rechargeable battery is a battery that is charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0162] In some embodiments, the computer device 800 further includes one or more sensors 809 , including but not limited to: an acceleration sensor 810 , a gyroscope sensor 811 , a pressure sensor 812 , an optical sensor 813 , and a proximity sensor 814 .

[0163] The acceleration sensor 810 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the computer device 800. For example, the acceleration sensor 810 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 801 can control the display screen 805 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 810. The acceleration sensor 810 can also be used to collect motion data of games or users.

[0164] The gyro sensor 811 can detect the body direction and rotation angle of the computer device 800, and the gyro sensor 811 can cooperate with the acceleration sensor 810 to collect the user's 3D actions on the computer device 800. The processor 801 can implement the following functions based on the data collected by the gyro sensor 811: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0165] The pressure sensor 812 can be set on the side frame of the computer device 800 and / or the lower layer of the display screen 805. When the pressure sensor 812 is set on the side frame of the computer device 800, it can detect the user's grip signal of the computer device 800, and the processor 801 performs left and right hand recognition or shortcut operations according to the grip signal collected by the pressure sensor 812. When the pressure sensor 812 is set on the lower layer of the display screen 805, the processor 801 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 805. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0166] The optical sensor 813 is used to collect the ambient light intensity. In one embodiment, the processor 801 can control the display brightness of the display screen 805 according to the ambient light intensity collected by the optical sensor 813. For example, when the ambient light intensity is high, the display brightness of the display screen 805 is increased; when the ambient light intensity is low, the display brightness of the display screen 805 is reduced. In another embodiment, the processor 801 can also dynamically adjust the shooting parameters of the camera component 806 according to the ambient light intensity collected by the optical sensor 813.

[0167] The proximity sensor 814, also called a distance sensor, is usually disposed on the front panel of the computer device 800. The proximity sensor 814 is used to collect the distance between the user and the front of the computer device 800. In one embodiment, when the proximity sensor 814 detects that the distance between the user and the front of the computer device 800 is gradually decreasing, the processor 801 controls the display screen 805 to switch from the screen-on state to the screen-off state; when the proximity sensor 814 detects that the distance between the user and the front of the computer device 800 is gradually increasing, the processor 801 controls the display screen 805 to switch from the screen-off state to the screen-on state.

[0168] Those skilled in the art will understand that Figure 8 The structure shown in the figure does not constitute a limitation on the computer device 800, and the computer device 800 may include more or less components than those shown in the figure, or combine some components, or adopt a different arrangement of components.

[0169] The present application also provides a computer-readable storage medium, in which at least one instruction, at least one program, a code set or an instruction set is stored. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the method for identifying the operating status of a pipeline network provided in the above method embodiment.

[0170] The present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method for identifying the operation status of a pipeline network provided in the above method embodiment.

[0171] Those of ordinary skill in the art will appreciate that all or part of the steps to implement the above-mentioned embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware to accomplish the steps. The program may be stored in a computer-readable storage medium, and the storage medium mentioned above may be a read-only memory, a disk, or an optical disk, etc. The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application. The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for cancelling a vehicle alarm, characterized in that: The method comprises: During the automatic driving of the vehicle, obtaining a steering wheel holding condition in the vehicle, wherein the steering wheel holding condition is used to indicate a controlled condition of the steering wheel in the vehicle; Based on the steering wheel holding condition, an alarm message is broadcasted, wherein the alarm message is used to instruct the driving subject of the vehicle to apply external force control to the steering wheel during the automatic driving process; In response to receiving a voice feedback signal for the alarm information, canceling the broadcasting of the alarm information, wherein the voice feedback signal meets a requirement for canceling the broadcasting of the alarm information.

2. The method according to claim 1, characterized in that In response to receiving a voice feedback signal for the alarm information, canceling the broadcast of the alarm information comprises: collecting sound information in the vehicle by means of a sound collection component; Determining the sound content of the sound information; In response to the presence of preset sound content in the sound content, canceling the broadcasting of the alarm information.

3. The method according to claim 2, characterized in that In response to the presence of preset sound content in the sound content, cancelling the broadcasting of the alarm information includes: Acquire and recognize the image of the driving subject through the image acquisition component; In response to the image content in the driving subject image meeting the preset image requirement and the sound content containing the preset sound content, the broadcasting of the alarm information is canceled.

4. The method according to claim 2, characterized in that: A pressure sensor is provided on the steering wheel in the vehicle; In response to the presence of preset sound content in the sound content, cancelling the broadcasting of the alarm information includes: Obtaining a pressure value corresponding to the pressure sensor; In response to the pressure value meeting the preset pressure value requirement and the sound content containing the preset sound content, the alarm information is canceled.

5. The method according to claim 2, characterized in that: A fingerprint sensor is provided on the steering wheel in the vehicle; In response to the presence of preset sound content in the sound content, cancelling the broadcasting of the alarm information includes: Acquiring real-time fingerprint information through the fingerprint sensor; In response to the real-time fingerprint information matching the preset fingerprint information, and the sound content containing the preset sound content, the alarm information is canceled from being broadcasted.

6. The method according to any one of claims 1 to 5, characterized in that: The obtaining of the steering wheel holding condition in the vehicle includes: Acquiring a real-time torque value corresponding to a steering wheel of the vehicle through a torque sensor; Obtaining a real-time steering angle corresponding to the vehicle wheel; Based on the real-time torque value and the real-time steering angle, the steering wheel holding condition corresponding to the vehicle is determined.

7. The method according to claim 6, characterized in that The determining the steering wheel holding condition corresponding to the vehicle based on the real-time torque value and the real-time steering angle includes: Determining a preset steering angle corresponding to the wheel based on the real-time torque value; In response to a difference between the preset steering angle and the real-time steering angle meeting a preset difference requirement, determining that the steering wheel holding condition is a holding state, wherein the non-holding state is used to indicate that the steering wheel in the vehicle is controlled by the driving subject; In response to the difference not meeting the preset difference requirement, the steering wheel holding condition is determined to be an unheld state, where the held state is used to indicate that the steering wheel in the vehicle is not controlled by the driving subject.

8. The method according to any one of claims 1 to 5, characterized in that: The alarm information includes at least one of voice alarm information, text alarm information, image alarm information, and breathing light flashing alarm information.

9. A vehicle alarm cancellation device, characterized in that: The device comprises: An acquisition module, used to acquire a steering wheel holding condition in the vehicle during the automatic driving process of the vehicle, wherein the steering wheel holding condition is used to indicate a controlled condition of the steering wheel in the vehicle; A playback module, configured to broadcast an alarm message based on the gripping condition of the steering wheel, wherein the alarm message is used to instruct the driving subject of the vehicle to apply external force control to the steering wheel during the automatic driving process; The playing module is further used to cancel the broadcasting of the alarm information in response to receiving a voice feedback signal for the alarm information, wherein the voice feedback signal meets the requirement for canceling the broadcasting of the alarm information.

10. A computer device, characterized in that: The computer device includes a processor and a memory, wherein at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement the vehicle alarm cancellation method according to any one of claims 1 to 8.

Images